2020-01-16T05:26:55.572 INFO:root:teuthology version: 1.0.0-c041b76 2020-01-16T05:26:55.572 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.gpUcLl.tmp -- --verbose --lock --description fs/thrash/{begin.yaml ceph-thrash/mds.yaml clusters/1-mds-1-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/cfuse_workunit_trivial_sync.yaml} --name pdonnell-2020-01-16_04:36:36-fs-wip-pdonnell-testing-20200116.003219-distro-basic-smithi --block --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2020-01-16_04:36:36-fs-wip-pdonnell-testing-20200116.003219-distro-basic-smithi/4672934 2020-01-16T05:26:55.608 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-01-16T05:26:55.681 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2020-01-16_04:36:36-fs-wip-pdonnell-testing-20200116.003219-distro-basic-smithi/4672934 branch: wip-pdonnell-testing-20200116.003219 description: fs/thrash/{begin.yaml ceph-thrash/mds.yaml clusters/1-mds-1-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/cfuse_workunit_trivial_sync.yaml} email: pdonnell@redhat.com first_in_suite: false job_id: '4672934' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2020-01-16_04:36:36-fs-wip-pdonnell-testing-20200116.003219-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: wip-pdonnell-testing-20200116.003219 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 global: mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: osd mds ms inject socket failures: 2500 mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - not responding, replacing - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 07713629e135b47dc5ec2a85f60649826e17a6cd ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 07713629e135b47dc5ec2a85f60649826e17a6cd thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20200116.003219 sha1: 07713629e135b47dc5ec2a85f60649826e17a6cd owner: scheduled_pdonnell@teuthology priority: 90 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 sha1: 07713629e135b47dc5ec2a85f60649826e17a6cd suite: fs suite_branch: wip-pdonnell-testing-20200116.003219 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200116.003219/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 07713629e135b47dc5ec2a85f60649826e17a6cd tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - ceph: null - mds_thrash: null - ceph-fuse: null - workunit: clients: all: - fs/misc/trivial_sync.sh teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.5530 2020-01-16T05:26:55.682 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200116.003219/qa; will attempt to use it 2020-01-16T05:26:55.682 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200116.003219/qa/tasks 2020-01-16T05:26:55.683 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-01-16T05:26:55.684 INFO:teuthology.task.internal:Checking packages... 2020-01-16T05:26:55.698 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '07713629e135b47dc5ec2a85f60649826e17a6cd' 2020-01-16T05:26:55.699 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-01-16T05:26:55.699 INFO:teuthology.packaging:ref: None 2020-01-16T05:26:55.699 INFO:teuthology.packaging:tag: None 2020-01-16T05:26:55.699 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20200116.003219 2020-01-16T05:26:55.699 INFO:teuthology.packaging:sha1: 07713629e135b47dc5ec2a85f60649826e17a6cd 2020-01-16T05:26:55.699 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=wip-pdonnell-testing-20200116.003219 2020-01-16T05:26:55.861 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-9376-g0771362-1bionic 2020-01-16T05:26:55.862 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-01-16T05:26:55.871 INFO:teuthology.task.internal:no buildpackages task found 2020-01-16T05:26:55.871 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-01-16T05:26:55.920 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-01-16T05:26:55.920 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-01-16T05:26:55.988 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-01-16T05:27:06.003 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-01-16T05:27:16.014 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-01-16T05:27:26.032 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-01-16T05:27:36.051 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-01-16T05:27:46.068 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-01-16T05:27:56.083 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-01-16T05:28:06.104 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-01-16T05:28:16.122 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-01-16T05:28:26.133 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-01-16T05:28:36.153 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-01-16T05:28:46.171 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-01-16T05:28:56.187 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-01-16T05:29:06.203 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-01-16T05:29:16.219 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_pdonnell@teuthology', 'description': '/home/teuthworker/archive/pdonnell-2020-01-16_04:36:36-fs-wip-pdonnell-testing-20200116.003219-distro-basic-smithi/4672934', 'machine_type': 'smithi'} 2020-01-16T05:29:16.238 DEBUG:teuthology.lock.ops:locked ubuntu@smithi084.front.sepia.ceph.com, ubuntu@smithi142.front.sepia.ceph.com 2020-01-16T05:29:16.292 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-01-16T05:29:16.503 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of ubuntu 18.04 2020-01-16T05:29:16.505 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of ubuntu 18.04 2020-01-16T05:29:16.931 INFO:teuthology.orchestra.console:Power off smithi084 2020-01-16T05:29:16.931 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-01-16T05:29:16.951 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-16T05:29:16.975 INFO:teuthology.orchestra.console:Power off smithi142 2020-01-16T05:29:16.976 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-01-16T05:29:16.998 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-16T05:29:17.087 INFO:teuthology.orchestra.console:Power off for smithi084 completed 2020-01-16T05:29:17.119 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2020-01-16T05:29:17.188 INFO:teuthology.orchestra.console:Power on smithi084 2020-01-16T05:29:17.189 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-01-16T05:29:17.220 INFO:teuthology.orchestra.console:Power on smithi142 2020-01-16T05:29:17.221 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-01-16T05:29:17.229 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-16T05:29:17.239 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-16T05:29:21.252 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-16T05:29:21.260 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-16T05:29:21.461 INFO:teuthology.orchestra.console:Power on for smithi084 completed 2020-01-16T05:29:21.468 INFO:teuthology.orchestra.console:Power on for smithi142 completed 2020-01-16T05:29:21.563 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2020-01-16T05:29:21.570 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2020-01-16T05:32:22.866 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi142.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:32:31.926 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi142.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:32:37.943 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:32:40.985 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi142.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:32:46.999 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:32:50.044 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi142.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:32:56.057 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:32:59.126 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi142.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:33:05.112 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:33:08.189 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi142.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:33:14.167 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:33:17.270 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi142.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:33:23.226 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:33:32.282 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:33:41.334 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:33:48.656 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-16T05:33:50.391 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:33:54.658 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi142.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:33:54.669 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-16T05:34:00.675 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi142.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:34:00.685 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-16T05:34:06.689 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi142.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:34:06.700 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-16T05:34:12.703 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi142.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:34:12.714 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-16T05:34:14.875 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:34:18.715 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi142.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:34:18.828 INFO:teuthology.orchestra.run.smithi142:> hostname 2020-01-16T05:34:19.415 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2020-01-16T05:34:19.416 INFO:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts 2020-01-16T05:34:19.471 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2020-01-16T05:34:19.471 INFO:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2020-01-16T05:34:19.629 INFO:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts 2020-01-16T05:34:19.644 INFO:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2020-01-16T05:34:19.702 INFO:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname 2020-01-16T05:34:19.761 INFO:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2020-01-16T05:34:19.815 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2020-01-16T05:34:19.817 DEBUG:teuthology.parallel:result is None 2020-01-16T05:34:23.932 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:34:24.082 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-16T05:34:30.085 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:34:30.095 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-16T05:34:36.101 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:34:36.112 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-16T05:34:42.114 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:34:42.124 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-16T05:34:48.127 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:34:48.139 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-16T05:34:54.142 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:34:54.266 INFO:teuthology.orchestra.run.smithi084:> hostname 2020-01-16T05:34:54.850 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2020-01-16T05:34:54.850 INFO:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2020-01-16T05:34:54.897 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2020-01-16T05:34:54.897 INFO:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2020-01-16T05:34:55.049 INFO:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2020-01-16T05:34:55.064 INFO:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2020-01-16T05:34:55.136 INFO:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2020-01-16T05:34:55.196 INFO:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2020-01-16T05:34:55.252 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2020-01-16T05:34:55.253 DEBUG:teuthology.parallel:result is None 2020-01-16T05:34:55.409 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2020-01-16T05:34:55.409 INFO:teuthology.lock.ops:New key found. Updating... 2020-01-16T05:34:55.428 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2020-01-16T05:34:55.428 INFO:teuthology.lock.ops:New key found. Updating... 2020-01-16T05:34:55.446 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2020-01-16T05:34:55.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-16T05:34:55.447 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:34:55.568 INFO:teuthology.orchestra.run.smithi084:> true 2020-01-16T05:34:55.755 INFO:teuthology.orchestra.run.smithi084:> uname -m 2020-01-16T05:34:55.805 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2020-01-16T05:34:55.806 INFO:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2020-01-16T05:34:55.851 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Ubuntu" 2020-01-16T05:34:55.852 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-01-16T05:34:55.852 INFO:teuthology.orchestra.run.smithi084.stdout:ID=ubuntu 2020-01-16T05:34:55.852 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE=debian 2020-01-16T05:34:55.852 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-01-16T05:34:55.852 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="18.04" 2020-01-16T05:34:55.852 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.ubuntu.com/" 2020-01-16T05:34:55.853 INFO:teuthology.orchestra.run.smithi084.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-01-16T05:34:55.853 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-01-16T05:34:55.853 INFO:teuthology.orchestra.run.smithi084.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-01-16T05:34:55.853 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_CODENAME=bionic 2020-01-16T05:34:55.853 INFO:teuthology.orchestra.run.smithi084.stdout:UBUNTU_CODENAME=bionic 2020-01-16T05:34:55.854 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2020-01-16T05:34:55.879 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2020-01-16T05:34:55.879 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-16T05:34:55.880 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi142.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:34:55.953 INFO:teuthology.orchestra.run.smithi142:> true 2020-01-16T05:34:56.203 INFO:teuthology.orchestra.run.smithi142:> uname -m 2020-01-16T05:34:56.253 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2020-01-16T05:34:56.254 INFO:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2020-01-16T05:34:56.302 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Ubuntu" 2020-01-16T05:34:56.302 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-01-16T05:34:56.302 INFO:teuthology.orchestra.run.smithi142.stdout:ID=ubuntu 2020-01-16T05:34:56.302 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE=debian 2020-01-16T05:34:56.303 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-01-16T05:34:56.303 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="18.04" 2020-01-16T05:34:56.303 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.ubuntu.com/" 2020-01-16T05:34:56.303 INFO:teuthology.orchestra.run.smithi142.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-01-16T05:34:56.303 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-01-16T05:34:56.303 INFO:teuthology.orchestra.run.smithi142.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-01-16T05:34:56.304 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_CODENAME=bionic 2020-01-16T05:34:56.304 INFO:teuthology.orchestra.run.smithi142.stdout:UBUNTU_CODENAME=bionic 2020-01-16T05:34:56.304 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2020-01-16T05:34:56.327 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-01-16T05:34:56.362 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi084.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCs4QDSE2u6b5Hf0HDm9GUBv8pQ6+bIM0N4icldK25MXrjTstWxc8xLKQK1wzTxkycMAm7r5cDtu2IJ8gA4WaSxzfJeCuWKxvb9sfEMjP1TGXTZvBWE9ByR5p55O9JPMeFAFAMxDgAzSkzC6NThx6RsUwLiG8G6qwZv40KcG2o7gKj+f8YP9IUYq7C8AeIksqnCohqq+xBX+UoM242usbJVra4DqvWdcb3/e8pHMbz2FOvpoL2vHT/k9TaEdAY6Z47z/yMw/VSRBZEo10SDfKYhUgtDF/eiujFteL+1pBOcsL5saisfr3YsPM59ReGaWh/T1ZkILnDxlE00vDFY110t smithi142.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6aAEP9FTYdyZjQgJK2L0kDdgDRgTlUe3lOhBuBRC+J5BweFii71iN9JUSCultLd84cIALerWaiG/o9wqCL3Iamfxsum1KijlFQWIXARoGigtEasDQSNSEy5d9Ra+pyt3dYjU/w2cfmbj8vEhVarCLbuLbpi5uaNXYk1uKtGFoprbvZJzFfcFKgBgIv2A5UwAJPQYqeP7XK1cUsogPQM0l3jEI1Bd+d8THQCHxREZZWR61hXhr/Mlv41XE+nVZkXQrVvUyMP/4qkLsSAPLc82fzox7uQeUUG3qEmA6nzSnCE7Ngv35f2qAcju/4M6fTNWE3LeDi1r++yvKFeEa5MCT 2020-01-16T05:34:56.362 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-01-16T05:34:56.416 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-01-16T05:34:56.425 INFO:teuthology.task.internal:Saving configuration 2020-01-16T05:34:56.447 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-01-16T05:34:56.456 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-01-16T05:34:56.476 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-01-16 05:29:16.226566', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi084.front.sepia.ceph.com', u'os_version': u'18.04', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'ubuntu', u'arch': u'x86_64', u'ssh_pub_key': u'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIG4uKqn/UIFWB4se9eqJbCHnyikBkCVCMI4zaSEmEhfH', u'description': u'/home/teuthworker/archive/pdonnell-2020-01-16_04:36:36-fs-wip-pdonnell-testing-20200116.003219-distro-basic-smithi/4672934'} 2020-01-16T05:34:56.493 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-01-16 05:29:16.226587', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi142.front.sepia.ceph.com', u'os_version': u'18.04', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'ubuntu', u'arch': u'x86_64', u'ssh_pub_key': u'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDd1KcBiIOgnZMh6FFbGDdMRjViZGNqyWMKb1KGVYWul', u'description': u'/home/teuthworker/archive/pdonnell-2020-01-16_04:36:36-fs-wip-pdonnell-testing-20200116.003219-distro-basic-smithi/4672934'} 2020-01-16T05:34:56.493 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-01-16T05:34:56.501 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2020-01-16T05:34:56.501 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2020-01-16T05:34:56.501 INFO:teuthology.run_tasks:Running task console_log... 2020-01-16T05:34:56.589 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-01-16T05:34:56.590 INFO:teuthology.run_tasks:Running task internal.connect... 2020-01-16T05:34:56.615 INFO:teuthology.task.internal:Opening connections... 2020-01-16T05:34:56.616 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2020-01-16T05:34:56.617 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:34:56.694 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2020-01-16T05:34:56.696 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi142.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:34:56.768 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-01-16T05:34:56.819 INFO:teuthology.orchestra.run.smithi084:> uname -m 2020-01-16T05:34:56.903 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2020-01-16T05:34:56.903 INFO:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2020-01-16T05:34:56.951 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Ubuntu" 2020-01-16T05:34:56.951 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-01-16T05:34:56.951 INFO:teuthology.orchestra.run.smithi084.stdout:ID=ubuntu 2020-01-16T05:34:56.951 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE=debian 2020-01-16T05:34:56.952 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-01-16T05:34:56.952 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="18.04" 2020-01-16T05:34:56.952 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.ubuntu.com/" 2020-01-16T05:34:56.952 INFO:teuthology.orchestra.run.smithi084.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-01-16T05:34:56.953 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-01-16T05:34:56.953 INFO:teuthology.orchestra.run.smithi084.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-01-16T05:34:56.953 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_CODENAME=bionic 2020-01-16T05:34:56.953 INFO:teuthology.orchestra.run.smithi084.stdout:UBUNTU_CODENAME=bionic 2020-01-16T05:34:56.953 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2020-01-16T05:34:56.969 INFO:teuthology.orchestra.run.smithi142:> uname -m 2020-01-16T05:34:56.975 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2020-01-16T05:34:56.975 INFO:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2020-01-16T05:34:57.021 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Ubuntu" 2020-01-16T05:34:57.021 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-01-16T05:34:57.022 INFO:teuthology.orchestra.run.smithi142.stdout:ID=ubuntu 2020-01-16T05:34:57.022 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE=debian 2020-01-16T05:34:57.022 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-01-16T05:34:57.022 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="18.04" 2020-01-16T05:34:57.022 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.ubuntu.com/" 2020-01-16T05:34:57.023 INFO:teuthology.orchestra.run.smithi142.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-01-16T05:34:57.023 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-01-16T05:34:57.023 INFO:teuthology.orchestra.run.smithi142.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-01-16T05:34:57.023 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_CODENAME=bionic 2020-01-16T05:34:57.023 INFO:teuthology.orchestra.run.smithi142.stdout:UBUNTU_CODENAME=bionic 2020-01-16T05:34:57.024 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2020-01-16T05:34:57.038 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-01-16T05:34:57.054 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-01-16T05:34:57.062 INFO:teuthology.task.internal:Checking for old test directory... 2020-01-16T05:34:57.063 INFO:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2020-01-16T05:34:57.065 INFO:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2020-01-16T05:34:57.071 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-01-16T05:34:57.078 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-01-16T05:34:57.078 INFO:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2020-01-16T05:34:57.112 INFO:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2020-01-16T05:34:57.124 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-01-16T05:34:57.166 INFO:teuthology.run_tasks:Running task kernel... 2020-01-16T05:34:57.184 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'mds.a': {'sha1': 'distro', 'kdb': True}, 'mds.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}} 2020-01-16T05:34:57.185 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-01-16T05:34:57.186 INFO:teuthology.orchestra.run.smithi084:> uname -r 2020-01-16T05:34:57.192 INFO:teuthology.orchestra.run.smithi084.stdout:4.15.0-72-generic 2020-01-16T05:34:57.193 INFO:teuthology.task.kernel:Running kernel on smithi084: 4.15.0-72-generic 2020-01-16T05:34:57.193 INFO:teuthology.orchestra.run.smithi084:> sudo apt-get clean 2020-01-16T05:34:57.310 INFO:teuthology.orchestra.run.smithi084:> sudo apt-get update 2020-01-16T05:34:57.564 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-16T05:34:57.564 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-01-16T05:34:57.629 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-01-16T05:34:57.942 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-01-16T05:34:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [417 kB] 2020-01-16T05:34:58.109 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [830 kB] 2020-01-16T05:34:58.266 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [606 kB] 2020-01-16T05:34:58.357 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [196 kB] 2020-01-16T05:34:58.381 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [17.0 kB] 2020-01-16T05:34:58.384 INFO:teuthology.orchestra.run.smithi084.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [5,032 B] 2020-01-16T05:34:58.384 INFO:teuthology.orchestra.run.smithi084.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [633 kB] 2020-01-16T05:34:58.438 INFO:teuthology.orchestra.run.smithi084.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [607 kB] 2020-01-16T05:34:58.465 INFO:teuthology.orchestra.run.smithi084.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [629 kB] 2020-01-16T05:34:58.472 INFO:teuthology.orchestra.run.smithi084.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [213 kB] 2020-01-16T05:34:58.484 INFO:teuthology.orchestra.run.smithi084.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [6,116 B] 2020-01-16T05:34:58.484 INFO:teuthology.orchestra.run.smithi084.stdout:Get:16 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [4,284 B] 2020-01-16T05:34:58.507 INFO:teuthology.orchestra.run.smithi084.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [290 kB] 2020-01-16T05:34:58.552 INFO:teuthology.orchestra.run.smithi084.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [26.0 kB] 2020-01-16T05:34:58.554 INFO:teuthology.orchestra.run.smithi084.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [6,976 B] 2020-01-16T05:34:58.555 INFO:teuthology.orchestra.run.smithi084.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,038 kB] 2020-01-16T05:34:58.621 INFO:teuthology.orchestra.run.smithi084.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,000 kB] 2020-01-16T05:34:58.658 INFO:teuthology.orchestra.run.smithi084.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [321 kB] 2020-01-16T05:34:58.668 INFO:teuthology.orchestra.run.smithi084.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [9,500 B] 2020-01-16T05:34:58.668 INFO:teuthology.orchestra.run.smithi084.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [7,472 B] 2020-01-16T05:34:58.669 INFO:teuthology.orchestra.run.smithi084.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [4,540 B] 2020-01-16T05:34:58.669 INFO:teuthology.orchestra.run.smithi084.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-backports/universe i386 Packages [4,036 B] 2020-01-16T05:34:58.670 INFO:teuthology.orchestra.run.smithi084.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [4,044 B] 2020-01-16T05:34:58.671 INFO:teuthology.orchestra.run.smithi084.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-backports/universe Translation-en [1,900 B] 2020-01-16T05:34:59.382 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 7,127 kB in 2s (3,765 kB/s) 2020-01-16T05:35:00.752 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2020-01-16T05:35:00.794 INFO:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-01-16T05:35:00.867 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2020-01-16T05:35:01.088 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2020-01-16T05:35:01.089 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2020-01-16T05:35:01.162 INFO:teuthology.orchestra.run.smithi084.stderr:E: Unable to locate package linux-image-current-generic 2020-01-16T05:35:01.163 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-01-16T05:35:01.164 INFO:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-01-16T05:35:01.288 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2020-01-16T05:35:01.547 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2020-01-16T05:35:01.547 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2020-01-16T05:35:01.697 INFO:teuthology.orchestra.run.smithi084.stdout:The following additional packages will be installed: 2020-01-16T05:35:01.697 INFO:teuthology.orchestra.run.smithi084.stdout: linux-generic linux-headers-4.15.0-74 linux-headers-4.15.0-74-generic 2020-01-16T05:35:01.698 INFO:teuthology.orchestra.run.smithi084.stdout: linux-headers-generic linux-image-4.15.0-74-generic 2020-01-16T05:35:01.698 INFO:teuthology.orchestra.run.smithi084.stdout: linux-modules-4.15.0-74-generic linux-modules-extra-4.15.0-74-generic 2020-01-16T05:35:01.699 INFO:teuthology.orchestra.run.smithi084.stdout:Suggested packages: 2020-01-16T05:35:01.700 INFO:teuthology.orchestra.run.smithi084.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2020-01-16T05:35:01.700 INFO:teuthology.orchestra.run.smithi084.stdout:Recommended packages: 2020-01-16T05:35:01.700 INFO:teuthology.orchestra.run.smithi084.stdout: thermald 2020-01-16T05:35:01.732 INFO:teuthology.orchestra.run.smithi084.stdout:The following NEW packages will be installed: 2020-01-16T05:35:01.732 INFO:teuthology.orchestra.run.smithi084.stdout: linux-headers-4.15.0-74 linux-headers-4.15.0-74-generic 2020-01-16T05:35:01.733 INFO:teuthology.orchestra.run.smithi084.stdout: linux-image-4.15.0-74-generic linux-modules-4.15.0-74-generic 2020-01-16T05:35:01.733 INFO:teuthology.orchestra.run.smithi084.stdout: linux-modules-extra-4.15.0-74-generic 2020-01-16T05:35:01.734 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages will be upgraded: 2020-01-16T05:35:01.735 INFO:teuthology.orchestra.run.smithi084.stdout: linux-generic linux-headers-generic linux-image-generic 2020-01-16T05:35:02.610 INFO:teuthology.orchestra.run.smithi084.stdout:3 upgraded, 5 newly installed, 0 to remove and 28 not upgraded. 2020-01-16T05:35:02.610 INFO:teuthology.orchestra.run.smithi084.stdout:Need to get 65.9 MB of archives. 2020-01-16T05:35:02.610 INFO:teuthology.orchestra.run.smithi084.stdout:After this operation, 332 MB of additional disk space will be used. 2020-01-16T05:35:02.610 INFO:teuthology.orchestra.run.smithi084.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-74-generic amd64 4.15.0-74.84 [13.0 MB] 2020-01-16T05:35:03.593 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-74-generic amd64 4.15.0-74.84 [7,993 kB] 2020-01-16T05:35:03.786 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-74-generic amd64 4.15.0-74.84 [32.7 MB] 2020-01-16T05:35:04.743 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.74.76 [1,864 B] 2020-01-16T05:35:04.744 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.74.76 [2,388 B] 2020-01-16T05:35:04.744 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-74 all 4.15.0-74.84 [11.0 MB] 2020-01-16T05:35:05.042 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-74-generic amd64 4.15.0-74.84 [1,122 kB] 2020-01-16T05:35:05.067 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.74.76 [2,348 B] 2020-01-16T05:35:05.525 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 65.9 MB in 3s (19.8 MB/s) 2020-01-16T05:35:05.686 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-modules-4.15.0-74-generic. 2020-01-16T05:35:05.722 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101858 files and directories currently installed.) 2020-01-16T05:35:05.725 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../0-linux-modules-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-16T05:35:05.774 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-modules-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-16T05:35:07.323 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-image-4.15.0-74-generic. 2020-01-16T05:35:07.335 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../1-linux-image-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-16T05:35:07.430 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-16T05:35:07.918 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-74-generic. 2020-01-16T05:35:07.930 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-16T05:35:07.968 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-modules-extra-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-16T05:35:11.682 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../3-linux-generic_4.15.0.74.76_amd64.deb ... 2020-01-16T05:35:11.784 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-16T05:35:12.092 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.74.76_amd64.deb ... 2020-01-16T05:35:12.213 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-image-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-16T05:35:12.565 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-headers-4.15.0-74. 2020-01-16T05:35:12.578 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../5-linux-headers-4.15.0-74_4.15.0-74.84_all.deb ... 2020-01-16T05:35:12.615 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-headers-4.15.0-74 (4.15.0-74.84) ... 2020-01-16T05:35:17.309 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-headers-4.15.0-74-generic. 2020-01-16T05:35:17.329 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../6-linux-headers-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-16T05:35:17.367 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-headers-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-16T05:35:19.689 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.74.76_amd64.deb ... 2020-01-16T05:35:19.814 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-headers-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-16T05:35:20.158 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-headers-4.15.0-74 (4.15.0-74.84) ... 2020-01-16T05:35:20.285 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-modules-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-16T05:35:20.812 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-16T05:35:21.238 INFO:teuthology.orchestra.run.smithi084.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-74-generic 2020-01-16T05:35:21.239 INFO:teuthology.orchestra.run.smithi084.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-74-generic 2020-01-16T05:35:21.380 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-modules-extra-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-16T05:35:21.865 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-headers-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-16T05:35:21.991 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-image-generic (4.15.0.74.76) ... 2020-01-16T05:35:22.789 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-headers-generic (4.15.0.74.76) ... 2020-01-16T05:35:22.915 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-generic (4.15.0.74.76) ... 2020-01-16T05:35:23.027 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-16T05:35:23.220 INFO:teuthology.orchestra.run.smithi084.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-01-16T05:35:23.220 INFO:teuthology.orchestra.run.smithi084.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-74-generic 2020-01-16T05:35:37.721 INFO:teuthology.orchestra.run.smithi084.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-01-16T05:35:37.722 INFO:teuthology.orchestra.run.smithi084.stdout:Sourcing file `/etc/default/grub' 2020-01-16T05:35:37.739 INFO:teuthology.orchestra.run.smithi084.stdout:Generating grub configuration file ... 2020-01-16T05:35:38.122 INFO:teuthology.orchestra.run.smithi084.stdout:Found linux image: /boot/vmlinuz-4.15.0-74-generic 2020-01-16T05:35:38.338 INFO:teuthology.orchestra.run.smithi084.stdout:Found initrd image: /boot/initrd.img-4.15.0-74-generic 2020-01-16T05:35:38.693 INFO:teuthology.orchestra.run.smithi084.stdout:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2020-01-16T05:35:38.712 INFO:teuthology.orchestra.run.smithi084.stdout:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2020-01-16T05:35:40.153 INFO:teuthology.orchestra.run.smithi084.stdout:done 2020-01-16T05:35:40.548 INFO:teuthology.orchestra.run.smithi084:> dpkg -s linux-image-generic 2020-01-16T05:35:40.571 INFO:teuthology.orchestra.run.smithi084.stdout:Package: linux-image-generic 2020-01-16T05:35:40.571 INFO:teuthology.orchestra.run.smithi084.stdout:Status: install ok installed 2020-01-16T05:35:40.571 INFO:teuthology.orchestra.run.smithi084.stdout:Priority: optional 2020-01-16T05:35:40.572 INFO:teuthology.orchestra.run.smithi084.stdout:Section: kernel 2020-01-16T05:35:40.572 INFO:teuthology.orchestra.run.smithi084.stdout:Installed-Size: 15 2020-01-16T05:35:40.572 INFO:teuthology.orchestra.run.smithi084.stdout:Maintainer: Ubuntu Kernel Team 2020-01-16T05:35:40.572 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: amd64 2020-01-16T05:35:40.572 INFO:teuthology.orchestra.run.smithi084.stdout:Source: linux-meta 2020-01-16T05:35:40.572 INFO:teuthology.orchestra.run.smithi084.stdout:Version: 4.15.0.74.76 2020-01-16T05:35:40.572 INFO:teuthology.orchestra.run.smithi084.stdout:Depends: linux-image-4.15.0-74-generic, linux-modules-extra-4.15.0-74-generic, linux-firmware, intel-microcode, amd64-microcode 2020-01-16T05:35:40.573 INFO:teuthology.orchestra.run.smithi084.stdout:Recommends: thermald 2020-01-16T05:35:40.573 INFO:teuthology.orchestra.run.smithi084.stdout:Description: Generic Linux kernel image 2020-01-16T05:35:40.573 INFO:teuthology.orchestra.run.smithi084.stdout: This package will always depend on the latest generic kernel image 2020-01-16T05:35:40.573 INFO:teuthology.orchestra.run.smithi084.stdout: available. 2020-01-16T05:35:40.573 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-72-generic Expected: 4.15.0-74-generic 2020-01-16T05:35:40.574 INFO:teuthology.orchestra.run.smithi142:> uname -r 2020-01-16T05:35:40.580 INFO:teuthology.orchestra.run.smithi142.stdout:4.15.0-72-generic 2020-01-16T05:35:40.580 INFO:teuthology.task.kernel:Running kernel on smithi142: 4.15.0-72-generic 2020-01-16T05:35:40.580 INFO:teuthology.orchestra.run.smithi142:> sudo apt-get clean 2020-01-16T05:35:40.710 INFO:teuthology.orchestra.run.smithi142:> sudo apt-get update 2020-01-16T05:35:41.015 INFO:teuthology.orchestra.run.smithi142.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-01-16T05:35:41.038 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-16T05:35:41.099 INFO:teuthology.orchestra.run.smithi142.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-01-16T05:35:41.426 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-01-16T05:35:41.451 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [417 kB] 2020-01-16T05:35:41.579 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [830 kB] 2020-01-16T05:35:41.742 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [606 kB] 2020-01-16T05:35:41.835 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [196 kB] 2020-01-16T05:35:41.856 INFO:teuthology.orchestra.run.smithi142.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [17.0 kB] 2020-01-16T05:35:41.857 INFO:teuthology.orchestra.run.smithi142.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [5,032 B] 2020-01-16T05:35:41.858 INFO:teuthology.orchestra.run.smithi142.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [633 kB] 2020-01-16T05:35:41.914 INFO:teuthology.orchestra.run.smithi142.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [607 kB] 2020-01-16T05:35:41.949 INFO:teuthology.orchestra.run.smithi142.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [213 kB] 2020-01-16T05:35:41.960 INFO:teuthology.orchestra.run.smithi142.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [4,284 B] 2020-01-16T05:35:41.961 INFO:teuthology.orchestra.run.smithi142.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [6,116 B] 2020-01-16T05:35:41.987 INFO:teuthology.orchestra.run.smithi142.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [629 kB] 2020-01-16T05:35:42.166 INFO:teuthology.orchestra.run.smithi142.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [290 kB] 2020-01-16T05:35:42.182 INFO:teuthology.orchestra.run.smithi142.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [26.0 kB] 2020-01-16T05:35:42.182 INFO:teuthology.orchestra.run.smithi142.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [6,976 B] 2020-01-16T05:35:42.183 INFO:teuthology.orchestra.run.smithi142.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,000 kB] 2020-01-16T05:35:42.332 INFO:teuthology.orchestra.run.smithi142.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,038 kB] 2020-01-16T05:35:42.397 INFO:teuthology.orchestra.run.smithi142.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [321 kB] 2020-01-16T05:35:42.400 INFO:teuthology.orchestra.run.smithi142.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [9,500 B] 2020-01-16T05:35:42.400 INFO:teuthology.orchestra.run.smithi142.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [7,472 B] 2020-01-16T05:35:42.401 INFO:teuthology.orchestra.run.smithi142.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [4,540 B] 2020-01-16T05:35:42.401 INFO:teuthology.orchestra.run.smithi142.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-backports/universe i386 Packages [4,036 B] 2020-01-16T05:35:42.401 INFO:teuthology.orchestra.run.smithi142.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [4,044 B] 2020-01-16T05:35:42.401 INFO:teuthology.orchestra.run.smithi142.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-backports/universe Translation-en [1,900 B] 2020-01-16T05:35:42.915 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 7,127 kB in 2s (3,568 kB/s) 2020-01-16T05:35:44.246 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2020-01-16T05:35:44.291 INFO:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-01-16T05:35:44.370 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2020-01-16T05:35:44.613 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2020-01-16T05:35:44.614 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2020-01-16T05:35:44.690 INFO:teuthology.orchestra.run.smithi142.stderr:E: Unable to locate package linux-image-current-generic 2020-01-16T05:35:44.691 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-01-16T05:35:44.692 INFO:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-01-16T05:35:44.769 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2020-01-16T05:35:45.000 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2020-01-16T05:35:45.000 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2020-01-16T05:35:45.166 INFO:teuthology.orchestra.run.smithi142.stdout:The following additional packages will be installed: 2020-01-16T05:35:45.167 INFO:teuthology.orchestra.run.smithi142.stdout: linux-generic linux-headers-4.15.0-74 linux-headers-4.15.0-74-generic 2020-01-16T05:35:45.167 INFO:teuthology.orchestra.run.smithi142.stdout: linux-headers-generic linux-image-4.15.0-74-generic 2020-01-16T05:35:45.167 INFO:teuthology.orchestra.run.smithi142.stdout: linux-modules-4.15.0-74-generic linux-modules-extra-4.15.0-74-generic 2020-01-16T05:35:45.168 INFO:teuthology.orchestra.run.smithi142.stdout:Suggested packages: 2020-01-16T05:35:45.169 INFO:teuthology.orchestra.run.smithi142.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2020-01-16T05:35:45.169 INFO:teuthology.orchestra.run.smithi142.stdout:Recommended packages: 2020-01-16T05:35:45.169 INFO:teuthology.orchestra.run.smithi142.stdout: thermald 2020-01-16T05:35:45.201 INFO:teuthology.orchestra.run.smithi142.stdout:The following NEW packages will be installed: 2020-01-16T05:35:45.201 INFO:teuthology.orchestra.run.smithi142.stdout: linux-headers-4.15.0-74 linux-headers-4.15.0-74-generic 2020-01-16T05:35:45.202 INFO:teuthology.orchestra.run.smithi142.stdout: linux-image-4.15.0-74-generic linux-modules-4.15.0-74-generic 2020-01-16T05:35:45.202 INFO:teuthology.orchestra.run.smithi142.stdout: linux-modules-extra-4.15.0-74-generic 2020-01-16T05:35:45.203 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages will be upgraded: 2020-01-16T05:35:45.204 INFO:teuthology.orchestra.run.smithi142.stdout: linux-generic linux-headers-generic linux-image-generic 2020-01-16T05:35:45.382 INFO:teuthology.orchestra.run.smithi142.stdout:3 upgraded, 5 newly installed, 0 to remove and 28 not upgraded. 2020-01-16T05:35:45.382 INFO:teuthology.orchestra.run.smithi142.stdout:Need to get 65.9 MB of archives. 2020-01-16T05:35:45.382 INFO:teuthology.orchestra.run.smithi142.stdout:After this operation, 332 MB of additional disk space will be used. 2020-01-16T05:35:45.382 INFO:teuthology.orchestra.run.smithi142.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-74-generic amd64 4.15.0-74.84 [13.0 MB] 2020-01-16T05:35:46.366 INFO:teuthology.orchestra.run.smithi142.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-74-generic amd64 4.15.0-74.84 [7,993 kB] 2020-01-16T05:35:46.553 INFO:teuthology.orchestra.run.smithi142.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-74-generic amd64 4.15.0-74.84 [32.7 MB] 2020-01-16T05:35:47.466 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.74.76 [1,864 B] 2020-01-16T05:35:47.466 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.74.76 [2,388 B] 2020-01-16T05:35:47.466 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-74 all 4.15.0-74.84 [11.0 MB] 2020-01-16T05:35:47.771 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-74-generic amd64 4.15.0-74.84 [1,122 kB] 2020-01-16T05:35:47.778 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.74.76 [2,348 B] 2020-01-16T05:35:48.281 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 65.9 MB in 3s (25.7 MB/s) 2020-01-16T05:35:48.427 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-modules-4.15.0-74-generic. 2020-01-16T05:35:48.464 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101858 files and directories currently installed.) 2020-01-16T05:35:48.467 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../0-linux-modules-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-16T05:35:48.531 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-modules-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-16T05:35:50.155 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-image-4.15.0-74-generic. 2020-01-16T05:35:50.167 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../1-linux-image-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-16T05:35:50.265 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-16T05:35:50.783 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-74-generic. 2020-01-16T05:35:50.794 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-16T05:35:50.842 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-modules-extra-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-16T05:35:54.539 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../3-linux-generic_4.15.0.74.76_amd64.deb ... 2020-01-16T05:35:54.667 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-16T05:35:54.991 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.74.76_amd64.deb ... 2020-01-16T05:35:55.154 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-image-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-16T05:35:55.482 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-headers-4.15.0-74. 2020-01-16T05:35:55.494 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../5-linux-headers-4.15.0-74_4.15.0-74.84_all.deb ... 2020-01-16T05:35:55.523 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-headers-4.15.0-74 (4.15.0-74.84) ... 2020-01-16T05:36:00.707 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-headers-4.15.0-74-generic. 2020-01-16T05:36:00.728 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../6-linux-headers-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-16T05:36:00.766 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-headers-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-16T05:36:03.217 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.74.76_amd64.deb ... 2020-01-16T05:36:03.337 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-headers-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-16T05:36:03.663 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-headers-4.15.0-74 (4.15.0-74.84) ... 2020-01-16T05:36:03.809 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-modules-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-16T05:36:04.327 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-16T05:36:04.809 INFO:teuthology.orchestra.run.smithi142.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-74-generic 2020-01-16T05:36:04.809 INFO:teuthology.orchestra.run.smithi142.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-74-generic 2020-01-16T05:36:04.946 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-modules-extra-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-16T05:36:05.447 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-headers-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-16T05:36:05.574 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-image-generic (4.15.0.74.76) ... 2020-01-16T05:36:05.700 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-headers-generic (4.15.0.74.76) ... 2020-01-16T05:36:05.817 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-generic (4.15.0.74.76) ... 2020-01-16T05:36:05.960 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-16T05:36:06.148 INFO:teuthology.orchestra.run.smithi142.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-01-16T05:36:06.148 INFO:teuthology.orchestra.run.smithi142.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-74-generic 2020-01-16T05:36:21.233 INFO:teuthology.orchestra.run.smithi142.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-01-16T05:36:21.234 INFO:teuthology.orchestra.run.smithi142.stdout:Sourcing file `/etc/default/grub' 2020-01-16T05:36:21.255 INFO:teuthology.orchestra.run.smithi142.stdout:Generating grub configuration file ... 2020-01-16T05:36:21.568 INFO:teuthology.orchestra.run.smithi142.stdout:Found linux image: /boot/vmlinuz-4.15.0-74-generic 2020-01-16T05:36:21.611 INFO:teuthology.orchestra.run.smithi142.stdout:Found initrd image: /boot/initrd.img-4.15.0-74-generic 2020-01-16T05:36:21.960 INFO:teuthology.orchestra.run.smithi142.stdout:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2020-01-16T05:36:21.992 INFO:teuthology.orchestra.run.smithi142.stdout:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2020-01-16T05:36:22.875 INFO:teuthology.orchestra.run.smithi142.stdout:done 2020-01-16T05:36:23.271 INFO:teuthology.orchestra.run.smithi142:> dpkg -s linux-image-generic 2020-01-16T05:36:23.298 INFO:teuthology.orchestra.run.smithi142.stdout:Package: linux-image-generic 2020-01-16T05:36:23.298 INFO:teuthology.orchestra.run.smithi142.stdout:Status: install ok installed 2020-01-16T05:36:23.298 INFO:teuthology.orchestra.run.smithi142.stdout:Priority: optional 2020-01-16T05:36:23.298 INFO:teuthology.orchestra.run.smithi142.stdout:Section: kernel 2020-01-16T05:36:23.298 INFO:teuthology.orchestra.run.smithi142.stdout:Installed-Size: 15 2020-01-16T05:36:23.298 INFO:teuthology.orchestra.run.smithi142.stdout:Maintainer: Ubuntu Kernel Team 2020-01-16T05:36:23.299 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: amd64 2020-01-16T05:36:23.299 INFO:teuthology.orchestra.run.smithi142.stdout:Source: linux-meta 2020-01-16T05:36:23.299 INFO:teuthology.orchestra.run.smithi142.stdout:Version: 4.15.0.74.76 2020-01-16T05:36:23.299 INFO:teuthology.orchestra.run.smithi142.stdout:Depends: linux-image-4.15.0-74-generic, linux-modules-extra-4.15.0-74-generic, linux-firmware, intel-microcode, amd64-microcode 2020-01-16T05:36:23.299 INFO:teuthology.orchestra.run.smithi142.stdout:Recommends: thermald 2020-01-16T05:36:23.299 INFO:teuthology.orchestra.run.smithi142.stdout:Description: Generic Linux kernel image 2020-01-16T05:36:23.299 INFO:teuthology.orchestra.run.smithi142.stdout: This package will always depend on the latest generic kernel image 2020-01-16T05:36:23.299 INFO:teuthology.orchestra.run.smithi142.stdout: available. 2020-01-16T05:36:23.300 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-72-generic Expected: 4.15.0-74-generic 2020-01-16T05:36:23.300 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2020-01-16T05:36:23.300 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-01-16T05:36:23.300 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-01-16T05:36:23.300 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2020-01-16T05:36:23.301 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi084.front.sepia.ceph.com, path=None, version=distro) 2020-01-16T05:36:23.301 INFO:teuthology.orchestra.run.smithi084:> sudo apt-get clean 2020-01-16T05:36:23.385 INFO:teuthology.orchestra.run.smithi084:> sudo apt-get update 2020-01-16T05:36:23.518 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-01-16T05:36:23.634 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-16T05:36:23.731 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-01-16T05:36:23.801 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-01-16T05:36:25.282 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2020-01-16T05:36:25.327 INFO:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-01-16T05:36:25.400 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2020-01-16T05:36:25.628 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2020-01-16T05:36:25.629 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2020-01-16T05:36:25.702 INFO:teuthology.orchestra.run.smithi084.stderr:E: Unable to locate package linux-image-current-generic 2020-01-16T05:36:25.705 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-01-16T05:36:25.705 INFO:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-01-16T05:36:25.783 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2020-01-16T05:36:26.009 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2020-01-16T05:36:26.009 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2020-01-16T05:36:26.212 INFO:teuthology.orchestra.run.smithi084.stdout:linux-image-generic is already the newest version (4.15.0.74.76). 2020-01-16T05:36:26.212 INFO:teuthology.orchestra.run.smithi084.stdout:0 upgraded, 0 newly installed, 0 to remove and 28 not upgraded. 2020-01-16T05:36:26.214 INFO:teuthology.orchestra.run.smithi084:> dpkg -s linux-image-generic 2020-01-16T05:36:26.236 INFO:teuthology.orchestra.run.smithi084.stdout:Package: linux-image-generic 2020-01-16T05:36:26.236 INFO:teuthology.orchestra.run.smithi084.stdout:Status: install ok installed 2020-01-16T05:36:26.236 INFO:teuthology.orchestra.run.smithi084.stdout:Priority: optional 2020-01-16T05:36:26.237 INFO:teuthology.orchestra.run.smithi084.stdout:Section: kernel 2020-01-16T05:36:26.237 INFO:teuthology.orchestra.run.smithi084.stdout:Installed-Size: 15 2020-01-16T05:36:26.237 INFO:teuthology.orchestra.run.smithi084.stdout:Maintainer: Ubuntu Kernel Team 2020-01-16T05:36:26.237 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: amd64 2020-01-16T05:36:26.237 INFO:teuthology.orchestra.run.smithi084.stdout:Source: linux-meta 2020-01-16T05:36:26.237 INFO:teuthology.orchestra.run.smithi084.stdout:Version: 4.15.0.74.76 2020-01-16T05:36:26.237 INFO:teuthology.orchestra.run.smithi084.stdout:Depends: linux-image-4.15.0-74-generic, linux-modules-extra-4.15.0-74-generic, linux-firmware, intel-microcode, amd64-microcode 2020-01-16T05:36:26.238 INFO:teuthology.orchestra.run.smithi084.stdout:Recommends: thermald 2020-01-16T05:36:26.238 INFO:teuthology.orchestra.run.smithi084.stdout:Description: Generic Linux kernel image 2020-01-16T05:36:26.238 INFO:teuthology.orchestra.run.smithi084.stdout: This package will always depend on the latest generic kernel image 2020-01-16T05:36:26.238 INFO:teuthology.orchestra.run.smithi084.stdout: available. 2020-01-16T05:36:26.239 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-01-16T05:36:26.284 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.V3tCVE8N82 2020-01-16T05:36:26.285 INFO:teuthology.orchestra.run.smithi084:> sudo cp /boot/grub/grub.cfg /tmp/tmp.V3tCVE8N82 2020-01-16T05:36:26.340 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.V3tCVE8N82 2020-01-16T05:36:26.461 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.V3tCVE8N82 is 8KB 2020-01-16T05:36:26.513 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.V3tCVE8N82 2020-01-16T05:36:26.522 INFO:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-01-16T05:36:26.579 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /etc/grub.d/01_ceph_kernel' && sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-01-16T05:36:26.675 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-74-generic 2020-01-16T05:36:26.675 INFO:teuthology.orchestra.run.smithi084:> sudo update-grub 2020-01-16T05:36:27.807 INFO:teuthology.orchestra.run.smithi084.stderr:Sourcing file `/etc/default/grub' 2020-01-16T05:36:27.822 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2020-01-16T05:36:28.048 INFO:teuthology.orchestra.run.smithi084.stderr:Found linux image: /boot/vmlinuz-4.15.0-74-generic 2020-01-16T05:36:28.061 INFO:teuthology.orchestra.run.smithi084.stderr:Found initrd image: /boot/initrd.img-4.15.0-74-generic 2020-01-16T05:36:28.406 INFO:teuthology.orchestra.run.smithi084.stderr:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2020-01-16T05:36:28.420 INFO:teuthology.orchestra.run.smithi084.stderr:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2020-01-16T05:36:29.526 INFO:teuthology.orchestra.run.smithi084.stderr:done 2020-01-16T05:36:29.528 INFO:teuthology.orchestra.run.smithi084:> sudo shutdown -r now 2020-01-16T05:36:29.530 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2020-01-16T05:36:29.530 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=None, version=distro) 2020-01-16T05:36:29.530 INFO:teuthology.orchestra.run.smithi142:> sudo apt-get clean 2020-01-16T05:36:29.592 INFO:teuthology.orchestra.run.smithi142:> sudo apt-get update 2020-01-16T05:36:29.842 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-01-16T05:36:29.843 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-16T05:36:29.914 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-01-16T05:36:29.992 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-01-16T05:36:31.632 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2020-01-16T05:36:31.679 INFO:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-01-16T05:36:31.754 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2020-01-16T05:36:31.983 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2020-01-16T05:36:31.984 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2020-01-16T05:36:32.058 INFO:teuthology.orchestra.run.smithi142.stderr:E: Unable to locate package linux-image-current-generic 2020-01-16T05:36:32.061 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-01-16T05:36:32.062 INFO:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-01-16T05:36:32.136 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2020-01-16T05:36:32.358 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2020-01-16T05:36:32.359 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2020-01-16T05:36:32.539 INFO:teuthology.orchestra.run.smithi142.stdout:linux-image-generic is already the newest version (4.15.0.74.76). 2020-01-16T05:36:32.539 INFO:teuthology.orchestra.run.smithi142.stdout:0 upgraded, 0 newly installed, 0 to remove and 28 not upgraded. 2020-01-16T05:36:32.541 INFO:teuthology.orchestra.run.smithi142:> dpkg -s linux-image-generic 2020-01-16T05:36:32.564 INFO:teuthology.orchestra.run.smithi142.stdout:Package: linux-image-generic 2020-01-16T05:36:32.564 INFO:teuthology.orchestra.run.smithi142.stdout:Status: install ok installed 2020-01-16T05:36:32.565 INFO:teuthology.orchestra.run.smithi142.stdout:Priority: optional 2020-01-16T05:36:32.565 INFO:teuthology.orchestra.run.smithi142.stdout:Section: kernel 2020-01-16T05:36:32.565 INFO:teuthology.orchestra.run.smithi142.stdout:Installed-Size: 15 2020-01-16T05:36:32.565 INFO:teuthology.orchestra.run.smithi142.stdout:Maintainer: Ubuntu Kernel Team 2020-01-16T05:36:32.565 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: amd64 2020-01-16T05:36:32.565 INFO:teuthology.orchestra.run.smithi142.stdout:Source: linux-meta 2020-01-16T05:36:32.566 INFO:teuthology.orchestra.run.smithi142.stdout:Version: 4.15.0.74.76 2020-01-16T05:36:32.566 INFO:teuthology.orchestra.run.smithi142.stdout:Depends: linux-image-4.15.0-74-generic, linux-modules-extra-4.15.0-74-generic, linux-firmware, intel-microcode, amd64-microcode 2020-01-16T05:36:32.566 INFO:teuthology.orchestra.run.smithi142.stdout:Recommends: thermald 2020-01-16T05:36:32.566 INFO:teuthology.orchestra.run.smithi142.stdout:Description: Generic Linux kernel image 2020-01-16T05:36:32.566 INFO:teuthology.orchestra.run.smithi142.stdout: This package will always depend on the latest generic kernel image 2020-01-16T05:36:32.566 INFO:teuthology.orchestra.run.smithi142.stdout: available. 2020-01-16T05:36:32.567 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-01-16T05:36:32.612 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.tvaSyqyTGq 2020-01-16T05:36:32.612 INFO:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub/grub.cfg /tmp/tmp.tvaSyqyTGq 2020-01-16T05:36:32.674 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.tvaSyqyTGq 2020-01-16T05:36:32.796 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.tvaSyqyTGq is 8KB 2020-01-16T05:36:32.852 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.tvaSyqyTGq 2020-01-16T05:36:32.858 INFO:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-01-16T05:36:32.912 INFO:teuthology.orchestra.run.smithi142:> sudo sh -c 'cat > /etc/grub.d/01_ceph_kernel' && sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-01-16T05:36:33.010 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-74-generic 2020-01-16T05:36:33.011 INFO:teuthology.orchestra.run.smithi142:> sudo update-grub 2020-01-16T05:36:34.202 INFO:teuthology.orchestra.run.smithi142.stderr:Sourcing file `/etc/default/grub' 2020-01-16T05:36:34.209 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2020-01-16T05:36:34.517 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-4.15.0-74-generic 2020-01-16T05:36:34.526 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-4.15.0-74-generic 2020-01-16T05:36:34.826 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2020-01-16T05:36:34.840 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2020-01-16T05:36:35.440 INFO:teuthology.orchestra.run.smithi142.stderr:done 2020-01-16T05:36:35.441 INFO:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2020-01-16T05:36:35.443 INFO:teuthology.misc:Re-opening connections... 2020-01-16T05:36:35.444 INFO:teuthology.misc:trying to connect to ubuntu@smithi084.front.sepia.ceph.com 2020-01-16T05:36:35.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-16T05:36:35.444 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:37:35.447 DEBUG:teuthology.orchestra.remote:timed out 2020-01-16T05:37:35.447 INFO:teuthology.misc:trying to connect to ubuntu@smithi142.front.sepia.ceph.com 2020-01-16T05:37:35.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-16T05:37:35.448 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi142.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:38:06.950 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2020-01-16T05:38:06.950 DEBUG:teuthology.misc:waited 91.5066349506 2020-01-16T05:38:07.951 INFO:teuthology.misc:trying to connect to ubuntu@smithi084.front.sepia.ceph.com 2020-01-16T05:38:07.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-16T05:38:07.951 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:38:23.334 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2020-01-16T05:38:23.334 INFO:teuthology.misc:trying to connect to ubuntu@smithi142.front.sepia.ceph.com 2020-01-16T05:38:23.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-16T05:38:23.335 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi142.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:38:23.519 INFO:teuthology.orchestra.run.smithi142:> true 2020-01-16T05:38:24.069 DEBUG:teuthology.misc:waited 108.625442982 2020-01-16T05:38:25.070 INFO:teuthology.misc:trying to connect to ubuntu@smithi084.front.sepia.ceph.com 2020-01-16T05:38:25.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-16T05:38:25.071 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:38:25.325 INFO:teuthology.orchestra.run.smithi084:> true 2020-01-16T05:38:26.307 DEBUG:teuthology.misc:waited 110.862854004 2020-01-16T05:38:27.307 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2020-01-16T05:38:27.308 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.15.0-74-generic"... 2020-01-16T05:38:27.308 INFO:teuthology.orchestra.run.smithi084:> uname -r 2020-01-16T05:38:27.315 INFO:teuthology.orchestra.run.smithi084.stdout:4.15.0-74-generic 2020-01-16T05:38:27.316 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-74-generic vs 4.15.0-74-generic 2020-01-16T05:38:27.316 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-01-16T05:38:27.316 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2020-01-16T05:38:27.316 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.15.0-74-generic"... 2020-01-16T05:38:27.316 INFO:teuthology.orchestra.run.smithi142:> uname -r 2020-01-16T05:38:27.322 INFO:teuthology.orchestra.run.smithi142.stdout:4.15.0-74-generic 2020-01-16T05:38:27.323 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-74-generic vs 4.15.0-74-generic 2020-01-16T05:38:27.323 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-01-16T05:38:28.324 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-01-16T05:38:28.324 INFO:teuthology.orchestra.run.smithi084:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-01-16T05:38:28.422 INFO:teuthology.orchestra.run.smithi084.stdout:ttyS1 2020-01-16T05:38:28.442 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-01-16T05:38:28.443 INFO:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-01-16T05:38:28.563 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2020-01-16T05:38:28.583 INFO:teuthology.run_tasks:Running task internal.base... 2020-01-16T05:38:28.593 INFO:teuthology.task.internal:Creating test directory... 2020-01-16T05:38:28.594 INFO:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-01-16T05:38:28.596 INFO:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-01-16T05:38:28.606 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-01-16T05:38:28.617 INFO:teuthology.run_tasks:Running task internal.archive... 2020-01-16T05:38:28.628 INFO:teuthology.task.internal:Creating archive directory... 2020-01-16T05:38:28.628 INFO:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-01-16T05:38:28.646 INFO:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-01-16T05:38:28.665 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-01-16T05:38:28.677 INFO:teuthology.task.internal:Enabling coredump saving... 2020-01-16T05:38:28.677 INFO:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-01-16T05:38:28.713 INFO:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-01-16T05:38:28.729 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-01-16T05:38:28.739 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-01-16T05:38:28.753 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-01-16T05:38:28.765 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-01-16T05:38:28.765 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-01-16T05:38:28.787 INFO:teuthology.task.internal:Configuring sudo... 2020-01-16T05:38:28.788 INFO:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-01-16T05:38:28.791 INFO:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-01-16T05:38:28.829 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-01-16T05:38:28.841 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-01-16T05:38:28.842 INFO:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-01-16T05:38:28.850 INFO:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-01-16T05:38:28.879 INFO:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-01-16T05:38:28.913 INFO:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-01-16T05:38:28.963 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-01-16T05:38:29.050 INFO:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-01-16T05:38:29.057 INFO:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-01-16T05:38:29.107 INFO:teuthology.orchestra.run.smithi142:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-01-16T05:38:29.195 INFO:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2020-01-16T05:38:29.197 INFO:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2020-01-16T05:38:29.283 INFO:teuthology.run_tasks:Running task internal.timer... 2020-01-16T05:38:29.292 INFO:teuthology.task.internal:Starting timer... 2020-01-16T05:38:29.292 INFO:teuthology.run_tasks:Running task pcp... 2020-01-16T05:38:29.329 INFO:teuthology.run_tasks:Running task selinux... 2020-01-16T05:38:29.341 DEBUG:teuthology.task.selinux:Excluding smithi084: OS 'ubuntu' does not support SELinux 2020-01-16T05:38:29.342 DEBUG:teuthology.task.selinux:Excluding smithi142: OS 'ubuntu' does not support SELinux 2020-01-16T05:38:29.342 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-01-16T05:38:29.342 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2020-01-16T05:38:29.342 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-01-16T05:38:29.342 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-01-16T05:38:29.351 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2020-01-16T05:38:29.361 INFO:teuthology.repo_utils:Fetching master from origin 2020-01-16T05:38:29.420 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-01-16T05:38:29.435 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-01-16T05:38:29.437 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-01-16T05:38:29.789 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-01-16T05:38:30.910 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-01-16T05:38:33.819 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-01-16T05:38:33.841 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:33 +0000 (0:00:00.061) 0:00:00.061 ****** 2020-01-16T05:38:33.852 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:33 +0000 (0:00:00.010) 0:00:00.072 ****** 2020-01-16T05:38:36.529 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-01-16T05:38:36.529 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] 2020-01-16T05:38:36.620 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:36 +0000 (0:00:02.768) 0:00:02.840 ****** 2020-01-16T05:38:36.852 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] 2020-01-16T05:38:36.916 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-01-16T05:38:36.917 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-01-16T05:38:36.956 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:36 +0000 (0:00:00.336) 0:00:03.176 ****** 2020-01-16T05:38:36.993 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:36 +0000 (0:00:00.036) 0:00:03.212 ****** 2020-01-16T05:38:37.081 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-01-16T05:38:37.123 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:37 +0000 (0:00:00.128) 0:00:03.341 ****** 2020-01-16T05:38:37.473 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-01-16T05:38:37.475 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-01-16T05:38:37.483 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-01-16T05:38:37.524 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:37 +0000 (0:00:00.402) 0:00:03.744 ****** 2020-01-16T05:38:37.560 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:37 +0000 (0:00:00.035) 0:00:03.780 ****** 2020-01-16T05:38:37.859 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-01-16T05:38:37.861 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.071077", "end": "2020-01-16 05:38:37.558151", "rc": 0, "start": "2020-01-16 05:38:37.487074", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.079901", "end": "2020-01-16 05:38:37.752209", "rc": 0, "start": "2020-01-16 05:38:37.672308", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-01-16T05:38:37.909 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:37 +0000 (0:00:00.349) 0:00:04.129 ****** 2020-01-16T05:38:37.973 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:37 +0000 (0:00:00.064) 0:00:04.193 ****** 2020-01-16T05:38:38.177 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-01-16T05:38:38.179 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-16T05:38:38.179 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-16T05:38:38.229 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:38 +0000 (0:00:00.255) 0:00:04.448 ****** 2020-01-16T05:38:38.284 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:38 +0000 (0:00:00.055) 0:00:04.504 ****** 2020-01-16T05:38:39.144 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-01-16T05:38:39.144 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1579153118.25-116496298680349/source", "state": "file", "uid": 0} 2020-01-16T05:38:39.192 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:39 +0000 (0:00:00.907) 0:00:05.412 ****** 2020-01-16T05:38:39.199 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1579153118.31-48850953481394/source", "state": "file", "uid": 0} 2020-01-16T05:38:39.245 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:39 +0000 (0:00:00.049) 0:00:05.462 ****** 2020-01-16T05:38:39.545 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi084.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-01-16T05:38:39.570 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-01-16T05:38:39.667 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-01-16T05:38:39.708 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-01-16T05:38:39.785 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-01-16T05:38:39.832 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-01-16T05:38:39.917 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-01-16T05:38:39.957 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-01-16T05:38:40.040 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-01-16T05:38:40.086 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-01-16T05:38:40.162 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-01-16T05:38:40.224 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-01-16T05:38:40.289 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-01-16T05:38:40.365 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-01-16T05:38:40.497 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** 2020-01-16T05:38:40.499 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-01-16T05:38:40.504 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-01-16T05:38:40.705 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:40 +0000 (0:00:01.463) 0:00:06.925 ****** 2020-01-16T05:38:40.740 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:40 +0000 (0:00:00.034) 0:00:06.960 ****** 2020-01-16T05:38:41.485 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-01-16T05:38:41.486 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] 2020-01-16T05:38:41.578 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] 2020-01-16T05:38:41.632 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-01-16T05:38:41.634 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:41 +0000 (0:00:00.892) 0:00:07.852 ****** 2020-01-16T05:38:41.710 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:41 +0000 (0:00:00.077) 0:00:07.930 ****** 2020-01-16T05:38:42.020 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-01-16T05:38:42.021 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.232978", "end": "2020-01-16 05:38:41.994051", "rc": 0, "start": "2020-01-16 05:38:41.761073", "stderr": "", "stderr_lines": [], "stdout": "19360304df051f6c2a8374fc9e8fc34ccf5740c9", "stdout_lines": ["19360304df051f6c2a8374fc9e8fc34ccf5740c9"]} 2020-01-16T05:38:42.061 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:42 +0000 (0:00:00.351) 0:00:08.281 ****** 2020-01-16T05:38:42.110 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.244984", "end": "2020-01-16 05:38:42.087239", "rc": 0, "start": "2020-01-16 05:38:41.842255", "stderr": "", "stderr_lines": [], "stdout": "19360304df051f6c2a8374fc9e8fc34ccf5740c9", "stdout_lines": ["19360304df051f6c2a8374fc9e8fc34ccf5740c9"]} 2020-01-16T05:38:42.151 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:42 +0000 (0:00:00.089) 0:00:08.371 ****** 2020-01-16T05:38:42.282 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-01-16T05:38:42.283 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.002514", "end": "2020-01-16 05:38:42.174291", "failed_when_result": false, "rc": 0, "start": "2020-01-16 05:38:42.171777", "stderr": "", "stderr_lines": [], "stdout": "c84d080fc97e482f88d240859322d5765ac90366", "stdout_lines": ["c84d080fc97e482f88d240859322d5765ac90366"]} 2020-01-16T05:38:42.323 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:42 +0000 (0:00:00.171) 0:00:08.543 ****** 2020-01-16T05:38:42.349 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-01-16T05:38:42.350 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:38:42.393 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:42 +0000 (0:00:00.069) 0:00:08.612 ****** 2020-01-16T05:38:42.441 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:38:42.484 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:42 +0000 (0:00:00.091) 0:00:08.704 ****** 2020-01-16T05:38:42.489 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-01-16T05:38:42.489 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.247738", "end": "2020-01-16 05:38:42.138224", "failed_when_result": false, "rc": 0, "start": "2020-01-16 05:38:41.890486", "stderr": "", "stderr_lines": [], "stdout": "c84d080fc97e482f88d240859322d5765ac90366", "stdout_lines": ["c84d080fc97e482f88d240859322d5765ac90366"]} 2020-01-16T05:38:42.532 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:42 +0000 (0:00:00.047) 0:00:08.751 ****** 2020-01-16T05:38:42.537 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-01-16T05:38:42.539 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:38:42.586 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:42 +0000 (0:00:00.054) 0:00:08.805 ****** 2020-01-16T05:38:42.591 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-01-16T05:38:42.592 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:38:42.654 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:42 +0000 (0:00:00.067) 0:00:08.873 ****** 2020-01-16T05:38:42.670 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:38:42.706 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:42 +0000 (0:00:00.050) 0:00:08.923 ****** 2020-01-16T05:38:42.717 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:38:42.757 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:42 +0000 (0:00:00.053) 0:00:08.977 ****** 2020-01-16T05:38:42.762 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-01-16T05:38:42.764 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:38:42.810 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:42 +0000 (0:00:00.052) 0:00:09.030 ****** 2020-01-16T05:38:42.815 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-01-16T05:38:42.816 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:38:42.870 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:42 +0000 (0:00:00.060) 0:00:09.090 ****** 2020-01-16T05:38:42.898 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-01-16T05:38:42.900 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:38:42.947 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:42 +0000 (0:00:00.075) 0:00:09.166 ****** 2020-01-16T05:38:42.964 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-01-16T05:38:42.972 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-16T05:38:43.022 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:43 +0000 (0:00:00.076) 0:00:09.242 ****** 2020-01-16T05:38:43.027 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-01-16T05:38:43.028 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:38:43.071 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:43 +0000 (0:00:00.048) 0:00:09.290 ****** 2020-01-16T05:38:43.266 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-01-16T05:38:43.266 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-01-16T05:38:43.351 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-01-16T05:38:43.351 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-16T05:38:43.395 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:43 +0000 (0:00:00.324) 0:00:09.615 ****** 2020-01-16T05:38:43.453 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-01-16T05:38:43.456 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-01-16T05:38:43.625 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-01-16T05:38:43.646 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-01-16T05:38:43.823 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-01-16T05:38:43.833 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-01-16T05:38:44.012 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-01-16T05:38:44.017 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f 2020-01-16T05:38:44.026 INFO:teuthology.task.ansible.out:47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-01-16T05:38:44.151 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-01-16T05:38:44.203 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-01-16T05:38:44.298 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-01-16T05:38:44.362 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-01-16T05:38:44.427 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-01-16T05:38:44.503 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-01-16T05:38:44.574 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-01-16T05:38:44.642 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-01-16T05:38:44.706 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-01-16T05:38:44.792 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-01-16T05:38:44.835 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-01-16T05:38:44.940 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-01-16T05:38:44.993 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-01-16T05:38:45.078 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-01-16T05:38:45.152 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-01-16T05:38:45.238 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-01-16T05:38:45.303 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-01-16T05:38:45.372 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-01-16T05:38:45.439 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-01-16T05:38:45.493 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-01-16T05:38:45.576 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-01-16T05:38:45.631 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-01-16T05:38:45.728 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-01-16T05:38:45.787 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-01-16T05:38:45.860 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-01-16T05:38:45.915 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-01-16T05:38:46.001 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-01-16T05:38:46.070 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-01-16T05:38:46.138 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-01-16T05:38:46.203 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-01-16T05:38:46.267 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-01-16T05:38:46.346 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-01-16T05:38:46.400 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-01-16T05:38:46.465 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-01-16T05:38:46.540 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-01-16T05:38:46.604 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-01-16T05:38:46.683 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-01-16T05:38:46.737 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-01-16T05:38:46.813 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-01-16T05:38:46.866 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-01-16T05:38:46.942 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-01-16T05:38:46.995 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-01-16T05:38:47.070 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-01-16T05:38:47.169 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-01-16T05:38:47.208 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-01-16T05:38:47.294 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-01-16T05:38:47.346 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-01-16T05:38:47.430 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-01-16T05:38:47.474 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-01-16T05:38:47.548 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-01-16T05:38:47.606 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-01-16T05:38:47.683 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-01-16T05:38:47.747 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-01-16T05:38:47.819 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-01-16T05:38:47.877 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-01-16T05:38:47.954 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-01-16T05:38:48.020 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-01-16T05:38:48.097 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-01-16T05:38:48.150 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-01-16T05:38:48.228 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-01-16T05:38:48.290 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-01-16T05:38:48.364 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-01-16T05:38:48.423 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-01-16T05:38:48.490 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-01-16T05:38:48.554 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-01-16T05:38:48.630 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-01-16T05:38:48.694 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-01-16T05:38:48.762 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-01-16T05:38:48.834 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-01-16T05:38:48.896 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-01-16T05:38:48.961 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-01-16T05:38:49.032 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-01-16T05:38:49.099 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-01-16T05:38:49.163 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-01-16T05:38:49.238 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-01-16T05:38:49.301 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-01-16T05:38:49.386 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-01-16T05:38:49.458 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-01-16T05:38:49.517 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-01-16T05:38:49.582 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-01-16T05:38:49.662 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-01-16T05:38:49.726 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-01-16T05:38:49.791 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-01-16T05:38:49.879 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-01-16T05:38:49.923 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-01-16T05:38:50.011 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-01-16T05:38:50.058 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-01-16T05:38:50.175 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-01-16T05:38:50.195 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-01-16T05:38:50.316 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-01-16T05:38:50.349 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-01-16T05:38:50.480 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-01-16T05:38:50.502 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-01-16T05:38:50.619 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-01-16T05:38:50.744 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-01-16T05:38:50.766 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-01-16T05:38:50.884 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-01-16T05:38:50.899 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-01-16T05:38:51.026 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-01-16T05:38:51.037 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-01-16T05:38:51.164 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-01-16T05:38:51.176 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-01-16T05:38:51.313 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-01-16T05:38:51.314 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-01-16T05:38:51.443 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-01-16T05:38:51.445 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-01-16T05:38:51.576 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-01-16T05:38:51.578 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-01-16T05:38:51.705 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-01-16T05:38:51.718 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-01-16T05:38:51.863 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-01-16T05:38:51.865 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-01-16T05:38:52.012 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-01-16T05:38:52.027 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-01-16T05:38:52.178 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-01-16T05:38:52.312 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-01-16T05:38:52.322 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-01-16T05:38:52.437 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-01-16T05:38:52.449 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-01-16T05:38:52.575 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-01-16T05:38:52.598 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-01-16T05:38:52.706 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-01-16T05:38:52.754 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-01-16T05:38:52.847 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-01-16T05:38:52.894 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-01-16T05:38:52.975 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-01-16T05:38:53.030 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-01-16T05:38:53.112 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-01-16T05:38:53.168 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-01-16T05:38:53.254 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-01-16T05:38:53.298 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-01-16T05:38:53.382 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-01-16T05:38:53.439 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-01-16T05:38:53.508 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-01-16T05:38:53.573 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-01-16T05:38:53.647 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-01-16T05:38:53.700 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-01-16T05:38:53.776 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-01-16T05:38:53.834 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-01-16T05:38:53.911 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-01-16T05:38:53.966 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-01-16T05:38:54.041 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-01-16T05:38:54.093 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-01-16T05:38:54.177 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-01-16T05:38:54.224 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-01-16T05:38:54.322 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-01-16T05:38:54.368 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-01-16T05:38:54.486 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-01-16T05:38:54.512 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-01-16T05:38:54.650 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-01-16T05:38:54.652 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-01-16T05:38:54.788 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-01-16T05:38:54.802 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-01-16T05:38:54.915 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-01-16T05:38:54.939 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-01-16T05:38:55.064 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-01-16T05:38:55.088 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-01-16T05:38:55.203 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-01-16T05:38:55.216 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-01-16T05:38:55.342 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-01-16T05:38:55.374 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-01-16T05:38:55.491 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-01-16T05:38:55.516 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-01-16T05:38:55.633 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-01-16T05:38:55.655 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-01-16T05:38:55.783 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-01-16T05:38:55.795 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-01-16T05:38:55.942 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-01-16T05:38:55.965 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-01-16T05:38:56.074 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-01-16T05:38:56.085 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-01-16T05:38:56.225 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-01-16T05:38:56.351 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-01-16T05:38:56.375 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-01-16T05:38:56.481 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-01-16T05:38:56.504 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-01-16T05:38:56.612 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-01-16T05:38:56.660 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-01-16T05:38:56.745 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-01-16T05:38:56.788 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-01-16T05:38:56.882 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-01-16T05:38:56.927 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-01-16T05:38:57.008 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-01-16T05:38:57.072 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-01-16T05:38:57.148 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-01-16T05:38:57.213 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-01-16T05:38:57.293 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-01-16T05:38:57.358 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-01-16T05:38:57.431 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-01-16T05:38:57.495 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-01-16T05:38:57.568 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-01-16T05:38:57.642 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-01-16T05:38:57.696 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-01-16T05:38:57.771 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-01-16T05:38:57.827 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-01-16T05:38:57.902 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-01-16T05:38:57.967 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-01-16T05:38:58.139 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-01-16T05:38:58.275 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-01-16T05:38:58.567 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-01-16T05:38:58.779 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-01-16T05:38:59.094 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "name": "xiubli", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-01-16T05:38:59.559 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "name": "xiubli", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-01-16T05:38:59.636 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "name": "jafaj", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2020-01-16T05:38:59.787 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:59 +0000 (0:00:16.392) 0:00:26.007 ****** 2020-01-16T05:38:59.814 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-01-16T05:38:59.852 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:59 +0000 (0:00:00.064) 0:00:26.071 ****** 2020-01-16T05:38:59.900 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-01-16T05:38:59.906 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ss 2020-01-16T05:38:59.907 INFO:teuthology.task.ansible.out:h-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN 2020-01-16T05:38:59.908 INFO:teuthology.task.ansible.out:2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499ea 2020-01-16T05:38:59.910 INFO:teuthology.task.ansible.out:f767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d 2020-01-16T05:38:59.911 INFO:teuthology.task.ansible.out:85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c2 2020-01-16T05:38:59.911 INFO:teuthology.task.ansible.out:4e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d 2020-01-16T05:38:59.913 INFO:teuthology.task.ansible.out:86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868" 2020-01-16T05:38:59.914 INFO:teuthology.task.ansible.out:}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad 2020-01-16T05:38:59.915 INFO:teuthology.task.ansible.out:7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280 2020-01-16T05:38:59.917 INFO:teuthology.task.ansible.out:b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029cc 2020-01-16T05:38:59.919 INFO:teuthology.task.ansible.out:dc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkr 2020-01-16T05:38:59.921 INFO:teuthology.task.ansible.out:Q 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": 2020-01-16T05:38:59.922 INFO:teuthology.task.ansible.out: "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}]}, "changed": false} 2020-01-16T05:38:59.974 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:38:59 +0000 (0:00:00.122) 0:00:26.194 ****** 2020-01-16T05:38:59.999 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-01-16T05:39:00.000 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "name": "jafaj", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2020-01-16T05:39:00.146 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:00 +0000 (0:00:00.171) 0:00:26.365 ****** 2020-01-16T05:39:00.173 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-01-16T05:39:00.221 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:00 +0000 (0:00:00.075) 0:00:26.441 ****** 2020-01-16T05:39:00.272 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-01-16T05:39:00.277 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ss 2020-01-16T05:39:00.278 INFO:teuthology.task.ansible.out:h-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN 2020-01-16T05:39:00.279 INFO:teuthology.task.ansible.out:2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499ea 2020-01-16T05:39:00.281 INFO:teuthology.task.ansible.out:f767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d 2020-01-16T05:39:00.282 INFO:teuthology.task.ansible.out:85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d 2020-01-16T05:39:00.284 INFO:teuthology.task.ansible.out:86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa 2020-01-16T05:39:00.284 INFO:teuthology.task.ansible.out:256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868" 2020-01-16T05:39:00.285 INFO:teuthology.task.ansible.out:}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad 2020-01-16T05:39:00.287 INFO:teuthology.task.ansible.out:7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280 2020-01-16T05:39:00.288 INFO:teuthology.task.ansible.out:b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkr 2020-01-16T05:39:00.290 INFO:teuthology.task.ansible.out:Q 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": 2020-01-16T05:39:00.291 INFO:teuthology.task.ansible.out: "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}]}, "changed": false} 2020-01-16T05:39:00.335 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:00 +0000 (0:00:00.113) 0:00:26.555 ****** 2020-01-16T05:39:00.891 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-01-16T05:39:00.892 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com -> localhost] => {"after": "19360304df051f6c2a8374fc9e8fc34ccf5740c9", "attempts": 1, "before": "19360304df051f6c2a8374fc9e8fc34ccf5740c9", "changed": false, "remote_url_changed": false} 2020-01-16T05:39:00.931 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:00 +0000 (0:00:00.595) 0:00:27.151 ****** 2020-01-16T05:39:00.994 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com -> localhost] => {"after": "19360304df051f6c2a8374fc9e8fc34ccf5740c9", "attempts": 1, "before": "19360304df051f6c2a8374fc9e8fc34ccf5740c9", "changed": false, "remote_url_changed": false} 2020-01-16T05:39:01.034 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:01 +0000 (0:00:00.102) 0:00:27.254 ****** 2020-01-16T05:39:01.220 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-16T05:39:01.221 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-01-16T05:39:01.222 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-01-16T05:39:01.372 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-01-16T05:39:01.394 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-01-16T05:39:01.494 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-01-16T05:39:01.528 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-01-16T05:39:01.627 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2020-01-16T05:39:01.628 INFO:teuthology.task.ansible.out:lidate_certs": true} 2020-01-16T05:39:01.680 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2020-01-16T05:39:01.682 INFO:teuthology.task.ansible.out:lidate_certs": true} 2020-01-16T05:39:01.775 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-01-16T05:39:01.843 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-01-16T05:39:01.908 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2020-01-16T05:39:01.909 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-01-16T05:39:01.975 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2020-01-16T05:39:01.977 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-01-16T05:39:02.049 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-01-16T05:39:02.096 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-01-16T05:39:02.186 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-01-16T05:39:02.192 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:02.242 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-01-16T05:39:02.264 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:02.333 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2020-01-16T05:39:02.334 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-01-16T05:39:02.344 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:02.355 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:02.370 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:02.399 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2020-01-16T05:39:02.401 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-01-16T05:39:02.411 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:02.412 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:02.424 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:02.497 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-01-16T05:39:02.572 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-01-16T05:39:02.648 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2020-01-16T05:39:02.650 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-01-16T05:39:02.724 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2020-01-16T05:39:02.725 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-01-16T05:39:02.778 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-01-16T05:39:02.852 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-01-16T05:39:02.917 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-01-16T05:39:02.991 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-01-16T05:39:03.057 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2020-01-16T05:39:03.132 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2020-01-16T05:39:03.190 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-01-16T05:39:03.255 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-01-16T05:39:03.319 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-01-16T05:39:03.393 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-01-16T05:39:03.446 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-01-16T05:39:03.531 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-01-16T05:39:03.584 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2020-01-16T05:39:03.586 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-01-16T05:39:03.660 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2020-01-16T05:39:03.661 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-01-16T05:39:03.713 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2020-01-16T05:39:03.715 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-01-16T05:39:03.790 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2020-01-16T05:39:03.792 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-01-16T05:39:03.846 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-01-16T05:39:03.921 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-01-16T05:39:03.984 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-01-16T05:39:04.053 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-01-16T05:39:04.119 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2020-01-16T05:39:04.121 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-01-16T05:39:04.184 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2020-01-16T05:39:04.186 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-01-16T05:39:04.262 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-01-16T05:39:04.318 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-01-16T05:39:04.411 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-01-16T05:39:04.444 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-01-16T05:39:04.565 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-01-16T05:39:04.577 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-01-16T05:39:04.709 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-01-16T05:39:04.710 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-01-16T05:39:04.835 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-01-16T05:39:04.847 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-01-16T05:39:04.977 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2020-01-16T05:39:04.978 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-01-16T05:39:05.009 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2020-01-16T05:39:05.011 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-01-16T05:39:05.104 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-01-16T05:39:05.137 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-01-16T05:39:05.244 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-01-16T05:39:05.270 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-01-16T05:39:05.366 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-01-16T05:39:05.424 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-01-16T05:39:05.519 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-01-16T05:39:05.562 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-01-16T05:39:05.648 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": tr 2020-01-16T05:39:05.649 INFO:teuthology.task.ansible.out:ue} 2020-01-16T05:39:05.693 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-01-16T05:39:05.798 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-01-16T05:39:05.820 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-01-16T05:39:05.938 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-01-16T05:39:05.951 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-01-16T05:39:06.067 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-01-16T05:39:06.089 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-01-16T05:39:06.195 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-01-16T05:39:06.227 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-01-16T05:39:06.324 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2020-01-16T05:39:06.326 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-01-16T05:39:06.356 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2020-01-16T05:39:06.357 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-01-16T05:39:06.474 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2020-01-16T05:39:06.475 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-01-16T05:39:06.496 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2020-01-16T05:39:06.498 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-01-16T05:39:06.603 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-01-16T05:39:06.646 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-01-16T05:39:06.729 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-01-16T05:39:06.778 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-01-16T05:39:06.862 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-01-16T05:39:06.904 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-01-16T05:39:06.989 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2020-01-16T05:39:06.990 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-01-16T05:39:07.031 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2020-01-16T05:39:07.032 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-01-16T05:39:07.126 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2020-01-16T05:39:07.128 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2020-01-16T05:39:07.129 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-01-16T05:39:07.168 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2020-01-16T05:39:07.170 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2020-01-16T05:39:07.172 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-01-16T05:39:07.252 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-01-16T05:39:07.310 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-01-16T05:39:07.384 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-01-16T05:39:07.519 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-01-16T05:39:07.571 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-01-16T05:39:07.656 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-01-16T05:39:07.700 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-01-16T05:39:07.784 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-01-16T05:39:07.830 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-01-16T05:39:07.914 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-01-16T05:39:07.954 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-01-16T05:39:08.039 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-01-16T05:39:08.092 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-01-16T05:39:08.166 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-01-16T05:39:08.219 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-01-16T05:39:08.295 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2020-01-16T05:39:08.297 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2020-01-16T05:39:08.351 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-01-16T05:39:08.424 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-01-16T05:39:08.477 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2020-01-16T05:39:08.479 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2020-01-16T05:39:08.551 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-01-16T05:39:08.610 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-01-16T05:39:08.701 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2020-01-16T05:39:08.702 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-01-16T05:39:08.744 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-01-16T05:39:08.839 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-01-16T05:39:08.871 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2020-01-16T05:39:08.873 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-01-16T05:39:08.978 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-01-16T05:39:09.169 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} ok: [smithi084.front.sep 2020-01-16T05:39:09.171 INFO:teuthology.task.ansible.out:ia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-01-16T05:39:09.241 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-01-16T05:39:09.284 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-01-16T05:39:09.381 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-01-16T05:39:09.412 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-01-16T05:39:09.547 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-01-16T05:39:09.558 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-01-16T05:39:09.682 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-01-16T05:39:09.684 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-01-16T05:39:09.815 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-01-16T05:39:09.848 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-01-16T05:39:09.943 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-01-16T05:39:09.994 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-01-16T05:39:10.078 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-01-16T05:39:10.107 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-01-16T05:39:10.195 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-01-16T05:39:10.237 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-01-16T05:39:10.331 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-01-16T05:39:10.374 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-01-16T05:39:10.458 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-01-16T05:39:10.501 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-01-16T05:39:10.586 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-01-16T05:39:10.628 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-01-16T05:39:10.713 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-01-16T05:39:10.779 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-01-16T05:39:10.833 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-01-16T05:39:10.909 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-01-16T05:39:10.968 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-01-16T05:39:11.103 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-01-16T05:39:11.171 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-01-16T05:39:11.244 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-01-16T05:39:11.297 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-01-16T05:39:11.370 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-01-16T05:39:11.425 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-01-16T05:39:11.509 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-01-16T05:39:11.562 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-01-16T05:39:11.637 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-01-16T05:39:11.701 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-01-16T05:39:11.777 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-01-16T05:39:11.841 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-01-16T05:39:11.904 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-01-16T05:39:11.982 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-01-16T05:39:12.030 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-01-16T05:39:12.109 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-01-16T05:39:12.180 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-01-16T05:39:12.233 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-01-16T05:39:12.322 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2020-01-16T05:39:12.324 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-01-16T05:39:12.376 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2020-01-16T05:39:12.377 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-01-16T05:39:12.471 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2020-01-16T05:39:12.473 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-01-16T05:39:12.504 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2020-01-16T05:39:12.505 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-01-16T05:39:12.600 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-01-16T05:39:12.660 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-01-16T05:39:12.736 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-01-16T05:39:12.770 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-01-16T05:39:12.867 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-01-16T05:39:12.899 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-01-16T05:39:12.999 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-01-16T05:39:13.035 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-01-16T05:39:13.123 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-01-16T05:39:13.166 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-01-16T05:39:13.253 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-01-16T05:39:13.299 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-01-16T05:39:13.384 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-01-16T05:39:13.430 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-01-16T05:39:13.516 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-01-16T05:39:13.571 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-01-16T05:39:13.651 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-01-16T05:39:13.706 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-01-16T05:39:13.783 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-01-16T05:39:13.857 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-01-16T05:39:13.921 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-01-16T05:39:13.984 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-01-16T05:39:14.049 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-01-16T05:39:14.147 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-01-16T05:39:14.210 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-01-16T05:39:14.377 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-01-16T05:39:14.441 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-01-16T05:39:14.598 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-01-16T05:39:14.662 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2020-01-16T05:39:14.663 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-01-16T05:39:14.809 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2020-01-16T05:39:14.811 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-01-16T05:39:14.885 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-01-16T05:39:14.990 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-01-16T05:39:15.078 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-01-16T05:39:15.143 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-01-16T05:39:15.249 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-01-16T05:39:15.300 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-01-16T05:39:15.403 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-01-16T05:39:15.435 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-01-16T05:39:15.560 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzVa77kg0qGGE3IpMZgSYJ+UwQiDEOg3Lji470V/sQ/R7g6/v7FZpaYqGn1wG3XeUp2gGACxNKLQfGV9EGU66NvfQYqn9A8dXRpTpZuGWN8EcKK98YrSAq0s0WzeiEzVT86RHzVHIqL6/Zn4B1p9sIeY9Hb+bfKOdtYkRBDoFELtiMRzHPFaiIJFnXl+EhH8wceYqXVNNvCuOUBMnOiDYLDtujvYdPt+ff7rvXuOzbwcAKoINFM1C4FtoUEYriKlsxJ2rr7AblfDm/WIrCZcqRBU4JcudtvZOtHhvN4uL6WgzuzuhIQFyePAeIHFUn6AiwKC/MApq7z1Qj+N3pN/Nz xiubli@fedora1", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-01-16T05:39:15.562 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzVa77kg0qGGE3IpMZgSYJ+UwQiDEOg3Lji470V/sQ/R7g6/v7FZpaYqGn1wG3XeUp2gGACxNKLQfGV9EGU66NvfQYqn9A8dXRpTpZuGWN8EcKK98YrSAq0s0WzeiEzVT86RHzVHIqL6/Zn4B1p9sIeY9Hb+bfKOdtYkRBDoFELtiMRzHPFaiIJFnXl+EhH8wceYqXVNNvCuOUBMnOiDYLDtujvYdPt+ff7rvXuOzbwcAKoINFM1C4FtoUEYriKlsxJ2rr7AblfDm/WIrCZcqRBU4JcudtvZOtHhvN4uL6WgzuzuhIQFyePAeIHFUn6AiwKC/MApq7z1Qj+N3pN/Nz xiubli@fedora1", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-01-16T05:39:15.694 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-01-16T05:39:15.794 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-01-16T05:39:15.872 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:15 +0000 (0:00:14.837) 0:00:42.092 ****** 2020-01-16T05:39:15.906 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:15 +0000 (0:00:00.033) 0:00:42.126 ****** 2020-01-16T05:39:15.925 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-16T05:39:15.926 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:15.937 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:15.948 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:15.949 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:15.951 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:15.965 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:15.973 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:15.975 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:15.984 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:15.985 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:15.997 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.008 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.021 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.122 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6m 2020-01-16T05:39:16.130 INFO:teuthology.task.ansible.out:GspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-01-16T05:39:16.145 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.163 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-01-16T05:39:16.174 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.279 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2020-01-16T05:39:16.312 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2020-01-16T05:39:16.418 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-01-16T05:39:16.431 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-01-16T05:39:16.536 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-01-16T05:39:16.558 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.559 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-01-16T05:39:16.561 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.571 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.582 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.680 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.691 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.703 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.703 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.715 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.715 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.717 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.727 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.728 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.729 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.740 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.741 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.742 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.753 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.754 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.755 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.766 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.767 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.769 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.779 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.780 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.781 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.793 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.793 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.795 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.805 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.807 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.808 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.809 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.820 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.821 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.831 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.832 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.834 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.834 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.845 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.846 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.859 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.860 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.863 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.875 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.882 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.883 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.885 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.896 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.898 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.899 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.900 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.913 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.913 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.925 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.926 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.928 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.938 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.939 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.950 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.951 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.953 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.969 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.970 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.972 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.987 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.988 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.990 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:16.991 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.001 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.002 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.004 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.014 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.026 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.027 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.028 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.039 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.039 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.041 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.052 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.053 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.064 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.064 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.066 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.067 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.080 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.090 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.091 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.101 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.102 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.104 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.114 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.115 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.117 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.129 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.129 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.140 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.142 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.143 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.143 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.154 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.155 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.167 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.168 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.179 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.180 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.182 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.193 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.194 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.195 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.206 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.206 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.218 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.219 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.221 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.232 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.232 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.234 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.244 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.245 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.246 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.257 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.258 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.259 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.270 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.270 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.281 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.282 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.284 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.285 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.296 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.308 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.310 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.311 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.313 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.324 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.325 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.327 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.339 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.340 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.352 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.353 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.355 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.366 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.368 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.369 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.371 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.381 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.382 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.384 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.385 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.397 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.398 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.399 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.410 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.412 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.413 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.415 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.425 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.427 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.428 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.430 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.441 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.441 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.453 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.454 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.455 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.456 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.468 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.470 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.471 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.473 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.483 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.484 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.496 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.497 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.498 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.500 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.512 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.513 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.630 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.694 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:17 +0000 (0:00:01.787) 0:00:43.914 ****** 2020-01-16T05:39:17.737 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:17 +0000 (0:00:00.042) 0:00:43.956 ****** 2020-01-16T05:39:17.738 INFO:teuthology.task.ansible.out: 2020-01-16T05:39:17.744 INFO:teuthology.task.ansible.out: 2020-01-16T05:39:17.745 INFO:teuthology.task.ansible.out:TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.791 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:17 +0000 (0:00:00.054) 0:00:44.010 ****** 2020-01-16T05:39:17.796 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:17.839 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:17 +0000 (0:00:00.048) 0:00:44.059 ****** 2020-01-16T05:39:17.949 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-16T05:39:17.950 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-01-16T05:39:18.002 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-01-16T05:39:18.076 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-01-16T05:39:18.130 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-01-16T05:39:18.204 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-01-16T05:39:18.257 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-01-16T05:39:18.332 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-01-16T05:39:18.384 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-01-16T05:39:18.460 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-01-16T05:39:18.502 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-01-16T05:39:18.504 INFO:teuthology.task.ansible.out: 2020-01-16T05:39:18.587 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-01-16T05:39:18.589 INFO:teuthology.task.ansible.out: 2020-01-16T05:39:18.633 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-01-16T05:39:18.707 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-01-16T05:39:18.708 INFO:teuthology.task.ansible.out: 2020-01-16T05:39:18.762 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-01-16T05:39:18.827 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-01-16T05:39:18.891 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-01-16T05:39:18.955 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-01-16T05:39:19.018 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-01-16T05:39:19.081 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-01-16T05:39:19.145 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-01-16T05:39:19.147 INFO:teuthology.task.ansible.out: 2020-01-16T05:39:19.200 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-01-16T05:39:19.273 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-01-16T05:39:19.326 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-01-16T05:39:19.410 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-01-16T05:39:19.457 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-01-16T05:39:19.530 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-01-16T05:39:19.584 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-01-16T05:39:19.678 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-01-16T05:39:19.720 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-01-16T05:39:19.806 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-01-16T05:39:19.853 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-01-16T05:39:19.947 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-01-16T05:39:20.003 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-01-16T05:39:20.079 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-01-16T05:39:20.143 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-01-16T05:39:20.206 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-01-16T05:39:20.281 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-01-16T05:39:20.344 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-01-16T05:39:20.428 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-01-16T05:39:20.481 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-01-16T05:39:20.549 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-01-16T05:39:20.612 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-01-16T05:39:20.679 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-01-16T05:39:20.761 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-01-16T05:39:20.803 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-01-16T05:39:20.885 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-01-16T05:39:20.927 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-01-16T05:39:21.011 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-01-16T05:39:21.064 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-01-16T05:39:21.150 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-01-16T05:39:21.193 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-01-16T05:39:21.268 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-01-16T05:39:21.331 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-01-16T05:39:21.405 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-01-16T05:39:21.458 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-01-16T05:39:21.532 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-01-16T05:39:21.584 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-01-16T05:39:21.658 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-01-16T05:39:21.711 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-01-16T05:39:21.774 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-01-16T05:39:21.837 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-01-16T05:39:21.900 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-01-16T05:39:21.963 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-01-16T05:39:22.026 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-01-16T05:39:22.090 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-01-16T05:39:22.153 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-01-16T05:39:22.615 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adeza", "name": "adeza", "remove": false, "state": "absent"} 2020-01-16T05:39:22.637 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adeza", "name": "adeza", "remove": false, "state": "absent"} 2020-01-16T05:39:22.741 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-01-16T05:39:22.763 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-01-16T05:39:22.867 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-01-16T05:39:22.899 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-01-16T05:39:22.993 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-01-16T05:39:23.036 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-01-16T05:39:23.111 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-01-16T05:39:23.164 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-01-16T05:39:23.238 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-01-16T05:39:23.291 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-01-16T05:39:23.365 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-01-16T05:39:23.418 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-01-16T05:39:23.492 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-01-16T05:39:23.559 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-01-16T05:39:23.612 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-01-16T05:39:23.687 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:23 +0000 (0:00:05.847) 0:00:49.906 ****** 2020-01-16T05:39:23.706 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-01-16T05:39:23.768 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:23 +0000 (0:00:00.081) 0:00:49.988 ****** 2020-01-16T05:39:24.042 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-01-16T05:39:24.045 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "checksum": "57a80abb6bd2cfda924e34ebf4650ffb7c549276", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "dcd56ec72ab960a85198ee963f616ac5", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1579153163.71-5337611750893/source", "state": "file", "uid": 0} 2020-01-16T05:39:24.083 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.314) 0:00:50.303 ****** 2020-01-16T05:39:24.109 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi142.front.sepia.ceph.com] => { "msg": "Host smithi142.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-01-16T05:39:24.150 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.067) 0:00:50.370 ****** 2020-01-16T05:39:24.156 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-01-16T05:39:24.157 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "checksum": "57a80abb6bd2cfda924e34ebf4650ffb7c549276", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "dcd56ec72ab960a85198ee963f616ac5", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1579153163.79-31882907953548/source", "state": "file", "uid": 0} 2020-01-16T05:39:24.200 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.049) 0:00:50.420 ****** 2020-01-16T05:39:24.207 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-01-16T05:39:24.207 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-01-16T05:39:24.251 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.051) 0:00:50.471 ****** 2020-01-16T05:39:24.257 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-01-16T05:39:24.257 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => { "msg": "Host smithi084.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-01-16T05:39:24.311 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.060) 0:00:50.531 ****** 2020-01-16T05:39:24.317 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-01-16T05:39:24.318 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:24.361 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.049) 0:00:50.581 ****** 2020-01-16T05:39:24.366 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-01-16T05:39:24.367 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-01-16T05:39:24.407 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.045) 0:00:50.626 ****** 2020-01-16T05:39:24.411 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-01-16T05:39:24.413 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:24.452 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.044) 0:00:50.671 ****** 2020-01-16T05:39:24.458 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-01-16T05:39:24.459 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:24.499 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.046) 0:00:50.718 ****** 2020-01-16T05:39:24.503 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-01-16T05:39:24.505 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:24.547 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.048) 0:00:50.767 ****** 2020-01-16T05:39:24.552 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-01-16T05:39:24.553 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:24.592 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.044) 0:00:50.812 ****** 2020-01-16T05:39:24.597 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-01-16T05:39:24.598 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:24.638 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.045) 0:00:50.857 ****** 2020-01-16T05:39:24.642 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-01-16T05:39:24.643 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:24.682 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.044) 0:00:50.902 ****** 2020-01-16T05:39:24.686 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-01-16T05:39:24.688 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:24.727 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.044) 0:00:50.947 ****** 2020-01-16T05:39:24.732 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-01-16T05:39:24.733 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:24.775 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.047) 0:00:50.995 ****** 2020-01-16T05:39:24.793 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:24.819 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.044) 0:00:51.039 ****** 2020-01-16T05:39:24.824 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-01-16T05:39:24.826 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:24.865 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.045) 0:00:51.085 ****** 2020-01-16T05:39:24.870 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-01-16T05:39:24.871 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:24.909 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.044) 0:00:51.129 ****** 2020-01-16T05:39:24.913 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-01-16T05:39:24.914 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:24.954 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.043) 0:00:51.173 ****** 2020-01-16T05:39:24.958 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-01-16T05:39:24.960 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:24.998 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:24 +0000 (0:00:00.044) 0:00:51.218 ****** 2020-01-16T05:39:25.002 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-01-16T05:39:25.004 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:25.045 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.046) 0:00:51.265 ****** 2020-01-16T05:39:25.049 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-01-16T05:39:25.049 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-16T05:39:25.051 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-16T05:39:25.092 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.047) 0:00:51.312 ****** 2020-01-16T05:39:25.097 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-01-16T05:39:25.097 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:25.138 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.045) 0:00:51.358 ****** 2020-01-16T05:39:25.142 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-01-16T05:39:25.144 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:25.186 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.048) 0:00:51.406 ****** 2020-01-16T05:39:25.190 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-01-16T05:39:25.191 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-16T05:39:25.192 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-16T05:39:25.231 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.045) 0:00:51.451 ****** 2020-01-16T05:39:25.235 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-01-16T05:39:25.238 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:25.280 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.047) 0:00:51.499 ****** 2020-01-16T05:39:25.285 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-01-16T05:39:25.286 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:25.329 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.049) 0:00:51.548 ****** 2020-01-16T05:39:25.334 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi142.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-16T05:39:25.376 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.047) 0:00:51.595 ****** 2020-01-16T05:39:25.380 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-01-16T05:39:25.381 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:25.422 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.046) 0:00:51.642 ****** 2020-01-16T05:39:25.426 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-01-16T05:39:25.428 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:25.469 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.046) 0:00:51.688 ****** 2020-01-16T05:39:25.475 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-01-16T05:39:25.476 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-16T05:39:25.517 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.048) 0:00:51.736 ****** 2020-01-16T05:39:25.522 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-01-16T05:39:25.523 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-16T05:39:25.563 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.045) 0:00:51.782 ****** 2020-01-16T05:39:25.567 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-01-16T05:39:25.569 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:25.610 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.046) 0:00:51.829 ****** 2020-01-16T05:39:25.614 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-01-16T05:39:25.616 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:25.660 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.049) 0:00:51.879 ****** 2020-01-16T05:39:25.664 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-01-16T05:39:25.666 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-16T05:39:25.709 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.049) 0:00:51.928 ****** 2020-01-16T05:39:25.714 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-01-16T05:39:25.715 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:25.757 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.048) 0:00:51.977 ****** 2020-01-16T05:39:25.763 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-01-16T05:39:25.763 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:25.806 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.049) 0:00:52.026 ****** 2020-01-16T05:39:25.812 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-01-16T05:39:25.813 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:25.855 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.048) 0:00:52.075 ****** 2020-01-16T05:39:25.859 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-01-16T05:39:25.861 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:25.909 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.053) 0:00:52.129 ****** 2020-01-16T05:39:25.914 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-01-16T05:39:25.916 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:25.956 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.047) 0:00:52.176 ****** 2020-01-16T05:39:25.961 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-01-16T05:39:25.962 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:26.002 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:25 +0000 (0:00:00.045) 0:00:52.221 ****** 2020-01-16T05:39:26.006 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-01-16T05:39:26.008 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-16T05:39:26.048 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.046) 0:00:52.268 ****** 2020-01-16T05:39:26.055 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-01-16T05:39:26.056 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:26.099 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.050) 0:00:52.319 ****** 2020-01-16T05:39:26.105 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-01-16T05:39:26.107 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:26.147 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.047) 0:00:52.367 ****** 2020-01-16T05:39:26.152 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-01-16T05:39:26.154 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-16T05:39:26.196 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.048) 0:00:52.416 ****** 2020-01-16T05:39:26.201 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-01-16T05:39:26.203 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:26.243 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.047) 0:00:52.463 ****** 2020-01-16T05:39:26.248 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-01-16T05:39:26.249 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:26.291 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.047) 0:00:52.511 ****** 2020-01-16T05:39:26.295 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-01-16T05:39:26.297 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:26.338 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.047) 0:00:52.558 ****** 2020-01-16T05:39:26.344 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-01-16T05:39:26.345 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:26.385 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.046) 0:00:52.604 ****** 2020-01-16T05:39:26.390 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-01-16T05:39:26.390 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:26.431 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.046) 0:00:52.650 ****** 2020-01-16T05:39:26.435 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-01-16T05:39:26.435 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:26.476 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.045) 0:00:52.696 ****** 2020-01-16T05:39:26.481 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-01-16T05:39:26.482 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:26.525 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.049) 0:00:52.745 ****** 2020-01-16T05:39:26.531 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-01-16T05:39:26.533 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:26.574 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.048) 0:00:52.793 ****** 2020-01-16T05:39:26.579 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-01-16T05:39:26.581 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:26.625 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.049) 0:00:52.843 ****** 2020-01-16T05:39:26.628 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-01-16T05:39:26.629 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:26.671 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.047) 0:00:52.891 ****** 2020-01-16T05:39:26.676 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-01-16T05:39:26.678 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-16T05:39:26.719 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.047) 0:00:52.939 ****** 2020-01-16T05:39:26.724 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-01-16T05:39:26.725 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:26.765 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.045) 0:00:52.985 ****** 2020-01-16T05:39:26.769 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-01-16T05:39:26.816 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.050) 0:00:53.035 ****** 2020-01-16T05:39:26.820 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-01-16T05:39:26.821 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-16T05:39:26.863 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.046) 0:00:53.082 ****** 2020-01-16T05:39:26.867 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-01-16T05:39:26.869 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:26.910 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.046) 0:00:53.129 ****** 2020-01-16T05:39:26.914 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-01-16T05:39:26.955 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.045) 0:00:53.175 ****** 2020-01-16T05:39:26.959 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-01-16T05:39:26.961 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.001 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:26 +0000 (0:00:00.046) 0:00:53.221 ****** 2020-01-16T05:39:27.007 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-01-16T05:39:27.008 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.052 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:27 +0000 (0:00:00.050) 0:00:53.272 ****** 2020-01-16T05:39:27.058 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-01-16T05:39:27.058 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.060 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.100 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:27 +0000 (0:00:00.047) 0:00:53.320 ****** 2020-01-16T05:39:27.106 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-01-16T05:39:27.108 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.150 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:27 +0000 (0:00:00.050) 0:00:53.370 ****** 2020-01-16T05:39:27.156 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi142.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.156 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.203 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:27 +0000 (0:00:00.052) 0:00:53.422 ****** 2020-01-16T05:39:27.204 INFO:teuthology.task.ansible.out: 2020-01-16T05:39:27.209 INFO:teuthology.task.ansible.out: 2020-01-16T05:39:27.211 INFO:teuthology.task.ansible.out:TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.212 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.214 INFO:teuthology.task.ansible.out: 2020-01-16T05:39:27.264 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:27 +0000 (0:00:00.061) 0:00:53.484 ****** 2020-01-16T05:39:27.266 INFO:teuthology.task.ansible.out: 2020-01-16T05:39:27.271 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2020-01-16T05:39:27.272 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.273 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.325 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:27 +0000 (0:00:00.057) 0:00:53.541 ****** 2020-01-16T05:39:27.328 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi084.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.369 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:27 +0000 (0:00:00.047) 0:00:53.589 ****** 2020-01-16T05:39:27.374 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2020-01-16T05:39:27.376 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.419 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:27 +0000 (0:00:00.049) 0:00:53.638 ****** 2020-01-16T05:39:27.424 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2020-01-16T05:39:27.424 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.426 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.476 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:27 +0000 (0:00:00.057) 0:00:53.696 ****** 2020-01-16T05:39:27.482 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2020-01-16T05:39:27.484 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.485 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.528 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:27 +0000 (0:00:00.052) 0:00:53.748 ****** 2020-01-16T05:39:27.534 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2020-01-16T05:39:27.534 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.579 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:27 +0000 (0:00:00.051) 0:00:53.799 ****** 2020-01-16T05:39:27.616 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2020-01-16T05:39:27.617 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.618 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.657 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:27 +0000 (0:00:00.077) 0:00:53.877 ****** 2020-01-16T05:39:27.693 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-01-16T05:39:27.693 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.029473", "end": "2020-01-16 05:39:27.602867", "rc": 0, "start": "2020-01-16 05:39:27.573394", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-01-16T05:39:27.738 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:27 +0000 (0:00:00.081) 0:00:53.958 ****** 2020-01-16T05:39:27.765 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-01-16T05:39:27.766 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.803 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:27 +0000 (0:00:00.064) 0:00:54.023 ****** 2020-01-16T05:39:27.805 INFO:teuthology.task.ansible.out: 2020-01-16T05:39:27.828 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-01-16T05:39:27.830 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.043664", "end": "2020-01-16 05:39:27.556012", "rc": 0, "start": "2020-01-16 05:39:27.512348", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-01-16T05:39:27.868 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:27 +0000 (0:00:00.064) 0:00:54.088 ****** 2020-01-16T05:39:27.902 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:27 +0000 (0:00:00.033) 0:00:54.122 ****** 2020-01-16T05:39:27.907 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-01-16T05:39:27.908 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.947 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:27 +0000 (0:00:00.045) 0:00:54.167 ****** 2020-01-16T05:39:27.952 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-01-16T05:39:27.954 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:27.993 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:27 +0000 (0:00:00.045) 0:00:54.213 ****** 2020-01-16T05:39:27.997 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-01-16T05:39:27.998 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:28.043 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:28 +0000 (0:00:00.049) 0:00:54.263 ****** 2020-01-16T05:39:28.047 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-01-16T05:39:28.049 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:28.089 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:28 +0000 (0:00:00.045) 0:00:54.308 ****** 2020-01-16T05:39:28.094 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-01-16T05:39:28.095 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:28.139 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:28 +0000 (0:00:00.049) 0:00:54.358 ****** 2020-01-16T05:39:28.143 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-01-16T05:39:28.145 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:28.183 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:28 +0000 (0:00:00.044) 0:00:54.403 ****** 2020-01-16T05:39:28.187 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-01-16T05:39:28.187 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:28.230 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:28 +0000 (0:00:00.046) 0:00:54.450 ****** 2020-01-16T05:39:28.237 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:28.280 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:28 +0000 (0:00:00.049) 0:00:54.500 ****** 2020-01-16T05:39:28.285 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-01-16T05:39:28.286 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:28.333 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:28 +0000 (0:00:00.052) 0:00:54.553 ****** 2020-01-16T05:39:28.338 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-01-16T05:39:28.340 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:28.381 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:28 +0000 (0:00:00.047) 0:00:54.600 ****** 2020-01-16T05:39:28.386 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-01-16T05:39:28.387 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:28.433 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:28 +0000 (0:00:00.051) 0:00:54.651 ****** 2020-01-16T05:39:28.458 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-01-16T05:39:28.460 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:28.501 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:28 +0000 (0:00:00.068) 0:00:54.720 ****** 2020-01-16T05:39:28.590 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-01-16T05:39:28.591 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.074353", "end": "2020-01-16 05:39:28.500399", "rc": 0, "start": "2020-01-16 05:39:28.426046", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:39:28.644 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:28 +0000 (0:00:00.142) 0:00:54.863 ****** 2020-01-16T05:39:28.671 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-01-16T05:39:28.678 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:28.711 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:28 +0000 (0:00:00.067) 0:00:54.931 ****** 2020-01-16T05:39:28.771 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-01-16T05:39:28.773 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.146232", "end": "2020-01-16 05:39:28.500349", "rc": 0, "start": "2020-01-16 05:39:28.354117", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:39:28.837 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:28 +0000 (0:00:00.126) 0:00:55.057 ****** 2020-01-16T05:39:28.863 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-01-16T05:39:28.864 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:28.905 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:28 +0000 (0:00:00.067) 0:00:55.124 ****** 2020-01-16T05:39:28.910 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-01-16T05:39:28.910 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-01-16T05:39:28.912 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.033571", "end": "2020-01-16 05:39:28.796007", "rc": 0, "start": "2020-01-16 05:39:28.762436", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:39:28.962 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:28 +0000 (0:00:00.057) 0:00:55.182 ****** 2020-01-16T05:39:29.062 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.036675", "end": "2020-01-16 05:39:28.792213", "rc": 0, "start": "2020-01-16 05:39:28.755538", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:39:29.102 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:29 +0000 (0:00:00.140) 0:00:55.322 ****** 2020-01-16T05:39:32.599 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-01-16T05:39:32.600 INFO:teuthology.task.ansible.out: [WARNING]: Could not find aptitude. Using apt-get instead ok: [smithi142.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1579152942, "cache_updated": false, "changed": false} 2020-01-16T05:39:32.638 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:32 +0000 (0:00:03.535) 0:00:58.858 ****** 2020-01-16T05:39:32.737 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1579152899, "cache_updated": false, "changed": false} 2020-01-16T05:39:32.777 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:32 +0000 (0:00:00.139) 0:00:58.997 ****** 2020-01-16T05:39:33.486 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-01-16T05:39:33.488 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1579152942, "cache_updated": false, "changed": false} 2020-01-16T05:39:33.529 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:33 +0000 (0:00:00.751) 0:00:59.749 ****** 2020-01-16T05:39:33.555 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-01-16T05:39:33.556 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:33.594 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:33 +0000 (0:00:00.065) 0:00:59.814 ****** 2020-01-16T05:39:33.610 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-01-16T05:39:33.610 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"cache_update_time": 1579152899, "cache_updated": false, "changed": false} 2020-01-16T05:39:33.650 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:33 +0000 (0:00:00.055) 0:00:59.870 ****** 2020-01-16T05:39:33.687 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-01-16T05:39:33.688 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:33.728 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:33 +0000 (0:00:00.077) 0:00:59.948 ****** 2020-01-16T05:39:34.227 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-01-16T05:39:34.240 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-01-16T05:39:34.242 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-01-16T05:39:34.296 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:34 +0000 (0:00:00.568) 0:01:00.516 ****** 2020-01-16T05:39:34.347 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:34 +0000 (0:00:00.050) 0:01:00.566 ****** 2020-01-16T05:39:35.133 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-01-16T05:39:35.134 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"cache_update_time": 1579152899, "cache_updated": false, "changed": false} 2020-01-16T05:39:35.175 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:35 +0000 (0:00:00.828) 0:01:01.395 ****** 2020-01-16T05:39:35.191 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1579152942, "cache_updated": false, "changed": false} 2020-01-16T05:39:35.231 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:35 +0000 (0:00:00.056) 0:01:01.451 ****** 2020-01-16T05:39:35.579 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-01-16T05:39:35.580 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-01-16T05:39:35.591 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-01-16T05:39:35.893 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-01-16T05:39:35.907 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-01-16T05:39:36.162 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-01-16T05:39:36.205 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:36 +0000 (0:00:00.973) 0:01:02.425 ****** 2020-01-16T05:39:36.211 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-01-16T05:39:36.260 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:36 +0000 (0:00:00.055) 0:01:02.480 ****** 2020-01-16T05:39:36.327 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-01-16T05:39:36.328 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-01-16T05:39:36.384 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:36 +0000 (0:00:00.123) 0:01:02.603 ****** 2020-01-16T05:39:36.390 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-01-16T05:39:36.433 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:36 +0000 (0:00:00.049) 0:01:02.652 ****** 2020-01-16T05:39:36.693 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-01-16T05:39:36.694 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-01-16T05:39:36.801 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-01-16T05:39:36.989 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-01-16T05:39:37.064 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-01-16T05:39:37.266 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-01-16T05:39:37.308 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:37 +0000 (0:00:00.875) 0:01:03.528 ****** 2020-01-16T05:39:37.336 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-01-16T05:39:37.341 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-01-16T05:39:37.343 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-01-16T05:39:37.382 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:37 +0000 (0:00:00.073) 0:01:03.601 ****** 2020-01-16T05:39:37.428 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:37 +0000 (0:00:00.044) 0:01:03.646 ****** 2020-01-16T05:39:37.431 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-01-16T05:39:37.432 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:37.474 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:37 +0000 (0:00:00.047) 0:01:03.694 ****** 2020-01-16T05:39:37.479 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-01-16T05:39:37.479 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-01-16T05:39:37.522 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:37 +0000 (0:00:00.048) 0:01:03.742 ****** 2020-01-16T05:39:37.527 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-01-16T05:39:37.529 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-16T05:39:37.589 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:37 +0000 (0:00:00.066) 0:01:03.808 ****** 2020-01-16T05:39:37.596 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-01-16T05:39:37.598 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:37.644 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:37 +0000 (0:00:00.053) 0:01:03.862 ****** 2020-01-16T05:39:37.650 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-16T05:39:37.661 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-16T05:39:37.702 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:37 +0000 (0:00:00.060) 0:01:03.922 ****** 2020-01-16T05:39:37.708 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-01-16T05:39:37.709 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-16T05:39:37.751 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:37 +0000 (0:00:00.049) 0:01:03.971 ****** 2020-01-16T05:39:37.756 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-01-16T05:39:37.757 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:37.801 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:37 +0000 (0:00:00.049) 0:01:04.020 ****** 2020-01-16T05:39:37.807 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-01-16T05:39:37.807 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-16T05:39:37.819 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-16T05:39:37.820 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-16T05:39:37.841 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-16T05:39:37.884 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:37 +0000 (0:00:00.083) 0:01:04.104 ****** 2020-01-16T05:39:37.910 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-01-16T05:39:37.912 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:37.950 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:37 +0000 (0:00:00.065) 0:01:04.170 ****** 2020-01-16T05:39:38.649 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2020-01-16T05:39:38.650 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"cache_update_time": 1579152899, "cache_updated": false, "changed": false} 2020-01-16T05:39:38.699 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:38 +0000 (0:00:00.749) 0:01:04.919 ****** 2020-01-16T05:39:38.831 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1579152942, "cache_updated": false, "changed": false} 2020-01-16T05:39:38.875 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:38 +0000 (0:00:00.176) 0:01:05.095 ****** 2020-01-16T05:39:39.006 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-01-16T05:39:39.013 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-01-16T05:39:39.053 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:39 +0000 (0:00:00.177) 0:01:05.272 ****** 2020-01-16T05:39:39.199 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-01-16T05:39:39.243 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:39 +0000 (0:00:00.190) 0:01:05.463 ****** 2020-01-16T05:39:39.363 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-01-16T05:39:39.364 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-01-16T05:39:39.407 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:39 +0000 (0:00:00.163) 0:01:05.627 ****** 2020-01-16T05:39:39.540 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-01-16T05:39:39.579 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:39 +0000 (0:00:00.172) 0:01:05.799 ****** 2020-01-16T05:39:39.584 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-01-16T05:39:39.585 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-16T05:39:39.628 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:39 +0000 (0:00:00.048) 0:01:05.847 ****** 2020-01-16T05:39:39.654 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-01-16T05:39:39.656 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:39.694 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:39 +0000 (0:00:00.066) 0:01:05.914 ****** 2020-01-16T05:39:39.720 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-01-16T05:39:39.720 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-16T05:39:39.760 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:39 +0000 (0:00:00.066) 0:01:05.980 ****** 2020-01-16T05:39:39.764 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-01-16T05:39:39.765 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-16T05:39:39.810 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:39 +0000 (0:00:00.050) 0:01:06.030 ****** 2020-01-16T05:39:39.815 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-01-16T05:39:39.816 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:39.856 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:39 +0000 (0:00:00.045) 0:01:06.076 ****** 2020-01-16T05:39:39.861 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-01-16T05:39:39.861 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:39.902 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:39 +0000 (0:00:00.046) 0:01:06.122 ****** 2020-01-16T05:39:39.929 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi142.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-16T05:39:39.950 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:39 +0000 (0:00:00.047) 0:01:06.170 ****** 2020-01-16T05:39:39.986 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-01-16T05:39:39.987 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:40.033 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:40 +0000 (0:00:00.083) 0:01:06.253 ****** 2020-01-16T05:39:40.228 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-01-16T05:39:40.229 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "9c3d1d79583cf76a6d81bb2ec150bc4af5ca3c5c", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1166, "state": "file", "uid": 0} 2020-01-16T05:39:40.280 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:40 +0000 (0:00:00.246) 0:01:06.499 ****** 2020-01-16T05:39:40.371 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "9c3d1d79583cf76a6d81bb2ec150bc4af5ca3c5c", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1166, "state": "file", "uid": 0} 2020-01-16T05:39:40.426 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:40 +0000 (0:00:00.146) 0:01:06.646 ****** 2020-01-16T05:39:40.903 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-01-16 05:38:10 UTC", "ActiveEnterTimestampMonotonic": "17984536", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target var-run.mount sysinit.target local-fs.target network.target system.slice systemd-journald.socket basic.target nss-lookup.target time-sync.target systemd-tmpfiles-setup.service -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-01-16 05:38:10 UTC", "AssertTimestampMonotonic": "17983415", "Before": "plymouth-quit.service getty@tty1.service xdm.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-01-16 05:38:10 UTC", "ConditionTimestampMonotonic": "17983415", "ConfigurationDirectoryMode": "0755", "Confl 2020-01-16T05:39:40.905 INFO:teuthology.task.ansible.out:icts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1259", "ExecMainStartTimestamp": "Thu 2020-01-16 05:38:10 UTC", "ExecMainStartTimestampMonotonic": "17984499", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Thu 2020-01-16 05:38:10 UTC] ; stop_time=[n/a] ; pid=1259 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-01-16 05:38:10 UTC", "InactiveExitTimestampMonotonic": "17984536", "InvocationID": "fde40bfd5c724f1db1e00c3285eaa90f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "Key 2020-01-16T05:39:40.906 INFO:teuthology.task.ansible.out:ringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1259", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", 2020-01-16T05:39:40.908 INFO:teuthology.task.ansible.out:"RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-01-16 05:38:10 UTC", "StateChangeTimestampMonotonic": "17984536", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-01-16 05:38:10 UTC", "WatchdogTimestampMonotonic": "17984535", "WatchdogUSec": "0"}} ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-01-16 05:38:24 UTC", "ActiveEnterTimestampMonotonic": "17550620", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service nss-lookup.target -.mount local-fs.target remote-fs.ta 2020-01-16T05:39:40.909 INFO:teuthology.task.ansible.out:rget var-run.mount systemd-journald.socket time-sync.target system.slice basic.target network.target sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-01-16 05:38:24 UTC", "AssertTimestampMonotonic": "17549879", "Before": "getty@tty1.service multi-user.target xdm.service plymouth-quit.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-01-16 05:38:24 UTC", "ConditionTimestampMonotonic": "17549879", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1249", "ExecMa 2020-01-16T05:39:40.911 INFO:teuthology.task.ansible.out:inStartTimestamp": "Thu 2020-01-16 05:38:24 UTC", "ExecMainStartTimestampMonotonic": "17550595", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Thu 2020-01-16 05:38:24 UTC] ; stop_time=[n/a] ; pid=1249 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-01-16 05:38:24 UTC", "InactiveExitTimestampMonotonic": "17550620", "InvocationID": "aaebb21d5c844212b1f7281a13de23da", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "Limi 2020-01-16T05:39:40.912 INFO:teuthology.task.ansible.out:tMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1249", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", 2020-01-16T05:39:40.914 INFO:teuthology.task.ansible.out:"StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-01-16 05:38:24 UTC", "StateChangeTimestampMonotonic": "17550620", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-01-16 05:38:24 UTC", "WatchdogTimestampMonotonic": "17550620", "WatchdogUSec": "0"}} 2020-01-16T05:39:40.949 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:40 +0000 (0:00:00.523) 0:01:07.169 ****** 2020-01-16T05:39:40.987 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:40 +0000 (0:00:00.037) 0:01:07.207 ****** 2020-01-16T05:39:40.992 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-01-16T05:39:40.993 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.033 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.045) 0:01:07.253 ****** 2020-01-16T05:39:41.038 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.081 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.048) 0:01:07.301 ****** 2020-01-16T05:39:41.088 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-01-16T05:39:41.088 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.143 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.061) 0:01:07.363 ****** 2020-01-16T05:39:41.149 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.192 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.046) 0:01:07.409 ****** 2020-01-16T05:39:41.194 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-01-16T05:39:41.195 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.246 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.056) 0:01:07.465 ****** 2020-01-16T05:39:41.251 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.303 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.057) 0:01:07.523 ****** 2020-01-16T05:39:41.308 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-01-16T05:39:41.308 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.350 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.046) 0:01:07.569 ****** 2020-01-16T05:39:41.355 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.397 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.047) 0:01:07.617 ****** 2020-01-16T05:39:41.401 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-01-16T05:39:41.403 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.443 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.045) 0:01:07.662 ****** 2020-01-16T05:39:41.448 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.490 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.047) 0:01:07.710 ****** 2020-01-16T05:39:41.496 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-01-16T05:39:41.497 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.539 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.048) 0:01:07.759 ****** 2020-01-16T05:39:41.545 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.594 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.050) 0:01:07.809 ****** 2020-01-16T05:39:41.595 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-01-16T05:39:41.597 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.638 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.048) 0:01:07.858 ****** 2020-01-16T05:39:41.646 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.691 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.053) 0:01:07.911 ****** 2020-01-16T05:39:41.696 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-01-16T05:39:41.698 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.738 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.046) 0:01:07.957 ****** 2020-01-16T05:39:41.743 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.786 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.048) 0:01:08.005 ****** 2020-01-16T05:39:41.790 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-01-16T05:39:41.792 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.832 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.046) 0:01:08.052 ****** 2020-01-16T05:39:41.837 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.880 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.047) 0:01:08.100 ****** 2020-01-16T05:39:41.885 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-01-16T05:39:41.885 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.927 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.047) 0:01:08.147 ****** 2020-01-16T05:39:41.933 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:41.976 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:41 +0000 (0:00:00.048) 0:01:08.196 ****** 2020-01-16T05:39:41.982 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-01-16T05:39:41.983 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-01-16T05:39:42.023 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:42 +0000 (0:00:00.046) 0:01:08.243 ****** 2020-01-16T05:39:42.028 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-01-16T05:39:42.070 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:42 +0000 (0:00:00.047) 0:01:08.290 ****** 2020-01-16T05:39:42.075 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-01-16T05:39:42.076 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-virtualenv", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "python-configobj", "python-gevent", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "btrfs-tools", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "python-nose", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "python-numpy", "python-matplotlib", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-01-16T05:39:42.120 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:42 +0000 (0:00:00.049) 0:01:08.339 ****** 2020-01-16T05:39:42.125 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-virtualenv", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "python-configobj", "python-gevent", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "btrfs-tools", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "python-nose", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "python-numpy", "python-matplotlib", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-01-16T05:39:42.168 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:42 +0000 (0:00:00.048) 0:01:08.388 ****** 2020-01-16T05:39:42.172 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-01-16T05:39:42.173 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-01-16T05:39:42.215 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:42 +0000 (0:00:00.046) 0:01:08.434 ****** 2020-01-16T05:39:42.220 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-01-16T05:39:42.271 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:42 +0000 (0:00:00.056) 0:01:08.491 ****** 2020-01-16T05:39:42.277 INFO:teuthology.task.ansible.out: 2020-01-16T05:39:42.278 INFO:teuthology.task.ansible.out:TASK [testnode : Including version specific variables.] ************************ 2020-01-16T05:39:42.279 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-01-16T05:39:42.346 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:42 +0000 (0:00:00.075) 0:01:08.566 ****** 2020-01-16T05:39:42.352 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-01-16T05:39:42.395 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:42 +0000 (0:00:00.048) 0:01:08.614 ****** 2020-01-16T05:39:42.473 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-01-16T05:39:42.475 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-01-16T05:39:42.522 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:42 +0000 (0:00:00.127) 0:01:08.742 ****** 2020-01-16T05:39:42.530 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-01-16T05:39:42.569 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:42 +0000 (0:00:00.046) 0:01:08.789 ****** 2020-01-16T05:39:42.656 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-01-16T05:39:42.658 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "name": "ubuntu", "state": "present", "system": false} 2020-01-16T05:39:42.708 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:42 +0000 (0:00:00.139) 0:01:08.928 ****** 2020-01-16T05:39:42.713 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "name": "ubuntu", "state": "present", "system": false} 2020-01-16T05:39:42.755 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:42 +0000 (0:00:00.046) 0:01:08.974 ****** 2020-01-16T05:39:42.760 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-01-16T05:39:42.763 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:42.802 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:42 +0000 (0:00:00.047) 0:01:09.022 ****** 2020-01-16T05:39:42.810 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:42.852 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:42 +0000 (0:00:00.049) 0:01:09.072 ****** 2020-01-16T05:39:42.857 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-01-16T05:39:42.858 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:42.904 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:42 +0000 (0:00:00.051) 0:01:09.124 ****** 2020-01-16T05:39:42.910 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:42.949 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:42 +0000 (0:00:00.044) 0:01:09.169 ****** 2020-01-16T05:39:43.058 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-01-16T05:39:43.059 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-01-16T05:39:43.102 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:43 +0000 (0:00:00.152) 0:01:09.321 ****** 2020-01-16T05:39:43.107 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-01-16T05:39:43.155 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:43 +0000 (0:00:00.045) 0:01:09.367 ****** 2020-01-16T05:39:43.495 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-01-16T05:39:43.496 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-01-16T05:39:43.536 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:43 +0000 (0:00:00.389) 0:01:09.756 ****** 2020-01-16T05:39:43.553 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-01-16T05:39:43.591 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:43 +0000 (0:00:00.054) 0:01:09.810 ****** 2020-01-16T05:39:43.596 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-01-16T05:39:43.596 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi084"}, "changed": false} 2020-01-16T05:39:43.637 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:43 +0000 (0:00:00.046) 0:01:09.857 ****** 2020-01-16T05:39:43.644 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi142"}, "changed": false} 2020-01-16T05:39:43.684 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:43 +0000 (0:00:00.046) 0:01:09.903 ****** 2020-01-16T05:39:44.575 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-01-16T05:39:44.578 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi084.front.sepia.ceph.com", "ansible_hostname": "smithi084", "ansible_nodename": "smithi084"}, "changed": true, "name": "smithi084"} 2020-01-16T05:39:44.624 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:44 +0000 (0:00:00.940) 0:01:10.844 ****** 2020-01-16T05:39:44.638 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi142.front.sepia.ceph.com", "ansible_hostname": "smithi142", "ansible_nodename": "smithi142"}, "changed": true, "name": "smithi142"} 2020-01-16T05:39:44.685 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:44 +0000 (0:00:00.061) 0:01:10.905 ****** 2020-01-16T05:39:44.939 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-01-16T05:39:44.940 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-01-16T05:39:44.984 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:44 +0000 (0:00:00.298) 0:01:11.203 ****** 2020-01-16T05:39:45.000 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-01-16T05:39:45.058 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:45 +0000 (0:00:00.074) 0:01:11.278 ****** 2020-01-16T05:39:45.384 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-01-16T05:39:45.385 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-01-16T05:39:45.429 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:45 +0000 (0:00:00.370) 0:01:11.648 ****** 2020-01-16T05:39:45.490 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-01-16T05:39:45.533 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:45 +0000 (0:00:00.104) 0:01:11.753 ****** 2020-01-16T05:39:46.023 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-01-16T05:39:46.023 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-01-16T05:39:46.068 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.534) 0:01:12.288 ****** 2020-01-16T05:39:46.074 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-01-16T05:39:46.120 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.051) 0:01:12.339 ****** 2020-01-16T05:39:46.124 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-01-16T05:39:46.125 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:46.168 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.048) 0:01:12.388 ****** 2020-01-16T05:39:46.175 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:46.218 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.049) 0:01:12.438 ****** 2020-01-16T05:39:46.223 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-01-16T05:39:46.224 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:46.276 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.057) 0:01:12.496 ****** 2020-01-16T05:39:46.282 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:46.328 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.051) 0:01:12.547 ****** 2020-01-16T05:39:46.332 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-01-16T05:39:46.332 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:46.376 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.048) 0:01:12.596 ****** 2020-01-16T05:39:46.382 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:46.425 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.048) 0:01:12.645 ****** 2020-01-16T05:39:46.430 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-01-16T05:39:46.432 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:46.472 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.046) 0:01:12.692 ****** 2020-01-16T05:39:46.478 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:46.522 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.049) 0:01:12.741 ****** 2020-01-16T05:39:46.527 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-01-16T05:39:46.528 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:46.570 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.048) 0:01:12.790 ****** 2020-01-16T05:39:46.576 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:46.624 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.053) 0:01:12.844 ****** 2020-01-16T05:39:46.629 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-01-16T05:39:46.630 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:46.676 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.051) 0:01:12.895 ****** 2020-01-16T05:39:46.681 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:46.722 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.046) 0:01:12.942 ****** 2020-01-16T05:39:46.727 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-01-16T05:39:46.728 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:46.770 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.047) 0:01:12.989 ****** 2020-01-16T05:39:46.775 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:46.820 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.050) 0:01:13.040 ****** 2020-01-16T05:39:46.825 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-01-16T05:39:46.866 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.045) 0:01:13.086 ****** 2020-01-16T05:39:46.912 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.045) 0:01:13.132 ****** 2020-01-16T05:39:46.917 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-01-16T05:39:46.958 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.045) 0:01:13.177 ****** 2020-01-16T05:39:47.004 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:46 +0000 (0:00:00.045) 0:01:13.223 ****** 2020-01-16T05:39:47.008 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-01-16T05:39:47.050 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.046) 0:01:13.270 ****** 2020-01-16T05:39:47.095 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.045) 0:01:13.315 ****** 2020-01-16T05:39:47.100 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-01-16T05:39:47.101 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.143 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.047) 0:01:13.362 ****** 2020-01-16T05:39:47.148 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.193 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.050) 0:01:13.412 ****** 2020-01-16T05:39:47.198 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-01-16T05:39:47.199 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.249 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.055) 0:01:13.468 ****** 2020-01-16T05:39:47.254 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.254 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.294 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.045) 0:01:13.514 ****** 2020-01-16T05:39:47.299 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.341 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.047) 0:01:13.561 ****** 2020-01-16T05:39:47.346 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.387 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.045) 0:01:13.606 ****** 2020-01-16T05:39:47.391 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-16T05:39:47.392 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.442 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.055) 0:01:13.662 ****** 2020-01-16T05:39:47.448 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.489 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.046) 0:01:13.708 ****** 2020-01-16T05:39:47.493 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-01-16T05:39:47.495 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.536 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.047) 0:01:13.756 ****** 2020-01-16T05:39:47.542 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.582 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.046) 0:01:13.802 ****** 2020-01-16T05:39:47.589 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.631 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.048) 0:01:13.851 ****** 2020-01-16T05:39:47.637 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.678 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.045) 0:01:13.897 ****** 2020-01-16T05:39:47.682 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-01-16T05:39:47.682 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.729 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.051) 0:01:13.948 ****** 2020-01-16T05:39:47.734 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.774 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.045) 0:01:13.994 ****** 2020-01-16T05:39:47.779 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-01-16T05:39:47.780 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.823 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.048) 0:01:14.042 ****** 2020-01-16T05:39:47.829 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.868 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.045) 0:01:14.088 ****** 2020-01-16T05:39:47.873 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-01-16T05:39:47.873 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.917 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.047) 0:01:14.135 ****** 2020-01-16T05:39:47.921 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:47.962 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:47 +0000 (0:00:00.046) 0:01:14.182 ****** 2020-01-16T05:39:47.967 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:48.010 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.047) 0:01:14.229 ****** 2020-01-16T05:39:48.015 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:48.056 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.046) 0:01:14.275 ****** 2020-01-16T05:39:48.060 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-01-16T05:39:48.062 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:48.102 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.046) 0:01:14.322 ****** 2020-01-16T05:39:48.108 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:48.149 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.046) 0:01:14.368 ****** 2020-01-16T05:39:48.153 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-01-16T05:39:48.156 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:48.195 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.046) 0:01:14.415 ****** 2020-01-16T05:39:48.201 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:48.242 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.046) 0:01:14.461 ****** 2020-01-16T05:39:48.246 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-01-16T05:39:48.248 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:48.288 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.045) 0:01:14.507 ****** 2020-01-16T05:39:48.293 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:48.335 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.047) 0:01:14.555 ****** 2020-01-16T05:39:48.341 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-01-16T05:39:48.341 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:48.388 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.053) 0:01:14.608 ****** 2020-01-16T05:39:48.394 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:48.435 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.047) 0:01:14.655 ****** 2020-01-16T05:39:48.440 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-01-16T05:39:48.441 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:48.481 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.045) 0:01:14.700 ****** 2020-01-16T05:39:48.487 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:48.528 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.047) 0:01:14.748 ****** 2020-01-16T05:39:48.534 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-01-16T05:39:48.534 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:48.588 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.059) 0:01:14.807 ****** 2020-01-16T05:39:48.594 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:48.664 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.075) 0:01:14.883 ****** 2020-01-16T05:39:48.670 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-01-16T05:39:48.671 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:48.714 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.050) 0:01:14.934 ****** 2020-01-16T05:39:48.726 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:48.761 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.047) 0:01:14.981 ****** 2020-01-16T05:39:48.840 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-01-16T05:39:48.841 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.004833", "end": "2020-01-16 05:39:48.581383", "rc": 0, "start": "2020-01-16 05:39:48.576550", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:39:48.880 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.118) 0:01:15.100 ****** 2020-01-16T05:39:48.897 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005209", "end": "2020-01-16 05:39:48.827183", "rc": 0, "start": "2020-01-16 05:39:48.821974", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:39:48.898 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-01-16T05:39:48.938 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.058) 0:01:15.158 ****** 2020-01-16T05:39:48.975 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:48 +0000 (0:00:00.036) 0:01:15.195 ****** 2020-01-16T05:39:49.041 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:49 +0000 (0:00:00.065) 0:01:15.261 ****** 2020-01-16T05:39:49.255 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-01-16T05:39:49.256 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-01-16T05:39:49.297 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:49 +0000 (0:00:00.255) 0:01:15.516 ****** 2020-01-16T05:39:49.336 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-01-16T05:39:49.338 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:49.380 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:49 +0000 (0:00:00.084) 0:01:15.600 ****** 2020-01-16T05:39:49.387 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-01-16T05:39:49.387 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-01-16T05:39:49.428 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:49 +0000 (0:00:00.047) 0:01:15.648 ****** 2020-01-16T05:39:49.455 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-01-16T05:39:49.456 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:39:49.495 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:49 +0000 (0:00:00.066) 0:01:15.715 ****** 2020-01-16T05:39:50.687 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-01-16T05:39:50.688 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-01-16T05:39:50.937 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-01-16T05:39:51.617 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-01-16T05:39:51.659 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:51 +0000 (0:00:02.164) 0:01:17.879 ****** 2020-01-16T05:39:51.843 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-01-16T05:39:51.901 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:51 +0000 (0:00:00.241) 0:01:18.120 ****** 2020-01-16T05:39:52.552 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-01-16T05:39:52.554 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1579152942, "cache_updated": false, "changed": false} 2020-01-16T05:39:52.625 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:52 +0000 (0:00:00.724) 0:01:18.845 ****** 2020-01-16T05:39:52.652 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-01-16T05:39:52.697 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:52 +0000 (0:00:00.067) 0:01:18.913 ****** 2020-01-16T05:39:52.782 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-01-16T05:39:52.784 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"cache_update_time": 1579152899, "cache_updated": false, "changed": false} 2020-01-16T05:39:52.823 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:52 +0000 (0:00:00.130) 0:01:19.043 ****** 2020-01-16T05:39:52.849 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-01-16T05:39:52.888 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:52 +0000 (0:00:00.064) 0:01:19.107 ****** 2020-01-16T05:39:52.893 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-01-16T05:39:52.894 INFO:teuthology.task.ansible.out: [WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.031662", "end": "2020-01-16 05:39:52.785793", "rc": 0, "start": "2020-01-16 05:39:52.754131", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:39:52.935 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:52 +0000 (0:00:00.047) 0:01:19.155 ****** 2020-01-16T05:39:53.056 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.034824", "end": "2020-01-16 05:39:52.792229", "rc": 0, "start": "2020-01-16 05:39:52.757405", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:39:53.095 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:53 +0000 (0:00:00.159) 0:01:19.315 ****** 2020-01-16T05:39:55.648 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-01-16T05:39:55.649 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1579152942, "cache_updated": false, "changed": false} 2020-01-16T05:39:55.688 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:55 +0000 (0:00:02.593) 0:01:21.908 ****** 2020-01-16T05:39:55.767 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"cache_update_time": 1579152899, "cache_updated": false, "changed": false} 2020-01-16T05:39:55.808 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:39:55 +0000 (0:00:00.119) 0:01:22.028 ****** 2020-01-16T05:40:06.058 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-01-16T05:40:06.059 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 28 not upgraded.\nAfter this operation, 47.5 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137378 files and directorie 2020-01-16T05:40:06.061 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nRemoving librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 28 not upgraded.", "After this operation, 47.5 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readin 2020-01-16T05:40:06.062 INFO:teuthology.task.ansible.out:g database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137378 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Removing librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-01-16T05:40:06.099 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:06 +0000 (0:00:10.291) 0:01:32.319 ****** 2020-01-16T05:40:06.139 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 28 not upgraded.\nAfter this operation, 47.5 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137378 files and directorie 2020-01-16T05:40:06.141 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nRemoving librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 28 not upgraded.", "After this operation, 47.5 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readin 2020-01-16T05:40:06.142 INFO:teuthology.task.ansible.out:g database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137378 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Removing librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-01-16T05:40:06.183 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:06 +0000 (0:00:00.083) 0:01:32.402 ****** 2020-01-16T05:40:06.957 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-01-16T05:40:06.958 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1579152942, "cache_updated": false, "changed": false} 2020-01-16T05:40:06.999 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:06 +0000 (0:00:00.816) 0:01:33.219 ****** 2020-01-16T05:40:07.031 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-01-16T05:40:07.032 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:07.083 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:07 +0000 (0:00:00.083) 0:01:33.302 ****** 2020-01-16T05:40:07.088 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-01-16T05:40:07.089 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"cache_update_time": 1579152899, "cache_updated": false, "changed": false} 2020-01-16T05:40:07.131 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:07 +0000 (0:00:00.047) 0:01:33.350 ****** 2020-01-16T05:40:07.157 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-01-16T05:40:07.159 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:07.200 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:07 +0000 (0:00:00.069) 0:01:33.420 ****** 2020-01-16T05:40:16.976 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-01-16T05:40:16.978 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1579152942, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.5).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n python-nose-doc samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 python3-nose qemu-block-extra qemu-system-common\n qemu-system-x86 qemu-utils\n0 upgraded, 7 newly installed, 0 to remove and 28 not upgraded.\nNeed to get 10.5 MB of archives.\nAfter this operation, 48.1 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.3 [2702 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.3 [920 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-nose all 1.3.7-3 [115 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]\nGet:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]\nFetched 10.5 MB in 1s (9977 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Re 2020-01-16T05:40:16.979 INFO:teuthology.task.ansible.out:ading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137236 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.3_amd64.deb ...\r\nUnpacking librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.3_amd64.deb ...\r\nUnpacking librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package python3-nose.\r\nPreparing to unpack .../4-python3-nose_1.3.7-3_all.deb ...\r\nUnpacking python3-nose (1.3.7-3) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nSetting up python3-nose (1.3.7-3) ...\r\nSetting up librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nSetting up qemu-block- 2020-01-16T05:40:16.981 INFO:teuthology.task.ansible.out:extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.5).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " python-nose-doc samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 python3-nose qemu-block-extra qemu-system-common", " qemu-system-x86 qemu-utils", "0 upgraded, 7 newly installed, 0 to remove and 28 not upgraded.", "Need to get 10.5 MB of archives.", "After this operation, 48.1 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.3 [2702 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.3 [920 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-nose all 1.3.7-3 [115 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]", "Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]", "Fetched 10.5 MB in 1s (9977 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading databa 2020-01-16T05:40:16.982 INFO:teuthology.task.ansible.out:se ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137236 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.3_amd64.deb ...", "Unpacking librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.3_amd64.deb ...", "Unpacking librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package python3-nose.", "Preparing to unpack .../4-python3-nose_1.3.7-3_all.deb ...", "Unpacking python3-nose (1.3.7-3) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Setting 2020-01-16T05:40:16.983 INFO:teuthology.task.ansible.out:up python3-nose (1.3.7-3) ...", "Setting up librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-01-16T05:40:17.025 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:17 +0000 (0:00:09.825) 0:01:43.245 ****** 2020-01-16T05:40:17.138 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"cache_update_time": 1579152899, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.5).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n python-nose-doc samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 python3-nose qemu-block-extra qemu-system-common\n qemu-system-x86 qemu-utils\n0 upgraded, 7 newly installed, 0 to remove and 28 not upgraded.\nNeed to get 10.5 MB of archives.\nAfter this operation, 48.1 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.3 [2702 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.3 [920 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-nose all 1.3.7-3 [115 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]\nGet:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]\nFetched 10.5 MB in 1s (9242 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Re 2020-01-16T05:40:17.140 INFO:teuthology.task.ansible.out:ading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137236 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.3_amd64.deb ...\r\nUnpacking librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.3_amd64.deb ...\r\nUnpacking librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package python3-nose.\r\nPreparing to unpack .../4-python3-nose_1.3.7-3_all.deb ...\r\nUnpacking python3-nose (1.3.7-3) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nSetting up python3-nose (1.3.7-3) ...\r\nSetting up librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nSetting up qemu-block- 2020-01-16T05:40:17.142 INFO:teuthology.task.ansible.out:extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.5).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " python-nose-doc samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 python3-nose qemu-block-extra qemu-system-common", " qemu-system-x86 qemu-utils", "0 upgraded, 7 newly installed, 0 to remove and 28 not upgraded.", "Need to get 10.5 MB of archives.", "After this operation, 48.1 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.3 [2702 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.3 [920 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-nose all 1.3.7-3 [115 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]", "Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]", "Fetched 10.5 MB in 1s (9242 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading databa 2020-01-16T05:40:17.143 INFO:teuthology.task.ansible.out:se ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137236 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.3_amd64.deb ...", "Unpacking librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.3_amd64.deb ...", "Unpacking librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package python3-nose.", "Preparing to unpack .../4-python3-nose_1.3.7-3_all.deb ...", "Unpacking python3-nose (1.3.7-3) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Setting 2020-01-16T05:40:17.145 INFO:teuthology.task.ansible.out:up python3-nose (1.3.7-3) ...", "Setting up librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-01-16T05:40:17.183 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:17 +0000 (0:00:00.157) 0:01:43.402 ****** 2020-01-16T05:40:17.895 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-01-16T05:40:17.897 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1579152942, "cache_updated": false, "changed": false} 2020-01-16T05:40:17.939 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:17 +0000 (0:00:00.756) 0:01:44.159 ****** 2020-01-16T05:40:18.029 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"cache_update_time": 1579152899, "cache_updated": false, "changed": false} 2020-01-16T05:40:18.088 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:18 +0000 (0:00:00.147) 0:01:44.307 ****** 2020-01-16T05:40:18.093 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-01-16T05:40:18.094 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-01-16T05:40:18.140 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:18 +0000 (0:00:00.052) 0:01:44.360 ****** 2020-01-16T05:40:18.166 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-01-16T05:40:18.168 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:18.208 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:18 +0000 (0:00:00.067) 0:01:44.427 ****** 2020-01-16T05:40:18.224 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-01-16T05:40:18.225 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-01-16T05:40:18.265 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:18 +0000 (0:00:00.057) 0:01:44.485 ****** 2020-01-16T05:40:18.297 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:18.339 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:18 +0000 (0:00:00.074) 0:01:44.559 ****** 2020-01-16T05:40:18.345 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-01-16T05:40:18.346 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-01-16T05:40:18.388 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:18 +0000 (0:00:00.048) 0:01:44.608 ****** 2020-01-16T05:40:18.467 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-01-16T05:40:18.509 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:18 +0000 (0:00:00.120) 0:01:44.728 ****** 2020-01-16T05:40:18.722 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-01-16T05:40:18.723 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-01-16T05:40:18.766 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:18 +0000 (0:00:00.257) 0:01:44.986 ****** 2020-01-16T05:40:18.856 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-01-16T05:40:18.898 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:18 +0000 (0:00:00.131) 0:01:45.118 ****** 2020-01-16T05:40:18.925 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-01-16T05:40:18.925 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1205, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-01-16T05:40:18.967 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:18 +0000 (0:00:00.068) 0:01:45.187 ****** 2020-01-16T05:40:19.057 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1205, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-01-16T05:40:19.101 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:19 +0000 (0:00:00.134) 0:01:45.321 ****** 2020-01-16T05:40:19.107 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-01-16T05:40:19.107 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-16T05:40:19.154 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:19 +0000 (0:00:00.052) 0:01:45.373 ****** 2020-01-16T05:40:19.233 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-16T05:40:19.275 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:19 +0000 (0:00:00.121) 0:01:45.494 ****** 2020-01-16T05:40:19.470 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-01-16T05:40:19.472 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Thu 2020-01-16 05:38:11 UTC", "ActiveEnterTimestampMonotonic": "18530474", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target systemd-journald.socket sysinit.target remote-fs.target system.slice nss-lookup.target -.mount systemd-tmpfiles-setup.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-01-16 05:38:10 UTC", "AssertTimestampMonotonic": "17981735", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-01-16 05:38:10 UTC", "ConditionTimestampMonotonic": "17981735", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-01-16T05:40:19.473 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1331", "ExecMainStartTimestamp": "Thu 2020-01-16 05:38:11 UTC", "ExecMainStartTimestampMonotonic": "18530463", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-01-16 05:38:10 UTC", "InactiveExitTimestampMonotonic": "17982412", "InvocationID": "a3c4a25e3d5c443794852bd0d85c8bd0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-01-16T05:40:19.475 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1331", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": 2020-01-16T05:40:19.476 INFO:teuthology.task.ansible.out: "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-01-16 05:38:11 UTC", "StateChangeTimestampMonotonic": "18530474", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-01-16 05:38:11 UTC", "WatchdogTimestampMonotonic": "18530473", "WatchdogUSec": "0"}} 2020-01-16T05:40:19.513 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:19 +0000 (0:00:00.238) 0:01:45.733 ****** 2020-01-16T05:40:19.540 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-01-16T05:40:19.541 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:19.584 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:19 +0000 (0:00:00.070) 0:01:45.804 ****** 2020-01-16T05:40:19.590 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-01-16T05:40:19.593 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Thu 2020-01-16 05:38:24 UTC", "ActiveEnterTimestampMonotonic": "18154923", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target -.mount systemd-journald.socket network.target sysinit.target basic.target system.slice systemd-tmpfiles-setup.service remote-fs.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-01-16 05:38:24 UTC", "AssertTimestampMonotonic": "17551341", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-01-16 05:38:24 UTC", "ConditionTimestampMonotonic": "17551341", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-01-16T05:40:19.594 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1476", "ExecMainStartTimestamp": "Thu 2020-01-16 05:38:24 UTC", "ExecMainStartTimestampMonotonic": "18154913", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-01-16 05:38:24 UTC", "InactiveExitTimestampMonotonic": "17552103", "InvocationID": "0038dc28e21c4e3999b3c7ae262c6311", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-01-16T05:40:19.596 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1476", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": 2020-01-16T05:40:19.597 INFO:teuthology.task.ansible.out: "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-01-16 05:38:24 UTC", "StateChangeTimestampMonotonic": "18154923", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-01-16 05:38:24 UTC", "WatchdogTimestampMonotonic": "18154923", "WatchdogUSec": "0"}} 2020-01-16T05:40:19.637 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:19 +0000 (0:00:00.052) 0:01:45.857 ****** 2020-01-16T05:40:19.644 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-01-16T05:40:19.650 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:19.689 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:19 +0000 (0:00:00.048) 0:01:45.905 ****** 2020-01-16T05:40:19.691 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-01-16T05:40:19.693 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:19.735 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:19 +0000 (0:00:00.048) 0:01:45.954 ****** 2020-01-16T05:40:19.740 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-01-16T05:40:19.741 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:19.790 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:19 +0000 (0:00:00.055) 0:01:46.010 ****** 2020-01-16T05:40:19.797 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-01-16T05:40:19.798 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:19.851 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:19 +0000 (0:00:00.061) 0:01:46.071 ****** 2020-01-16T05:40:19.861 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:19.898 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:19 +0000 (0:00:00.046) 0:01:46.118 ****** 2020-01-16T05:40:19.903 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-01-16T05:40:19.905 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:19.943 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:19 +0000 (0:00:00.045) 0:01:46.163 ****** 2020-01-16T05:40:19.948 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-01-16T05:40:19.949 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:19.990 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:19 +0000 (0:00:00.046) 0:01:46.210 ****** 2020-01-16T05:40:19.995 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-01-16T05:40:19.995 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.038 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.048) 0:01:46.258 ****** 2020-01-16T05:40:20.043 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-01-16T05:40:20.045 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.087 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.048) 0:01:46.307 ****** 2020-01-16T05:40:20.098 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.136 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.048) 0:01:46.356 ****** 2020-01-16T05:40:20.141 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-01-16T05:40:20.142 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.183 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.046) 0:01:46.402 ****** 2020-01-16T05:40:20.187 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-01-16T05:40:20.188 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.228 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.044) 0:01:46.447 ****** 2020-01-16T05:40:20.232 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-01-16T05:40:20.233 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.274 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.046) 0:01:46.494 ****** 2020-01-16T05:40:20.279 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-01-16T05:40:20.281 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.319 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.044) 0:01:46.539 ****** 2020-01-16T05:40:20.324 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-01-16T05:40:20.325 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.364 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.045) 0:01:46.584 ****** 2020-01-16T05:40:20.370 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-01-16T05:40:20.370 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.410 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.045) 0:01:46.629 ****** 2020-01-16T05:40:20.414 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-01-16T05:40:20.416 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.455 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.045) 0:01:46.674 ****** 2020-01-16T05:40:20.460 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-01-16T05:40:20.460 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.500 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.045) 0:01:46.720 ****** 2020-01-16T05:40:20.505 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-01-16T05:40:20.507 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.546 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.045) 0:01:46.765 ****** 2020-01-16T05:40:20.551 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-01-16T05:40:20.552 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.591 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.045) 0:01:46.811 ****** 2020-01-16T05:40:20.596 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-01-16T05:40:20.597 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.643 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.052) 0:01:46.863 ****** 2020-01-16T05:40:20.648 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-01-16T05:40:20.649 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.690 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.046) 0:01:46.910 ****** 2020-01-16T05:40:20.695 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-01-16T05:40:20.696 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.736 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.046) 0:01:46.956 ****** 2020-01-16T05:40:20.742 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-01-16T05:40:20.743 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.783 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.047) 0:01:47.003 ****** 2020-01-16T05:40:20.788 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-01-16T05:40:20.790 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.830 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.046) 0:01:47.049 ****** 2020-01-16T05:40:20.835 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-01-16T05:40:20.836 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.876 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.046) 0:01:47.096 ****** 2020-01-16T05:40:20.881 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-01-16T05:40:20.883 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.923 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.046) 0:01:47.142 ****** 2020-01-16T05:40:20.927 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-01-16T05:40:20.928 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:20.969 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:20 +0000 (0:00:00.045) 0:01:47.188 ****** 2020-01-16T05:40:20.979 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.016 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.047) 0:01:47.236 ****** 2020-01-16T05:40:21.021 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-01-16T05:40:21.023 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.065 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.048) 0:01:47.284 ****** 2020-01-16T05:40:21.070 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-01-16T05:40:21.070 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.113 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.048) 0:01:47.332 ****** 2020-01-16T05:40:21.118 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-01-16T05:40:21.119 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.161 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.047) 0:01:47.380 ****** 2020-01-16T05:40:21.166 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-01-16T05:40:21.167 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.211 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.049) 0:01:47.430 ****** 2020-01-16T05:40:21.215 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-01-16T05:40:21.216 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.257 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.046) 0:01:47.476 ****** 2020-01-16T05:40:21.262 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-01-16T05:40:21.264 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.304 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.046) 0:01:47.523 ****** 2020-01-16T05:40:21.308 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-01-16T05:40:21.309 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.349 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.045) 0:01:47.568 ****** 2020-01-16T05:40:21.354 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.395 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.045) 0:01:47.614 ****** 2020-01-16T05:40:21.400 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-01-16T05:40:21.400 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.442 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.046) 0:01:47.661 ****** 2020-01-16T05:40:21.447 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-01-16T05:40:21.448 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.490 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.048) 0:01:47.709 ****** 2020-01-16T05:40:21.495 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-01-16T05:40:21.496 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.535 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.045) 0:01:47.754 ****** 2020-01-16T05:40:21.540 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-01-16T05:40:21.542 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.582 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.047) 0:01:47.802 ****** 2020-01-16T05:40:21.587 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-01-16T05:40:21.589 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.628 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.045) 0:01:47.848 ****** 2020-01-16T05:40:21.633 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-01-16T05:40:21.635 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.676 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.047) 0:01:47.895 ****** 2020-01-16T05:40:21.681 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-01-16T05:40:21.682 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.721 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.045) 0:01:47.941 ****** 2020-01-16T05:40:21.726 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-01-16T05:40:21.727 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.775 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.053) 0:01:47.994 ****** 2020-01-16T05:40:21.779 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-01-16T05:40:21.781 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.821 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.046) 0:01:48.040 ****** 2020-01-16T05:40:21.826 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-01-16T05:40:21.826 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.868 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.046) 0:01:48.087 ****** 2020-01-16T05:40:21.872 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-01-16T05:40:21.873 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.913 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.045) 0:01:48.133 ****** 2020-01-16T05:40:21.949 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:21.989 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:21 +0000 (0:00:00.075) 0:01:48.209 ****** 2020-01-16T05:40:22.006 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-01-16T05:40:22.007 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-01-16T05:40:22.052 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:22 +0000 (0:00:00.062) 0:01:48.271 ****** 2020-01-16T05:40:22.122 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-01-16T05:40:22.163 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:22 +0000 (0:00:00.111) 0:01:48.383 ****** 2020-01-16T05:40:22.378 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-01-16T05:40:22.379 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-01-16T05:40:22.420 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:22 +0000 (0:00:00.256) 0:01:48.639 ****** 2020-01-16T05:40:22.446 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-01-16T05:40:22.448 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:22.487 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:22 +0000 (0:00:00.067) 0:01:48.707 ****** 2020-01-16T05:40:22.492 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-01-16T05:40:22.493 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-01-16T05:40:22.535 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:22 +0000 (0:00:00.048) 0:01:48.755 ****** 2020-01-16T05:40:22.562 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-01-16T05:40:22.564 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:22.606 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:22 +0000 (0:00:00.071) 0:01:48.826 ****** 2020-01-16T05:40:22.799 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-01-16T05:40:22.800 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-01-16T05:40:22.842 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:22 +0000 (0:00:00.235) 0:01:49.062 ****** 2020-01-16T05:40:22.932 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-01-16T05:40:22.973 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:22 +0000 (0:00:00.131) 0:01:49.193 ****** 2020-01-16T05:40:23.166 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-01-16T05:40:23.167 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-01-16T05:40:23.211 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:23 +0000 (0:00:00.237) 0:01:49.431 ****** 2020-01-16T05:40:23.302 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-01-16T05:40:23.342 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:23 +0000 (0:00:00.130) 0:01:49.562 ****** 2020-01-16T05:40:23.526 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-01-16T05:40:23.527 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-01-16T05:40:23.567 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:23 +0000 (0:00:00.224) 0:01:49.786 ****** 2020-01-16T05:40:23.671 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-01-16T05:40:23.711 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:23 +0000 (0:00:00.143) 0:01:49.930 ****** 2020-01-16T05:40:23.715 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-01-16T05:40:23.716 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-16T05:40:23.757 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:23 +0000 (0:00:00.046) 0:01:49.976 ****** 2020-01-16T05:40:23.783 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-01-16T05:40:23.784 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:23.822 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:23 +0000 (0:00:00.065) 0:01:50.042 ****** 2020-01-16T05:40:23.837 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-01-16T05:40:23.838 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-16T05:40:23.879 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:23 +0000 (0:00:00.057) 0:01:50.099 ****** 2020-01-16T05:40:23.892 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:23.923 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:23 +0000 (0:00:00.044) 0:01:50.143 ****** 2020-01-16T05:40:23.928 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-01-16T05:40:23.928 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:23.968 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:23 +0000 (0:00:00.044) 0:01:50.187 ****** 2020-01-16T05:40:23.973 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-01-16T05:40:23.975 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.013 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:24 +0000 (0:00:00.045) 0:01:50.233 ****** 2020-01-16T05:40:24.018 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-01-16T05:40:24.019 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.065 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:24 +0000 (0:00:00.051) 0:01:50.284 ****** 2020-01-16T05:40:24.070 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-01-16T05:40:24.072 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.114 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:24 +0000 (0:00:00.048) 0:01:50.333 ****** 2020-01-16T05:40:24.118 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-01-16T05:40:24.120 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.160 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:24 +0000 (0:00:00.045) 0:01:50.379 ****** 2020-01-16T05:40:24.171 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.206 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:24 +0000 (0:00:00.045) 0:01:50.425 ****** 2020-01-16T05:40:24.210 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-01-16T05:40:24.211 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.254 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:24 +0000 (0:00:00.046) 0:01:50.472 ****** 2020-01-16T05:40:24.260 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-01-16T05:40:24.298 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:24 +0000 (0:00:00.046) 0:01:50.518 ****** 2020-01-16T05:40:24.302 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-01-16T05:40:24.304 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.344 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:24 +0000 (0:00:00.045) 0:01:50.564 ****** 2020-01-16T05:40:24.350 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-01-16T05:40:24.351 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.353 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.363 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.374 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.374 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-01-16T05:40:24.376 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi142.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.414 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:24 +0000 (0:00:00.070) 0:01:50.634 ****** 2020-01-16T05:40:24.426 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} ok: [smithi142.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi142.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.435 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.446 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.457 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.457 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.458 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.460 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.505 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:24 +0000 (0:00:00.090) 0:01:50.725 ****** 2020-01-16T05:40:24.510 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.511 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.513 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.513 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.513 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.525 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.536 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-01-16T05:40:24.547 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.558 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.569 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.569 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.580 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.635 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:24 +0000 (0:00:00.119) 0:01:50.844 ****** 2020-01-16T05:40:24.645 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi142.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.002998", "end": "2020-01-16 05:40:24.622769", "rc": 0, "start": "2020-01-16 05:40:24.619771", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-01-16T05:40:24.688 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:24 +0000 (0:00:00.063) 0:01:50.908 ****** 2020-01-16T05:40:24.724 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-01-16T05:40:24.725 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.782 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:24 +0000 (0:00:00.093) 0:01:51.001 ****** 2020-01-16T05:40:24.783 INFO:teuthology.task.ansible.out: 2020-01-16T05:40:24.789 INFO:teuthology.task.ansible.out: 2020-01-16T05:40:24.790 INFO:teuthology.task.ansible.out:TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi084.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003224", "end": "2020-01-16 05:40:24.742609", "rc": 0, "start": "2020-01-16 05:40:24.739385", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-01-16T05:40:24.835 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:24 +0000 (0:00:00.053) 0:01:51.055 ****** 2020-01-16T05:40:24.837 INFO:teuthology.task.ansible.out: 2020-01-16T05:40:24.842 INFO:teuthology.task.ansible.out: 2020-01-16T05:40:24.843 INFO:teuthology.task.ansible.out:TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.893 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:24 +0000 (0:00:00.057) 0:01:51.113 ****** 2020-01-16T05:40:24.900 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-01-16T05:40:24.902 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:24.956 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:24 +0000 (0:00:00.062) 0:01:51.176 ****** 2020-01-16T05:40:24.961 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-01-16T05:40:24.962 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:25.005 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:25 +0000 (0:00:00.049) 0:01:51.225 ****** 2020-01-16T05:40:25.010 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-01-16T05:40:25.012 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:25.056 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:25 +0000 (0:00:00.050) 0:01:51.276 ****** 2020-01-16T05:40:25.092 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-01-16T05:40:25.094 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:25.136 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:25 +0000 (0:00:00.079) 0:01:51.356 ****** 2020-01-16T05:40:25.840 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-01-16T05:40:25.841 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1579152942, "cache_updated": false, "changed": false} 2020-01-16T05:40:25.894 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:25 +0000 (0:00:00.758) 0:01:52.114 ****** 2020-01-16T05:40:25.932 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-01-16T05:40:25.933 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:25.983 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:25 +0000 (0:00:00.088) 0:01:52.203 ****** 2020-01-16T05:40:25.999 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-01-16T05:40:26.000 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"cache_update_time": 1579152899, "cache_updated": false, "changed": false} 2020-01-16T05:40:26.057 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:26 +0000 (0:00:00.073) 0:01:52.277 ****** 2020-01-16T05:40:26.063 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-01-16T05:40:26.064 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={u'block_used': 13723478, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371630, u'size_available': 927218196480, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905894, u'device': u'/dev/sda1', u'inode_used': 149082, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371630, "block_size": 4096, "block_total": 240095108, "block_used": 13723478, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905894, "inode_total": 61054976, "inode_used": 149082, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927218196480, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}} 2020-01-16T05:40:26.112 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:26 +0000 (0:00:00.055) 0:01:52.332 ****** 2020-01-16T05:40:26.117 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-01-16T05:40:26.119 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.163 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:26 +0000 (0:00:00.050) 0:01:52.383 ****** 2020-01-16T05:40:26.211 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-01-16T05:40:26.212 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'block_used': 13723476, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371632, u'size_available': 927218204672, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905894, u'device': u'/dev/sda1', u'inode_used': 149082, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371632, "block_size": 4096, "block_total": 240095108, "block_used": 13723476, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905894, "inode_total": 61054976, "inode_used": 149082, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927218204672, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}} 2020-01-16T05:40:26.280 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:26 +0000 (0:00:00.117) 0:01:52.500 ****** 2020-01-16T05:40:26.287 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-01-16T05:40:26.288 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.007462", "end": "2020-01-16 05:40:26.197949", "rc": 0, "start": "2020-01-16 05:40:26.190487", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:26.334 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:26 +0000 (0:00:00.053) 0:01:52.553 ****** 2020-01-16T05:40:26.371 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-01-16T05:40:26.372 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'block_used': 13723478, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371630, u'size_available': 927218196480, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905894, u'device': u'/dev/sda1', u'inode_used': 149082, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371630, "block_size": 4096, "block_total": 240095108, "block_used": 13723478, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905894, "inode_total": 61054976, "inode_used": 149082, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927218196480, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.430 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:26 +0000 (0:00:00.095) 0:01:52.650 ****** 2020-01-16T05:40:26.436 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-01-16T05:40:26.436 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009801", "end": "2020-01-16 05:40:26.177668", "rc": 0, "start": "2020-01-16 05:40:26.167867", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:26.479 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:26 +0000 (0:00:00.049) 0:01:52.699 ****** 2020-01-16T05:40:26.485 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-01-16T05:40:26.530 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:26 +0000 (0:00:00.050) 0:01:52.749 ****** 2020-01-16T05:40:26.538 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi084.front.sepia.ceph.com] => (item={u'block_used': 13723476, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371632, u'size_available': 927218204672, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905894, u'device': u'/dev/sda1', u'inode_used': 149082, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371632, "block_size": 4096, "block_total": 240095108, "block_used": 13723476, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905894, "inode_total": 61054976, "inode_used": 149082, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927218204672, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.590 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:26 +0000 (0:00:00.060) 0:01:52.810 ****** 2020-01-16T05:40:26.598 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-01-16T05:40:26.603 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFVQ', u'wwn-0x5000c5009292426c'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XFVQ', u'wwn': u'0x5000c5009292426c', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFVQ-part1', u'wwn-0x5000c5009292426c-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFVQ", "wwn-0x5000c5009292426c"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFVQ-part1", "wwn-0x5000c5009292426c-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFVQ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2020-01-16T05:40:26.605 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c5009292426c"}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.606 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.608 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.610 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.625 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.626 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-01-16T05:40:26.628 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.679 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:26 +0000 (0:00:00.089) 0:01:52.899 ****** 2020-01-16T05:40:26.688 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.690 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.693 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.748 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LH7Q', u'wwn-0x5000c500918e3515'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5LH7Q', u'wwn': u'0x5000c500918e3515', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LH7Q-part1', u'wwn-0x5000c500918e3515-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LH7Q", "wwn-0x5000c500918e3515"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LH7Q-part1", "wwn-0x5000c500918e3515-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LH7Q", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2020-01-16T05:40:26.750 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c500918e3515"}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.762 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.765 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.787 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.800 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.808 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.810 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.823 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:26.836 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:28.783 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-UCySgp-Ai57-jlo7-dNb4-iB3M-8Vuf-zeWC5U', u'nvme-INTEL_SSDPEDMD400G4_CVFT6303009Y400BGN', u'nvme-nvme.8086-43564654363330333030395934303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.991581", "end": "2020-01-16 05:40:28.716450", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-UCySgp-Ai57-jlo7-dNb4-iB3M-8Vuf-zeWC5U", "nvme-INTEL_SSDPEDMD400G4_CVFT6303009Y400BGN", "nvme-nvme.8086-43564654363330333030395934303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:26.724869", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-01-16T05:40:28.785 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-16T05:40:29.215 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-tw5i8B-diI3-gX72-zCdh-nAcc-juk7-l4vEWV', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400WF400BGN', u'nvme-nvme.8086-50484654363230343030574634303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:02.253274", "end": "2020-01-16 05:40:28.964457", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-tw5i8B-diI3-gX72-zCdh-nAcc-juk7-l4vEWV", "nvme-INTEL_SSDPEDMD400G4_PHFT620400WF400BGN", "nvme-nvme.8086-50484654363230343030574634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:26.711183", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-01-16T05:40:29.217 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-16T05:40:30.027 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yhMdB2gG7ZyTAkhRRdugdfArzVztA3jUbq'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.132869", "end": "2020-01-16 05:40:29.966153", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yhMdB2gG7ZyTAkhRRdugdfArzVztA3jUbq"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:28.833284", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-16T05:40:30.477 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTwmwho4wfxJGU5x4QEZOFPiILwOVq15jqC'], u'uuids': [u'57abad99-108d-44fb-923e-0418c4e38232']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.135609", "end": "2020-01-16 05:40:30.228789", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTwmwho4wfxJGU5x4QEZOFPiILwOVq15jqC"], "labels": [], "masters": [], "uuids": ["57abad99-108d-44fb-923e-0418c4e38232"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:29.093180", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-16T05:40:31.300 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yh5TgAMzOSnalcLtMJhSTpN7epXa2QRlX3'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.122709", "end": "2020-01-16 05:40:31.217736", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yh5TgAMzOSnalcLtMJhSTpN7epXa2QRlX3"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:30.095027", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-16T05:40:31.731 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTw5jh1S2f8VkhLCtd7UmnKuQpufjmIKvzZ'], u'uuids': [u'4488cea6-d152-4033-817e-5e8b29b9fcc8']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.132144", "end": "2020-01-16 05:40:31.487347", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTw5jh1S2f8VkhLCtd7UmnKuQpufjmIKvzZ"], "labels": [], "masters": [], "uuids": ["4488cea6-d152-4033-817e-5e8b29b9fcc8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:30.355203", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-16T05:40:32.540 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yhT01dvz1Qe27BL2r70kuVwSFNhkxJdf84'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.123721", "end": "2020-01-16 05:40:32.484932", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yhT01dvz1Qe27BL2r70kuVwSFNhkxJdf84"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:31.361211", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-16T05:40:33.059 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTwNbNfTunmXqD096QKuUn75b08hV1GXWOu'], u'uuids': [u'289ddefb-3b07-4095-912d-aafa22c46fb3']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.194388", "end": "2020-01-16 05:40:32.804129", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTwNbNfTunmXqD096QKuUn75b08hV1GXWOu"], "labels": [], "masters": [], "uuids": ["289ddefb-3b07-4095-912d-aafa22c46fb3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:31.609741", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-16T05:40:33.796 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yhJveHRsQt3EF1nl9jiAXin1fZB3i6m9i6'], u'uuids': [u'0c744b80-0d94-4b18-a99f-0665200725b9']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.115833", "end": "2020-01-16 05:40:33.726803", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yhJveHRsQt3EF1nl9jiAXin1fZB3i6m9i6"], "labels": [], "masters": [], "uuids": ["0c744b80-0d94-4b18-a99f-0665200725b9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:32.610970", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-16T05:40:34.321 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTwhumaw2B33FxbiK2jwDzffpt6JaNkDMyL'], u'uuids': [u'10a7b301-7e8d-4ec5-8290-a356eb633bfd']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.116023", "end": "2020-01-16 05:40:34.063530", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTwhumaw2B33FxbiK2jwDzffpt6JaNkDMyL"], "labels": [], "masters": [], "uuids": ["10a7b301-7e8d-4ec5-8290-a356eb633bfd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:32.947507", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-16T05:40:35.041 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yh06M95omUUpYp1de8CXdrzAHdMfRI0HsJ'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.119252", "end": "2020-01-16 05:40:34.986246", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yh06M95omUUpYp1de8CXdrzAHdMfRI0HsJ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:33.866994", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-16T05:40:35.121 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:35 +0000 (0:00:08.441) 0:02:01.341 ****** 2020-01-16T05:40:35.182 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFVQ', u'wwn-0x5000c5009292426c'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XFVQ', u'wwn': u'0x5000c5009292426c', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFVQ-part1', u'wwn-0x5000c5009292426c-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFVQ", "wwn-0x5000c5009292426c"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFVQ-part1", "wwn-0x5000c5009292426c-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "ser 2020-01-16T05:40:35.184 INFO:teuthology.task.ansible.out:ial": "Z1W5XFVQ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009292426c"}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:35.194 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:35.196 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:35.208 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:35.222 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:35.223 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:35.236 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:35.247 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:35.259 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:35.450 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-UCySgp-Ai57-jlo7-dNb4-iB3M-8Vuf-zeWC5U', u'nvme-INTEL_SSDPEDMD400G4_CVFT6303009Y400BGN', u'nvme-nvme.8086-43564654363330333030395934303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.054225", "end": "2020-01-16 05:40:35.388829", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-UCySgp-Ai57-jlo7-dNb4-iB3M-8Vuf-zeWC5U", "nvme-INTEL_SSDPEDMD400G4_CVFT6303009Y400BGN", "nvme-nvme.8086-43564654363330333030395934303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:35.334604", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-01-16T05:40:35.452 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0409874 s, 2.8 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0409874 s, 2.8 GB/s"], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:35.590 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-01-16T05:40:35.593 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTw8dbYsjGOeqrdawkNlJGk3DRhXSzPjKeV'], u'uuids': [u'2e4be1c9-d6ce-44e2-9fec-f9bd1c9478a7']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.133001", "end": "2020-01-16 05:40:35.339683", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTw8dbYsjGOeqrdawkNlJGk3DRhXSzPjKeV"], "labels": [], "masters": [], "uuids": ["2e4be1c9-d6ce-44e2-9fec-f9bd1c9478a7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:34.206682", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-16T05:40:35.654 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:35 +0000 (0:00:00.533) 0:02:01.874 ****** 2020-01-16T05:40:35.715 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-16T05:40:35.717 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yhMdB2gG7ZyTAkhRRdugdfArzVztA3jUbq'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.141211", "end": "2020-01-16 05:40:35.664808", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yhMdB2gG7ZyTAkhRRdugdfArzVztA3jUbq"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:35.523597", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138025 s, 836 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138025 s, 836 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:35.757 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LH7Q', u'wwn-0x5000c500918e3515'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5LH7Q', u'wwn': u'0x5000c500918e3515', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LH7Q-part1', u'wwn-0x5000c500918e3515-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LH7Q", "wwn-0x5000c500918e3515"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LH7Q-part1", "wwn-0x5000c500918e3515-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LH7Q", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2020-01-16T05:40:35.759 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c500918e3515"}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:35.771 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:35.773 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:35.786 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:35.798 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:35.813 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:35.825 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:35.838 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:35.850 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:36.018 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yh5TgAMzOSnalcLtMJhSTpN7epXa2QRlX3'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.163611", "end": "2020-01-16 05:40:35.955183", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yh5TgAMzOSnalcLtMJhSTpN7epXa2QRlX3"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:35.791572", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159007 s, 725 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159007 s, 725 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:36.041 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-tw5i8B-diI3-gX72-zCdh-nAcc-juk7-l4vEWV', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400WF400BGN', u'nvme-nvme.8086-50484654363230343030574634303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.050847", "end": "2020-01-16 05:40:35.785827", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-tw5i8B-diI3-gX72-zCdh-nAcc-juk7-l4vEWV", "nvme-INTEL_SSDPEDMD400G4_PHFT620400WF400BGN", "nvme-nvme.8086-50484654363230343030574634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:35.734980", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-01-16T05:40:36.043 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.040993 s, 2.8 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.040993 s, 2.8 GB/s"], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:36.311 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yhT01dvz1Qe27BL2r70kuVwSFNhkxJdf84'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.154784", "end": "2020-01-16 05:40:36.239809", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yhT01dvz1Qe27BL2r70kuVwSFNhkxJdf84"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:36.085025", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.150132 s, 768 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.150132 s, 768 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:36.344 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTwmwho4wfxJGU5x4QEZOFPiILwOVq15jqC'], u'uuids': [u'57abad99-108d-44fb-923e-0418c4e38232']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.153653", "end": "2020-01-16 05:40:36.093039", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTwmwho4wfxJGU5x4QEZOFPiILwOVq15jqC"], "labels": [], "masters": [], "uuids": ["57abad99-108d-44fb-923e-0418c4e38232"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:35.939386", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.149539 s, 771 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.149539 s, 771 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:36.626 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yhJveHRsQt3EF1nl9jiAXin1fZB3i6m9i6'], u'uuids': [u'0c744b80-0d94-4b18-a99f-0665200725b9']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.156549", "end": "2020-01-16 05:40:36.564836", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yhJveHRsQt3EF1nl9jiAXin1fZB3i6m9i6"], "labels": [], "masters": [], "uuids": ["0c744b80-0d94-4b18-a99f-0665200725b9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:36.408287", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.151884 s, 759 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.151884 s, 759 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:36.644 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTw5jh1S2f8VkhLCtd7UmnKuQpufjmIKvzZ'], u'uuids': [u'4488cea6-d152-4033-817e-5e8b29b9fcc8']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.156057", "end": "2020-01-16 05:40:36.382937", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTw5jh1S2f8VkhLCtd7UmnKuQpufjmIKvzZ"], "labels": [], "masters": [], "uuids": ["4488cea6-d152-4033-817e-5e8b29b9fcc8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:36.226880", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.151681 s, 760 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.151681 s, 760 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:36.965 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yh06M95omUUpYp1de8CXdrzAHdMfRI0HsJ'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.156471", "end": "2020-01-16 05:40:36.894706", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-lbjXVG1d3OzZsdL6yXe5RqIUUAQcT6yh06M95omUUpYp1de8CXdrzAHdMfRI0HsJ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:36.738235", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.151646 s, 761 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.151646 s, 761 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:37.006 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTwNbNfTunmXqD096QKuUn75b08hV1GXWOu'], u'uuids': [u'289ddefb-3b07-4095-912d-aafa22c46fb3']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.167626", "end": "2020-01-16 05:40:36.706317", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTwNbNfTunmXqD096QKuUn75b08hV1GXWOu"], "labels": [], "masters": [], "uuids": ["289ddefb-3b07-4095-912d-aafa22c46fb3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:36.538691", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.16314 s, 707 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.16314 s, 707 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:37.044 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:37 +0000 (0:00:01.388) 0:02:03.262 ****** 2020-01-16T05:40:37.273 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTwhumaw2B33FxbiK2jwDzffpt6JaNkDMyL'], u'uuids': [u'10a7b301-7e8d-4ec5-8290-a356eb633bfd']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.158286", "end": "2020-01-16 05:40:37.025348", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTwhumaw2B33FxbiK2jwDzffpt6JaNkDMyL"], "labels": [], "masters": [], "uuids": ["10a7b301-7e8d-4ec5-8290-a356eb633bfd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:36.867062", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153472 s, 752 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153472 s, 752 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:37.360 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-01-16T05:40:37.361 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.167167", "end": "2020-01-16 05:40:37.304342", "rc": 0, "start": "2020-01-16 05:40:37.137175", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:37.415 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:37 +0000 (0:00:00.373) 0:02:03.635 ****** 2020-01-16T05:40:37.571 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-16T05:40:37.572 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTw8dbYsjGOeqrdawkNlJGk3DRhXSzPjKeV'], u'uuids': [u'2e4be1c9-d6ce-44e2-9fec-f9bd1c9478a7']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.169033", "end": "2020-01-16 05:40:37.328970", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ogxPBUJeeVIw4ZYSjn4F7celBJMFszTw8dbYsjGOeqrdawkNlJGk3DRhXSzPjKeV"], "labels": [], "masters": [], "uuids": ["2e4be1c9-d6ce-44e2-9fec-f9bd1c9478a7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-16 05:40:37.159937", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.164224 s, 702 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.164224 s, 702 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:37.613 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-01-16T05:40:37.615 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.046354", "end": "2020-01-16 05:40:37.550330", "rc": 0, "start": "2020-01-16 05:40:37.503976", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:37.666 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:37 +0000 (0:00:00.244) 0:02:03.880 ****** 2020-01-16T05:40:37.698 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:37 +0000 (0:00:00.037) 0:02:03.918 ****** 2020-01-16T05:40:37.726 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-01-16T05:40:37.768 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:37 +0000 (0:00:00.069) 0:02:03.988 ****** 2020-01-16T05:40:37.804 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-01-16T05:40:37.806 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:37.854 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:37 +0000 (0:00:00.079) 0:02:04.067 ****** 2020-01-16T05:40:37.885 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:37.933 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:37 +0000 (0:00:00.081) 0:02:04.148 ****** 2020-01-16T05:40:37.950 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi084.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.132037", "end": "2020-01-16 05:40:37.688215", "rc": 0, "start": "2020-01-16 05:40:37.556178", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:37.995 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:37 +0000 (0:00:00.066) 0:02:04.214 ****** 2020-01-16T05:40:38.003 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:38.064 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:38 +0000 (0:00:00.069) 0:02:04.284 ****** 2020-01-16T05:40:38.091 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-01-16T05:40:38.093 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:38.138 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:38 +0000 (0:00:00.073) 0:02:04.357 ****** 2020-01-16T05:40:38.189 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-01-16T05:40:38.198 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.044346", "end": "2020-01-16 05:40:37.947144", "rc": 0, "start": "2020-01-16 05:40:37.902798", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:38.230 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:38 +0000 (0:00:00.092) 0:02:04.450 ****** 2020-01-16T05:40:38.263 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-01-16T05:40:38.328 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:38 +0000 (0:00:00.097) 0:02:04.548 ****** 2020-01-16T05:40:38.335 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-01-16T05:40:38.336 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-16T05:40:38.376 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:38 +0000 (0:00:00.048) 0:02:04.596 ****** 2020-01-16T05:40:38.381 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-01-16T05:40:38.382 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:38.433 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:38 +0000 (0:00:00.056) 0:02:04.653 ****** 2020-01-16T05:40:38.439 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-01-16T05:40:38.439 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={u'block_used': 13723478, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371630, u'size_available': 927218196480, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905894, u'device': u'/dev/sda1', u'inode_used': 149082, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371630, "block_size": 4096, "block_total": 240095108, "block_used": 13723478, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905894, "inode_total": 61054976, "inode_used": 149082, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927218196480, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:38.483 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:38 +0000 (0:00:00.050) 0:02:04.703 ****** 2020-01-16T05:40:38.489 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-01-16T05:40:38.491 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:38.538 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:38 +0000 (0:00:00.054) 0:02:04.758 ****** 2020-01-16T05:40:38.545 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-01-16T05:40:38.546 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:38.588 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:38 +0000 (0:00:00.050) 0:02:04.808 ****** 2020-01-16T05:40:38.606 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:38.647 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:38 +0000 (0:00:00.058) 0:02:04.867 ****** 2020-01-16T05:40:38.662 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:38.698 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:38 +0000 (0:00:00.051) 0:02:04.918 ****** 2020-01-16T05:40:38.703 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-01-16T05:40:38.705 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:38.754 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:38 +0000 (0:00:00.056) 0:02:04.974 ****** 2020-01-16T05:40:38.760 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-16T05:40:38.761 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:38.821 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:38 +0000 (0:00:00.067) 0:02:05.041 ****** 2020-01-16T05:40:38.858 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-01-16T05:40:38.861 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:38.899 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:38 +0000 (0:00:00.077) 0:02:05.119 ****** 2020-01-16T05:40:38.904 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-01-16T05:40:38.905 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-16T05:40:38.957 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:38 +0000 (0:00:00.058) 0:02:05.177 ****** 2020-01-16T05:40:38.963 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:39.006 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:39 +0000 (0:00:00.048) 0:02:05.226 ****** 2020-01-16T05:40:39.011 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-01-16T05:40:39.014 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'block_used': 13723476, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371632, u'size_available': 927218204672, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905894, u'device': u'/dev/sda1', u'inode_used': 149082, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371632, "block_size": 4096, "block_total": 240095108, "block_used": 13723476, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905894, "inode_total": 61054976, "inode_used": 149082, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927218204672, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:39.056 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:39 +0000 (0:00:00.050) 0:02:05.276 ****** 2020-01-16T05:40:39.062 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-01-16T05:40:39.062 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:39.106 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:39 +0000 (0:00:00.049) 0:02:05.325 ****** 2020-01-16T05:40:39.111 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-01-16T05:40:39.112 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:39.153 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:39 +0000 (0:00:00.046) 0:02:05.372 ****** 2020-01-16T05:40:39.193 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-16T05:40:39.195 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:39.245 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:39 +0000 (0:00:00.091) 0:02:05.464 ****** 2020-01-16T05:40:39.282 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-16T05:40:39.283 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:39.346 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:39 +0000 (0:00:00.100) 0:02:05.565 ****** 2020-01-16T05:40:39.375 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:39.433 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:39 +0000 (0:00:00.086) 0:02:05.652 ****** 2020-01-16T05:40:39.469 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-01-16T05:40:39.470 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:39.514 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:39 +0000 (0:00:00.082) 0:02:05.734 ****** 2020-01-16T05:40:39.554 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:39.601 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:39 +0000 (0:00:00.086) 0:02:05.821 ****** 2020-01-16T05:40:39.742 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-01-16T05:40:39.743 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-01-16T05:40:39.784 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:39 +0000 (0:00:00.183) 0:02:06.004 ****** 2020-01-16T05:40:39.932 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-01-16T05:40:39.975 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:39 +0000 (0:00:00.190) 0:02:06.195 ****** 2020-01-16T05:40:40.371 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-01-16T05:40:40.373 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-16T05:40:40.421 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-16T05:40:40.625 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-16T05:40:40.683 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-16T05:40:40.896 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-16T05:40:40.947 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-16T05:40:41.150 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-16T05:40:41.223 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-16T05:40:41.442 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-16T05:40:41.519 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:41 +0000 (0:00:01.543) 0:02:07.739 ****** 2020-01-16T05:40:41.527 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-16T05:40:41.600 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:41 +0000 (0:00:00.080) 0:02:07.819 ****** 2020-01-16T05:40:41.660 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-01-16T05:40:41.661 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-01-16T05:40:41.736 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:41 +0000 (0:00:00.135) 0:02:07.955 ****** 2020-01-16T05:40:41.743 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-01-16T05:40:41.789 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:41 +0000 (0:00:00.053) 0:02:08.009 ****** 2020-01-16T05:40:41.806 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-01-16T05:40:41.807 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:41.829 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:41.938 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-16T05:40:41.961 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-16T05:40:42.072 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-16T05:40:42.095 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-16T05:40:42.214 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-16T05:40:42.227 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-16T05:40:42.356 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-16T05:40:42.402 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:42 +0000 (0:00:00.607) 0:02:08.616 ****** 2020-01-16T05:40:42.439 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:42 +0000 (0:00:00.042) 0:02:08.659 ****** 2020-01-16T05:40:42.542 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-01-16T05:40:42.543 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-01-16T05:40:42.598 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:42 +0000 (0:00:00.158) 0:02:08.818 ****** 2020-01-16T05:40:42.612 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-01-16T05:40:42.670 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:42 +0000 (0:00:00.071) 0:02:08.889 ****** 2020-01-16T05:40:42.678 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-01-16T05:40:42.679 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-01-16T05:40:42.726 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:42 +0000 (0:00:00.056) 0:02:08.946 ****** 2020-01-16T05:40:42.733 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-01-16T05:40:42.775 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:42 +0000 (0:00:00.046) 0:02:08.993 ****** 2020-01-16T05:40:43.269 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-01-16T05:40:43.270 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true} changed: [smithi142.front.sepia.ceph.com] => {"changed": true} 2020-01-16T05:40:43.328 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:43 +0000 (0:00:00.554) 0:02:09.547 ****** 2020-01-16T05:40:43.375 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:43 +0000 (0:00:00.047) 0:02:09.594 ****** 2020-01-16T05:40:43.796 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-01-16T05:40:43.799 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-01-16T05:40:43.852 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:43 +0000 (0:00:00.477) 0:02:10.072 ****** 2020-01-16T05:40:43.862 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-01-16T05:40:43.914 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:43 +0000 (0:00:00.061) 0:02:10.133 ****** 2020-01-16T05:40:43.994 INFO:teuthology.task.ansible.out: 2020-01-16T05:40:43.996 INFO:teuthology.task.ansible.out:TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-01-16T05:40:44.047 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:44 +0000 (0:00:00.133) 0:02:10.267 ****** 2020-01-16T05:40:44.084 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-01-16T05:40:44.131 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:44 +0000 (0:00:00.082) 0:02:10.350 ****** 2020-01-16T05:40:44.196 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-01-16T05:40:44.198 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-01-16T05:40:44.247 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:44 +0000 (0:00:00.116) 0:02:10.466 ****** 2020-01-16T05:40:44.281 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-01-16T05:40:44.334 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:44 +0000 (0:00:00.083) 0:02:10.550 ****** 2020-01-16T05:40:44.628 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-01-16T05:40:44.630 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-01-16T05:40:44.671 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:44 +0000 (0:00:00.340) 0:02:10.891 ****** 2020-01-16T05:40:44.687 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-01-16T05:40:44.736 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:44 +0000 (0:00:00.065) 0:02:10.956 ****** 2020-01-16T05:40:45.058 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-01-16T05:40:45.059 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-01-16T05:40:45.118 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:45 +0000 (0:00:00.367) 0:02:11.323 ****** ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-01-16T05:40:45.155 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:45 +0000 (0:00:00.051) 0:02:11.375 ****** 2020-01-16T05:40:46.002 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1579152942, "cache_updated": false, "changed": false} 2020-01-16T05:40:46.049 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:46 +0000 (0:00:00.893) 0:02:12.268 ****** 2020-01-16T05:40:46.054 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"cache_update_time": 1579152899, "cache_updated": false, "changed": false} 2020-01-16T05:40:46.106 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:46 +0000 (0:00:00.057) 0:02:12.325 ****** 2020-01-16T05:40:46.234 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.045365", "end": "2020-01-16 05:40:46.186326", "rc": 0, "start": "2020-01-16 05:40:46.140961", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-01-16T05:40:46.294 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:46 +0000 (0:00:00.188) 0:02:12.514 ****** 2020-01-16T05:40:46.311 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.047179", "end": "2020-01-16 05:40:46.073026", "rc": 0, "start": "2020-01-16 05:40:46.025847", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-01-16T05:40:46.360 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:46 +0000 (0:00:00.065) 0:02:12.579 ****** 2020-01-16T05:40:46.366 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-01-16T05:40:46.366 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:46.429 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:46 +0000 (0:00:00.059) 0:02:12.639 ****** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:46.476 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:46 +0000 (0:00:00.057) 0:02:12.696 ****** 2020-01-16T05:40:46.485 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-01-16T05:40:46.485 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:46.545 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:46 +0000 (0:00:00.068) 0:02:12.765 ****** 2020-01-16T05:40:46.565 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:46.603 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:46 +0000 (0:00:00.058) 0:02:12.823 ****** 2020-01-16T05:40:47.426 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-01-16T05:40:47.427 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1579152942, "cache_updated": false, "changed": false} 2020-01-16T05:40:47.476 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:47 +0000 (0:00:00.872) 0:02:13.696 ****** 2020-01-16T05:40:47.483 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"cache_update_time": 1579152899, "cache_updated": false, "changed": false} 2020-01-16T05:40:47.547 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:47 +0000 (0:00:00.070) 0:02:13.766 ****** 2020-01-16T05:40:47.557 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-01-16T05:40:47.559 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:47.605 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:47 +0000 (0:00:00.057) 0:02:13.824 ****** 2020-01-16T05:40:47.612 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:47.664 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:47 +0000 (0:00:00.059) 0:02:13.884 ****** 2020-01-16T05:40:47.963 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-01-16T05:40:47.965 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-01-16T05:40:48.054 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:48 +0000 (0:00:00.376) 0:02:14.260 ****** ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-01-16T05:40:48.092 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:48 +0000 (0:00:00.051) 0:02:14.312 ****** 2020-01-16T05:40:48.104 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:48.159 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:48 +0000 (0:00:00.065) 0:02:14.377 ****** 2020-01-16T05:40:48.170 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:48.217 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:48 +0000 (0:00:00.059) 0:02:14.437 ****** 2020-01-16T05:40:48.380 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-01-16T05:40:48.389 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-01-16 05:38:18 UTC", "ActiveEnterTimestampMonotonic": "25850953", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target sysinit.target systemd-tmpfiles-setup.service network.target systemd-journald.socket -.mount system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-01-16 05:38:10 UTC", "AssertTimestampMonotonic": "17688135", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-01-16 05:38:10 UTC", "ConditionTimestampMonotonic": "17688135", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-01-16T05:40:48.390 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1851", "ExecMainStartTimestamp": "Thu 2020-01-16 05:38:18 UTC", "ExecMainStartTimestampMonotonic": "25850939", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-01-16 05:38:10 UTC", "InactiveExitTimestampMonotonic": "17688941", "InvocationID": "79650404815b478eb4c3391a21974377", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-01-16T05:40:48.392 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1851", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-01-16 05:38:18 UTC", "StateChangeTimestampMonoton 2020-01-16T05:40:48.394 INFO:teuthology.task.ansible.out:ic": "25850953", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-01-16 05:38:18 UTC", "WatchdogTimestampMonotonic": "25850952", "WatchdogUSec": "0"}} 2020-01-16T05:40:48.445 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:48 +0000 (0:00:00.227) 0:02:14.664 ****** 2020-01-16T05:40:48.453 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-01-16 05:38:32 UTC", "ActiveEnterTimestampMonotonic": "25315418", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service -.mount basic.target sysinit.target systemd-journald.socket system.slice network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-01-16 05:38:23 UTC", "AssertTimestampMonotonic": "17224126", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-01-16 05:38:23 UTC", "ConditionTimestampMonotonic": "17224125", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-01-16T05:40:48.455 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1971", "ExecMainStartTimestamp": "Thu 2020-01-16 05:38:32 UTC", "ExecMainStartTimestampMonotonic": "25315405", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-01-16 05:38:23 UTC", "InactiveExitTimestampMonotonic": "17224959", "InvocationID": "c4ac51efd9c149739bdbf3e6b1c6e370", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-01-16T05:40:48.457 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1971", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-01-16 05:38:32 UTC", "StateChangeTimestampMonoton 2020-01-16T05:40:48.458 INFO:teuthology.task.ansible.out:ic": "25315418", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-01-16 05:38:32 UTC", "WatchdogTimestampMonotonic": "25315417", "WatchdogUSec": "0"}} 2020-01-16T05:40:48.495 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:48 +0000 (0:00:00.050) 0:02:14.715 ****** 2020-01-16T05:40:48.500 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-01-16T05:40:48.502 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:48.544 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:48 +0000 (0:00:00.049) 0:02:14.764 ****** 2020-01-16T05:40:48.547 INFO:teuthology.task.ansible.out: 2020-01-16T05:40:48.554 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:48.606 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:48 +0000 (0:00:00.056) 0:02:14.821 ****** 2020-01-16T05:40:49.396 INFO:teuthology.task.ansible.out: 2020-01-16T05:40:49.398 INFO:teuthology.task.ansible.out:TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1579152942, "cache_updated": false, "changed": false} 2020-01-16T05:40:49.440 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:49 +0000 (0:00:00.839) 0:02:15.660 ****** 2020-01-16T05:40:49.467 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-01-16T05:40:49.468 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:49.511 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:49 +0000 (0:00:00.070) 0:02:15.730 ****** 2020-01-16T05:40:49.516 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-01-16T05:40:49.517 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"cache_update_time": 1579152899, "cache_updated": false, "changed": false} 2020-01-16T05:40:49.558 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:49 +0000 (0:00:00.047) 0:02:15.777 ****** 2020-01-16T05:40:49.583 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-01-16T05:40:49.585 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:49.625 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:49 +0000 (0:00:00.066) 0:02:15.844 ****** 2020-01-16T05:40:49.641 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-01-16T05:40:49.642 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-01-16T05:40:49.698 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:49 +0000 (0:00:00.070) 0:02:15.915 ****** 2020-01-16T05:40:49.774 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-01-16T05:40:49.839 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:49 +0000 (0:00:00.143) 0:02:16.059 ****** 2020-01-16T05:40:50.064 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-01-16T05:40:50.065 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-01-16T05:40:50.123 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:50 +0000 (0:00:00.282) 0:02:16.341 ****** 2020-01-16T05:40:50.213 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-01-16T05:40:50.262 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:50 +0000 (0:00:00.141) 0:02:16.482 ****** 2020-01-16T05:40:51.221 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-01-16T05:40:51.222 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-01-16T05:40:51.224 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-01-16T05:40:51.289 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:51 +0000 (0:00:01.026) 0:02:17.508 ****** 2020-01-16T05:40:51.327 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:51 +0000 (0:00:00.038) 0:02:17.547 ****** 2020-01-16T05:40:51.812 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-01-16T05:40:51.813 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false} 2020-01-16T05:40:51.888 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:51 +0000 (0:00:00.560) 0:02:18.108 ****** 2020-01-16T05:40:51.896 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false} 2020-01-16T05:40:51.938 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:51 +0000 (0:00:00.049) 0:02:18.157 ****** 2020-01-16T05:40:51.942 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-01-16T05:40:51.943 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-01-16T05:40:51.987 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:51 +0000 (0:00:00.049) 0:02:18.207 ****** 2020-01-16T05:40:51.993 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-01-16T05:40:52.036 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:52 +0000 (0:00:00.049) 0:02:18.256 ****** 2020-01-16T05:40:52.134 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-01-16T05:40:52.136 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1579152884.7815936, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1579152883.3048558, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 107167, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1579152883.3048558, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "4209737475", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-01-16T05:40:52.187 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:52 +0000 (0:00:00.150) 0:02:18.407 ****** 2020-01-16T05:40:52.196 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1579152847.730512, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1579152846.281788, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 107167, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1579152846.281788, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "4209737475", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-01-16T05:40:52.236 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:52 +0000 (0:00:00.048) 0:02:18.456 ****** 2020-01-16T05:40:52.588 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-01-16T05:40:52.589 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-01-16T05:40:52.590 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-01-16T05:40:52.664 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:52 +0000 (0:00:00.427) 0:02:18.883 ****** 2020-01-16T05:40:52.703 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:52 +0000 (0:00:00.038) 0:02:18.922 ****** 2020-01-16T05:40:52.708 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-01-16T05:40:52.710 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-01-16T05:40:52.753 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:52 +0000 (0:00:00.050) 0:02:18.973 ****** 2020-01-16T05:40:52.774 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-01-16T05:40:52.819 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:52 +0000 (0:00:00.066) 0:02:19.039 ****** 2020-01-16T05:40:52.828 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-01-16T05:40:52.829 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:52.877 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:52 +0000 (0:00:00.057) 0:02:19.097 ****** 2020-01-16T05:40:52.885 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:52.942 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:52 +0000 (0:00:00.064) 0:02:19.161 ****** 2020-01-16T05:40:53.173 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-01-16T05:40:53.177 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-01-16T05:40:53.178 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-01-16T05:40:53.234 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:53 +0000 (0:00:00.289) 0:02:19.450 ****** 2020-01-16T05:40:53.267 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:53 +0000 (0:00:00.035) 0:02:19.486 ****** 2020-01-16T05:40:53.418 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-01-16T05:40:53.419 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-01-16T05:40:53.463 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:53 +0000 (0:00:00.196) 0:02:19.683 ****** 2020-01-16T05:40:53.471 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-01-16T05:40:53.512 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:53 +0000 (0:00:00.048) 0:02:19.732 ****** 2020-01-16T05:40:53.518 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-01-16T05:40:53.520 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:53.559 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:53 +0000 (0:00:00.046) 0:02:19.779 ****** 2020-01-16T05:40:53.566 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:53.613 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:53 +0000 (0:00:00.054) 0:02:19.833 ****** 2020-01-16T05:40:53.624 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi084.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:53.634 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:53.636 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:53.686 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:53 +0000 (0:00:00.073) 0:02:19.906 ****** 2020-01-16T05:40:53.693 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:53.694 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:53.696 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:53.696 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-01-16T05:40:53.755 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:53 +0000 (0:00:00.068) 0:02:19.974 ****** 2020-01-16T05:40:53.763 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-01-16T05:40:53.764 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:53.766 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:53.767 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:53.769 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:53.769 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:53.820 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:53 +0000 (0:00:00.065) 0:02:20.040 ****** 2020-01-16T05:40:53.830 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:53.835 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:53.878 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:53 +0000 (0:00:00.057) 0:02:20.097 ****** 2020-01-16T05:40:53.884 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:53.937 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:53 +0000 (0:00:00.059) 0:02:20.157 ****** 2020-01-16T05:40:53.943 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:53.996 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:53 +0000 (0:00:00.058) 0:02:20.215 ****** 2020-01-16T05:40:54.000 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-01-16T05:40:54.002 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:54.047 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:54 +0000 (0:00:00.051) 0:02:20.267 ****** 2020-01-16T05:40:54.053 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:54.103 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:54 +0000 (0:00:00.055) 0:02:20.322 ****** 2020-01-16T05:40:54.110 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:54.161 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:54 +0000 (0:00:00.054) 0:02:20.377 ****** 2020-01-16T05:40:54.166 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:54.214 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:54 +0000 (0:00:00.056) 0:02:20.433 ****** 2020-01-16T05:40:54.226 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:54.270 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:54 +0000 (0:00:00.050) 0:02:20.484 ****** 2020-01-16T05:40:54.274 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:54.315 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:54 +0000 (0:00:00.050) 0:02:20.534 ****** 2020-01-16T05:40:54.321 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-01-16T05:40:54.323 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:54.387 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:54 +0000 (0:00:00.072) 0:02:20.607 ****** 2020-01-16T05:40:54.395 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:54.445 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:54 +0000 (0:00:00.057) 0:02:20.665 ****** 2020-01-16T05:40:54.450 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-01-16T05:40:54.452 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:54.494 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:54 +0000 (0:00:00.049) 0:02:20.714 ****** 2020-01-16T05:40:54.500 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:54.549 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:54 +0000 (0:00:00.055) 0:02:20.769 ****** 2020-01-16T05:40:54.554 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-01-16T05:40:54.556 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:54.600 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:54 +0000 (0:00:00.051) 0:02:20.820 ****** 2020-01-16T05:40:54.618 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:54.653 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:54 +0000 (0:00:00.049) 0:02:20.870 ****** 2020-01-16T05:40:54.655 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-01-16T05:40:54.656 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:54.697 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:54 +0000 (0:00:00.046) 0:02:20.917 ****** 2020-01-16T05:40:54.702 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-16T05:40:54.750 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:54 +0000 (0:00:00.053) 0:02:20.970 ****** 2020-01-16T05:40:54.874 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-01-16T05:40:54.875 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010988", "end": "2020-01-16 05:40:54.627133", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-01-16 05:40:54.616145", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:54.929 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011450", "end": "2020-01-16 05:40:54.877895", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-01-16 05:40:54.866445", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:55.001 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006003", "end": "2020-01-16 05:40:54.757511", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-01-16 05:40:54.751508", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:55.066 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006125", "end": "2020-01-16 05:40:55.012258", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-01-16 05:40:55.006133", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:55.135 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005533", "end": "2020-01-16 05:40:54.889800", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-01-16 05:40:54.884267", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:55.219 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005423", "end": "2020-01-16 05:40:55.156040", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-01-16 05:40:55.150617", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:55.314 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.020701", "end": "2020-01-16 05:40:55.055138", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-01-16 05:40:55.034437", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:55.379 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:55 +0000 (0:00:00.629) 0:02:21.599 ****** 2020-01-16T05:40:55.385 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.021718", "end": "2020-01-16 05:40:55.316105", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-01-16 05:40:55.294387", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-16T05:40:55.435 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:55 +0000 (0:00:00.055) 0:02:21.655 ****** 2020-01-16T05:40:55.447 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-01-16T05:40:55.482 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:55 +0000 (0:00:00.046) 0:02:21.701 ****** 2020-01-16T05:40:55.536 INFO:teuthology.task.ansible.out:Thursday 16 January 2020 05:40:55 +0000 (0:00:00.053) 0:02:21.755 ****** 2020-01-16T05:40:55.625 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-01-16T05:40:55.686 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-01-16T05:40:55.824 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-01-16T05:40:55.826 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-01-16T05:40:55.829 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2020-01-16T05:40:55.830 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi084.front.sepia.ceph.com : ok=113 changed=32 unreachable=0 failed=0 skipped=169 rescued=0 ignored=0 smithi142.front.sepia.ceph.com : ok=113 changed=32 unreachable=0 failed=0 skipped=169 rescued=0 ignored=0 Thursday 16 January 2020 05:40:55 +0000 (0:00:00.293) 0:02:22.049 ****** =============================================================================== users : Create all admin users with sudo access. ----------------------- 16.39s users : Update authorized_keys using the keys repo --------------------- 14.84s testnode : Ensure packages are not present. ---------------------------- 10.29s testnode : Install packages --------------------------------------------- 9.83s testnode : Zap all non-root disks --------------------------------------- 8.44s users : Remove revoked users -------------------------------------------- 5.85s common : Update apt cache ----------------------------------------------- 3.54s Gathering Facts --------------------------------------------------------- 2.77s 2020-01-16T05:40:55.831 INFO:teuthology.task.ansible.out:testnode : Update apt cache. -------------------------------------------- 2.59s testnode : Install apt keys --------------------------------------------- 2.16s users : Update authorized_keys for each user with literal keys ---------- 1.79s testnode : Create logical volume(s) ------------------------------------- 1.54s ansible-managed : Add authorized keys for the ansible user. ------------- 1.46s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.39s testnode : Install packages via pip ------------------------------------- 1.03s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 0.97s testnode : Set the system's hostname ------------------------------------ 0.94s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.91s 2020-01-16T05:40:55.831 INFO:teuthology.task.ansible.out:testnode : Ensure perl-doc is inst 2020-01-16T05:40:55.832 INFO:teuthology.task.ansible.out:alled on apt systems. ----------------- 0.89s Gathering Facts --------------------------------------------------------- 0.89s 2020-01-16T05:40:56.111 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2020-01-16T05:40:56.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-16T05:40:56.114 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:40:56.191 INFO:teuthology.orchestra.run.smithi084:> true 2020-01-16T05:40:56.392 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-16T05:40:56.392 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi142.front.sepia.ceph.com', 'timeout': 60} 2020-01-16T05:40:56.470 INFO:teuthology.orchestra.run.smithi142:> true 2020-01-16T05:40:56.680 INFO:teuthology.run_tasks:Running task clock... 2020-01-16T05:40:56.708 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-01-16T05:40:56.709 INFO:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-01-16T05:40:56.767 INFO:teuthology.orchestra.run.smithi084.stdout:16 Jan 05:40:56 ntpd[7748]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-01-16T05:40:56.768 INFO:teuthology.orchestra.run.smithi084.stdout:16 Jan 05:40:56 ntpd[7748]: Command line: ntpd -gq 2020-01-16T05:40:56.768 INFO:teuthology.orchestra.run.smithi084.stdout:16 Jan 05:40:56 ntpd[7748]: proto: precision = 0.105 usec (-23) 2020-01-16T05:40:56.770 INFO:teuthology.orchestra.run.smithi084.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-01-16T05:40:56.770 INFO:teuthology.orchestra.run.smithi084.stderr:restrict ::: KOD does nothing without LIMITED. 2020-01-16T05:40:56.770 INFO:teuthology.orchestra.run.smithi084.stdout:16 Jan 05:40:56 ntpd[7748]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-01-16T05:40:56.770 INFO:teuthology.orchestra.run.smithi084.stdout:16 Jan 05:40:56 ntpd[7748]: restrict ::: KOD does nothing without LIMITED. 2020-01-16T05:40:56.770 INFO:teuthology.orchestra.run.smithi084.stdout:16 Jan 05:40:56 ntpd[7748]: Listen and drop on 0 v6wildcard [::]:123 2020-01-16T05:40:56.771 INFO:teuthology.orchestra.run.smithi084.stdout:16 Jan 05:40:56 ntpd[7748]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-01-16T05:40:56.771 INFO:teuthology.orchestra.run.smithi084.stdout:16 Jan 05:40:56 ntpd[7748]: Listen normally on 2 lo 127.0.0.1:123 2020-01-16T05:40:56.771 INFO:teuthology.orchestra.run.smithi084.stdout:16 Jan 05:40:56 ntpd[7748]: Listen normally on 3 enp3s0f1 172.21.15.84:123 2020-01-16T05:40:56.771 INFO:teuthology.orchestra.run.smithi084.stdout:16 Jan 05:40:56 ntpd[7748]: Listen normally on 4 lo [::1]:123 2020-01-16T05:40:56.771 INFO:teuthology.orchestra.run.smithi084.stdout:16 Jan 05:40:56 ntpd[7748]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d751%5]:123 2020-01-16T05:40:56.771 INFO:teuthology.orchestra.run.smithi084.stdout:16 Jan 05:40:56 ntpd[7748]: Listening on routing socket on fd #22 for interface updates 2020-01-16T05:40:59.767 INFO:teuthology.orchestra.run.smithi084.stderr:16 Jan 05:40:59 ntpd[7748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-16T05:40:59.767 INFO:teuthology.orchestra.run.smithi084.stderr:16 Jan 05:40:59 ntpd[7748]: can't open /var/log/ntpstats/rawstats.20200116: Permission denied 2020-01-16T05:40:59.768 INFO:teuthology.orchestra.run.smithi084.stderr:16 Jan 05:40:59 ntpd[7748]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-16T05:40:59.768 INFO:teuthology.orchestra.run.smithi084.stderr:16 Jan 05:40:59 ntpd[7748]: can't open /var/log/ntpstats/peerstats.20200116: Permission denied 2020-01-16T05:41:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:16 Jan 05:41:01 ntpd[7748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-16T05:41:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:16 Jan 05:41:01 ntpd[7748]: can't open /var/log/ntpstats/rawstats.20200116: Permission denied 2020-01-16T05:41:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:16 Jan 05:41:01 ntpd[7748]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-16T05:41:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:16 Jan 05:41:01 ntpd[7748]: can't open /var/log/ntpstats/peerstats.20200116: Permission denied 2020-01-16T05:41:03.770 INFO:teuthology.orchestra.run.smithi084.stderr:16 Jan 05:41:03 ntpd[7748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-16T05:41:03.770 INFO:teuthology.orchestra.run.smithi084.stderr:16 Jan 05:41:03 ntpd[7748]: can't open /var/log/ntpstats/rawstats.20200116: Permission denied 2020-01-16T05:41:03.771 INFO:teuthology.orchestra.run.smithi084.stderr:16 Jan 05:41:03 ntpd[7748]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-16T05:41:03.771 INFO:teuthology.orchestra.run.smithi084.stderr:16 Jan 05:41:03 ntpd[7748]: can't open /var/log/ntpstats/peerstats.20200116: Permission denied 2020-01-16T05:41:05.764 INFO:teuthology.orchestra.run.smithi084.stderr:16 Jan 05:41:05 ntpd[7748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-16T05:41:05.765 INFO:teuthology.orchestra.run.smithi084.stderr:16 Jan 05:41:05 ntpd[7748]: can't open /var/log/ntpstats/rawstats.20200116: Permission denied 2020-01-16T05:41:05.765 INFO:teuthology.orchestra.run.smithi084.stderr:16 Jan 05:41:05 ntpd[7748]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-16T05:41:05.765 INFO:teuthology.orchestra.run.smithi084.stderr:16 Jan 05:41:05 ntpd[7748]: can't open /var/log/ntpstats/peerstats.20200116: Permission denied 2020-01-16T05:41:05.765 INFO:teuthology.orchestra.run.smithi084.stderr:16 Jan 05:41:05 ntpd[7748]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-01-16T05:41:05.765 INFO:teuthology.orchestra.run.smithi084.stderr:16 Jan 05:41:05 ntpd[7748]: can't open /var/log/ntpstats/loopstats.20200116: Permission denied 2020-01-16T05:41:05.765 INFO:teuthology.orchestra.run.smithi084.stdout:16 Jan 05:41:05 ntpd[7748]: ntpd: time set +0.201689 s 2020-01-16T05:41:05.766 INFO:teuthology.orchestra.run.smithi084.stdout:ntpd: time set +0.201689s 2020-01-16T05:41:05.818 INFO:teuthology.orchestra.run.smithi084.stdout: remote refid st t when poll reach delay offset jitter 2020-01-16T05:41:05.819 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================== 2020-01-16T05:41:05.819 INFO:teuthology.orchestra.run.smithi084.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-16T05:41:05.819 INFO:teuthology.orchestra.run.smithi084.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-16T05:41:05.819 INFO:teuthology.orchestra.run.smithi084.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-16T05:41:05.819 INFO:teuthology.orchestra.run.smithi084.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-16T05:41:05.820 INFO:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-01-16T05:41:05.870 INFO:teuthology.orchestra.run.smithi142.stdout:16 Jan 05:41:05 ntpd[7743]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-01-16T05:41:05.870 INFO:teuthology.orchestra.run.smithi142.stdout:16 Jan 05:41:05 ntpd[7743]: Command line: ntpd -gq 2020-01-16T05:41:05.870 INFO:teuthology.orchestra.run.smithi142.stdout:16 Jan 05:41:05 ntpd[7743]: proto: precision = 0.123 usec (-23) 2020-01-16T05:41:05.871 INFO:teuthology.orchestra.run.smithi142.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-01-16T05:41:05.871 INFO:teuthology.orchestra.run.smithi142.stderr:restrict ::: KOD does nothing without LIMITED. 2020-01-16T05:41:05.872 INFO:teuthology.orchestra.run.smithi142.stdout:16 Jan 05:41:05 ntpd[7743]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-01-16T05:41:05.872 INFO:teuthology.orchestra.run.smithi142.stdout:16 Jan 05:41:05 ntpd[7743]: restrict ::: KOD does nothing without LIMITED. 2020-01-16T05:41:05.872 INFO:teuthology.orchestra.run.smithi142.stdout:16 Jan 05:41:05 ntpd[7743]: Listen and drop on 0 v6wildcard [::]:123 2020-01-16T05:41:05.872 INFO:teuthology.orchestra.run.smithi142.stdout:16 Jan 05:41:05 ntpd[7743]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-01-16T05:41:05.873 INFO:teuthology.orchestra.run.smithi142.stdout:16 Jan 05:41:05 ntpd[7743]: Listen normally on 2 lo 127.0.0.1:123 2020-01-16T05:41:05.873 INFO:teuthology.orchestra.run.smithi142.stdout:16 Jan 05:41:05 ntpd[7743]: Listen normally on 3 enp3s0f1 172.21.15.142:123 2020-01-16T05:41:05.873 INFO:teuthology.orchestra.run.smithi142.stdout:16 Jan 05:41:05 ntpd[7743]: Listen normally on 4 lo [::1]:123 2020-01-16T05:41:05.873 INFO:teuthology.orchestra.run.smithi142.stdout:16 Jan 05:41:05 ntpd[7743]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6e0d%5]:123 2020-01-16T05:41:05.874 INFO:teuthology.orchestra.run.smithi142.stdout:16 Jan 05:41:05 ntpd[7743]: Listening on routing socket on fd #22 for interface updates 2020-01-16T05:41:08.869 INFO:teuthology.orchestra.run.smithi142.stderr:16 Jan 05:41:08 ntpd[7743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-16T05:41:08.869 INFO:teuthology.orchestra.run.smithi142.stderr:16 Jan 05:41:08 ntpd[7743]: can't open /var/log/ntpstats/rawstats.20200116: Permission denied 2020-01-16T05:41:08.870 INFO:teuthology.orchestra.run.smithi142.stderr:16 Jan 05:41:08 ntpd[7743]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-16T05:41:08.870 INFO:teuthology.orchestra.run.smithi142.stderr:16 Jan 05:41:08 ntpd[7743]: can't open /var/log/ntpstats/peerstats.20200116: Permission denied 2020-01-16T05:41:10.868 INFO:teuthology.orchestra.run.smithi142.stderr:16 Jan 05:41:10 ntpd[7743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-16T05:41:10.868 INFO:teuthology.orchestra.run.smithi142.stderr:16 Jan 05:41:10 ntpd[7743]: can't open /var/log/ntpstats/rawstats.20200116: Permission denied 2020-01-16T05:41:10.868 INFO:teuthology.orchestra.run.smithi142.stderr:16 Jan 05:41:10 ntpd[7743]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-16T05:41:10.868 INFO:teuthology.orchestra.run.smithi142.stderr:16 Jan 05:41:10 ntpd[7743]: can't open /var/log/ntpstats/peerstats.20200116: Permission denied 2020-01-16T05:41:12.868 INFO:teuthology.orchestra.run.smithi142.stderr:16 Jan 05:41:12 ntpd[7743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-16T05:41:12.869 INFO:teuthology.orchestra.run.smithi142.stderr:16 Jan 05:41:12 ntpd[7743]: can't open /var/log/ntpstats/rawstats.20200116: Permission denied 2020-01-16T05:41:12.869 INFO:teuthology.orchestra.run.smithi142.stderr:16 Jan 05:41:12 ntpd[7743]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-16T05:41:12.869 INFO:teuthology.orchestra.run.smithi142.stderr:16 Jan 05:41:12 ntpd[7743]: can't open /var/log/ntpstats/peerstats.20200116: Permission denied 2020-01-16T05:41:14.866 INFO:teuthology.orchestra.run.smithi142.stderr:16 Jan 05:41:14 ntpd[7743]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-16T05:41:14.867 INFO:teuthology.orchestra.run.smithi142.stderr:16 Jan 05:41:14 ntpd[7743]: can't open /var/log/ntpstats/rawstats.20200116: Permission denied 2020-01-16T05:41:14.867 INFO:teuthology.orchestra.run.smithi142.stderr:16 Jan 05:41:14 ntpd[7743]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-16T05:41:14.867 INFO:teuthology.orchestra.run.smithi142.stderr:16 Jan 05:41:14 ntpd[7743]: can't open /var/log/ntpstats/peerstats.20200116: Permission denied 2020-01-16T05:41:14.867 INFO:teuthology.orchestra.run.smithi142.stderr:16 Jan 05:41:14 ntpd[7743]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-01-16T05:41:14.867 INFO:teuthology.orchestra.run.smithi142.stderr:16 Jan 05:41:14 ntpd[7743]: can't open /var/log/ntpstats/loopstats.20200116: Permission denied 2020-01-16T05:41:14.868 INFO:teuthology.orchestra.run.smithi142.stdout:16 Jan 05:41:14 ntpd[7743]: ntpd: time slew +0.007169 s 2020-01-16T05:41:14.868 INFO:teuthology.orchestra.run.smithi142.stdout:ntpd: time slew +0.007169s 2020-01-16T05:41:14.997 INFO:teuthology.orchestra.run.smithi142.stdout: remote refid st t when poll reach delay offset jitter 2020-01-16T05:41:14.997 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================== 2020-01-16T05:41:14.997 INFO:teuthology.orchestra.run.smithi142.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-16T05:41:14.998 INFO:teuthology.orchestra.run.smithi142.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-16T05:41:14.998 INFO:teuthology.orchestra.run.smithi142.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-16T05:41:14.998 INFO:teuthology.orchestra.run.smithi142.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-16T05:41:14.999 INFO:teuthology.run_tasks:Running task install... 2020-01-16T05:41:15.010 DEBUG:teuthology.task.install:project ceph 2020-01-16T05:41:15.010 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '07713629e135b47dc5ec2a85f60649826e17a6cd'}} 2020-01-16T05:41:15.011 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': '07713629e135b47dc5ec2a85f60649826e17a6cd'} 2020-01-16T05:41:15.011 INFO:teuthology.task.install:Using flavor: basic 2020-01-16T05:41:15.026 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-01-16T05:41:15.026 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-01-16T05:41:15.026 INFO:teuthology.orchestra.run.smithi084:> sudo lsb_release -is 2020-01-16T05:41:15.080 INFO:teuthology.orchestra.run.smithi084.stdout:Ubuntu 2020-01-16T05:41:15.086 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-16T05:41:15.086 INFO:teuthology.orchestra.run.smithi142:> sudo lsb_release -is 2020-01-16T05:41:15.087 INFO:teuthology.orchestra.run.smithi084:> sudo apt-key list | grep Ceph 2020-01-16T05:41:15.136 INFO:teuthology.orchestra.run.smithi142.stdout:Ubuntu 2020-01-16T05:41:15.141 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-16T05:41:15.142 INFO:teuthology.orchestra.run.smithi142:> sudo apt-key list | grep Ceph 2020-01-16T05:41:15.178 INFO:teuthology.orchestra.run.smithi084.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-01-16T05:41:15.221 INFO:teuthology.orchestra.run.smithi142.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-01-16T05:41:15.232 INFO:teuthology.orchestra.run.smithi084.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-01-16T05:41:15.232 INFO:teuthology.orchestra.run.smithi084.stdout:uid [ unknown] Ceph.com (release key) 2020-01-16T05:41:15.233 INFO:teuthology.orchestra.run.smithi084:> sudo lsb_release -is 2020-01-16T05:41:15.274 INFO:teuthology.orchestra.run.smithi142.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-01-16T05:41:15.275 INFO:teuthology.orchestra.run.smithi142.stdout:uid [ unknown] Ceph.com (release key) 2020-01-16T05:41:15.276 INFO:teuthology.orchestra.run.smithi142:> sudo lsb_release -is 2020-01-16T05:41:15.284 INFO:teuthology.orchestra.run.smithi084.stdout:Ubuntu 2020-01-16T05:41:15.291 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-16T05:41:15.291 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2020-01-16T05:41:15.291 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent on remote deb x86_64 2020-01-16T05:41:15.292 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=07713629e135b47dc5ec2a85f60649826e17a6cd 2020-01-16T05:41:15.328 INFO:teuthology.orchestra.run.smithi142.stdout:Ubuntu 2020-01-16T05:41:15.333 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-16T05:41:15.334 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2020-01-16T05:41:15.334 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent on remote deb x86_64 2020-01-16T05:41:15.334 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=07713629e135b47dc5ec2a85f60649826e17a6cd 2020-01-16T05:41:15.453 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default/ 2020-01-16T05:41:15.454 INFO:teuthology.task.install.deb:Package version is 15.0.0-9376-g0771362-1bionic 2020-01-16T05:41:15.495 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default/ 2020-01-16T05:41:15.495 INFO:teuthology.task.install.deb:Package version is 15.0.0-9376-g0771362-1bionic 2020-01-16T05:41:15.582 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2020-01-16T05:41:15.627 INFO:teuthology.orchestra.run.smithi142:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2020-01-16T05:41:15.652 INFO:teuthology.orchestra.run.smithi084:> sudo apt-get update 2020-01-16T05:41:15.707 INFO:teuthology.orchestra.run.smithi142:> sudo apt-get update 2020-01-16T05:41:15.915 INFO:teuthology.orchestra.run.smithi084.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic InRelease 2020-01-16T05:41:15.937 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic Release [7,663 B] 2020-01-16T05:41:15.957 INFO:teuthology.orchestra.run.smithi084.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic Release.gpg 2020-01-16T05:41:15.958 INFO:teuthology.orchestra.run.smithi142.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic InRelease 2020-01-16T05:41:15.969 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-16T05:41:15.970 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:5 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-01-16T05:41:15.979 INFO:teuthology.orchestra.run.smithi142.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic Release [7,663 B] 2020-01-16T05:41:15.991 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.3 kB] 2020-01-16T05:41:16.004 INFO:teuthology.orchestra.run.smithi142.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic Release.gpg 2020-01-16T05:41:16.016 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:4 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-01-16T05:41:16.017 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-16T05:41:16.024 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.3 kB] 2020-01-16T05:41:16.041 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:7 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-01-16T05:41:16.042 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,611 B] 2020-01-16T05:41:16.060 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,611 B] 2020-01-16T05:41:16.087 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-01-16T05:41:16.118 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-01-16T05:41:16.166 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-01-16T05:41:16.565 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 25.6 kB in 1s (36.3 kB/s) 2020-01-16T05:41:16.624 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 25.6 kB in 1s (35.8 kB/s) 2020-01-16T05:41:17.709 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2020-01-16T05:41:17.754 INFO:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.0.0-9376-g0771362-1bionic cephadm=15.0.0-9376-g0771362-1bionic ceph-mds=15.0.0-9376-g0771362-1bionic ceph-mgr=15.0.0-9376-g0771362-1bionic ceph-common=15.0.0-9376-g0771362-1bionic ceph-fuse=15.0.0-9376-g0771362-1bionic ceph-test=15.0.0-9376-g0771362-1bionic radosgw=15.0.0-9376-g0771362-1bionic python3-rados=15.0.0-9376-g0771362-1bionic python3-rgw=15.0.0-9376-g0771362-1bionic python3-cephfs=15.0.0-9376-g0771362-1bionic python3-rbd=15.0.0-9376-g0771362-1bionic libcephfs2=15.0.0-9376-g0771362-1bionic libcephfs-dev=15.0.0-9376-g0771362-1bionic librados2=15.0.0-9376-g0771362-1bionic librbd1=15.0.0-9376-g0771362-1bionic rbd-fuse=15.0.0-9376-g0771362-1bionic python3-cephfs=15.0.0-9376-g0771362-1bionic cephfs-shell=15.0.0-9376-g0771362-1bionic 2020-01-16T05:41:17.768 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2020-01-16T05:41:17.814 INFO:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.0.0-9376-g0771362-1bionic cephadm=15.0.0-9376-g0771362-1bionic ceph-mds=15.0.0-9376-g0771362-1bionic ceph-mgr=15.0.0-9376-g0771362-1bionic ceph-common=15.0.0-9376-g0771362-1bionic ceph-fuse=15.0.0-9376-g0771362-1bionic ceph-test=15.0.0-9376-g0771362-1bionic radosgw=15.0.0-9376-g0771362-1bionic python3-rados=15.0.0-9376-g0771362-1bionic python3-rgw=15.0.0-9376-g0771362-1bionic python3-cephfs=15.0.0-9376-g0771362-1bionic python3-rbd=15.0.0-9376-g0771362-1bionic libcephfs2=15.0.0-9376-g0771362-1bionic libcephfs-dev=15.0.0-9376-g0771362-1bionic librados2=15.0.0-9376-g0771362-1bionic librbd1=15.0.0-9376-g0771362-1bionic rbd-fuse=15.0.0-9376-g0771362-1bionic python3-cephfs=15.0.0-9376-g0771362-1bionic cephfs-shell=15.0.0-9376-g0771362-1bionic 2020-01-16T05:41:17.829 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2020-01-16T05:41:17.898 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2020-01-16T05:41:18.080 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2020-01-16T05:41:18.081 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2020-01-16T05:41:18.155 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2020-01-16T05:41:18.156 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2020-01-16T05:41:18.242 INFO:teuthology.orchestra.run.smithi084.stdout:The following additional packages will be installed: 2020-01-16T05:41:18.243 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-01-16T05:41:18.243 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mon 2020-01-16T05:41:18.245 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 liboath0 libonig4 2020-01-16T05:41:18.245 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 2020-01-16T05:41:18.245 INFO:teuthology.orchestra.run.smithi084.stdout: python-attr python-funcsigs python-pastedeploy-tpl python-pluggy python-py 2020-01-16T05:41:18.245 INFO:teuthology.orchestra.run.smithi084.stdout: python-pytest python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-01-16T05:41:18.245 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2020-01-16T05:41:18.246 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2020-01-16T05:41:18.246 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2020-01-16T05:41:18.246 INFO:teuthology.orchestra.run.smithi084.stdout: python3-html5lib python3-httplib2 python3-joblib python3-jwt 2020-01-16T05:41:18.246 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2020-01-16T05:41:18.246 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-01-16T05:41:18.246 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-01-16T05:41:18.246 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-01-16T05:41:18.246 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-01-16T05:41:18.247 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2020-01-16T05:41:18.247 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-01-16T05:41:18.247 INFO:teuthology.orchestra.run.smithi084.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-01-16T05:41:18.247 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-01-16T05:41:18.247 INFO:teuthology.orchestra.run.smithi084.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-01-16T05:41:18.247 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-01-16T05:41:18.247 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2020-01-16T05:41:18.248 INFO:teuthology.orchestra.run.smithi084.stdout:Suggested packages: 2020-01-16T05:41:18.248 INFO:teuthology.orchestra.run.smithi084.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2020-01-16T05:41:18.248 INFO:teuthology.orchestra.run.smithi084.stdout: python-pytest-xdist python-mock python-cryptography-doc 2020-01-16T05:41:18.248 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi python3-crypto 2020-01-16T05:41:18.249 INFO:teuthology.orchestra.run.smithi084.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc dvipng 2020-01-16T05:41:18.249 INFO:teuthology.orchestra.run.smithi084.stdout: ffmpeg gir1.2-gtk-3.0 ghostscript inkscape ipython3 python-matplotlib-doc 2020-01-16T05:41:18.249 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cairocffi python3-gi-cairo python3-gobject python3-pyqt4 python3-sip 2020-01-16T05:41:18.249 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tornado texlive-extra-utils texlive-latex-extra ttf-staypuft 2020-01-16T05:41:18.249 INFO:teuthology.orchestra.run.smithi084.stdout: python-numpy-doc python3-dev python3-numpy-dbg python-openssl-doc 2020-01-16T05:41:18.249 INFO:teuthology.orchestra.run.smithi084.stdout: python3-openssl-dbg httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2020-01-16T05:41:18.249 INFO:teuthology.orchestra.run.smithi084.stdout: libjs-mochikit python-pecan-doc python-pil-doc python3-pil-dbg 2020-01-16T05:41:18.250 INFO:teuthology.orchestra.run.smithi084.stdout: python-pyinotify-doc python-pyparsing-doc python-scipy-doc 2020-01-16T05:41:18.250 INFO:teuthology.orchestra.run.smithi084.stdout: python-setuptools-doc python3-dap python-sklearn-doc python-sqlalchemy-doc 2020-01-16T05:41:18.250 INFO:teuthology.orchestra.run.smithi084.stdout: python3-psycopg2 python3-pymysql python3-fdb tix python3-tk-dbg 2020-01-16T05:41:18.250 INFO:teuthology.orchestra.run.smithi084.stdout: python-waitress-doc python-webob-doc python-webtest-doc python3-termcolor 2020-01-16T05:41:18.250 INFO:teuthology.orchestra.run.smithi084.stdout: python3-watchdog python-werkzeug-doc 2020-01-16T05:41:18.319 INFO:teuthology.orchestra.run.smithi142.stdout:The following additional packages will be installed: 2020-01-16T05:41:18.320 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-01-16T05:41:18.320 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mon 2020-01-16T05:41:18.321 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 liboath0 libonig4 2020-01-16T05:41:18.321 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 2020-01-16T05:41:18.321 INFO:teuthology.orchestra.run.smithi142.stdout: python-attr python-funcsigs python-pastedeploy-tpl python-pluggy python-py 2020-01-16T05:41:18.321 INFO:teuthology.orchestra.run.smithi142.stdout: python-pytest python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-01-16T05:41:18.322 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2020-01-16T05:41:18.322 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2020-01-16T05:41:18.322 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2020-01-16T05:41:18.322 INFO:teuthology.orchestra.run.smithi142.stdout: python3-html5lib python3-httplib2 python3-joblib python3-jwt 2020-01-16T05:41:18.322 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2020-01-16T05:41:18.322 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-01-16T05:41:18.322 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-01-16T05:41:18.322 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-01-16T05:41:18.323 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-01-16T05:41:18.323 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2020-01-16T05:41:18.323 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-01-16T05:41:18.323 INFO:teuthology.orchestra.run.smithi142.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-01-16T05:41:18.323 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-01-16T05:41:18.323 INFO:teuthology.orchestra.run.smithi142.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-01-16T05:41:18.323 INFO:teuthology.orchestra.run.smithi142.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-01-16T05:41:18.324 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2020-01-16T05:41:18.324 INFO:teuthology.orchestra.run.smithi142.stdout:Suggested packages: 2020-01-16T05:41:18.324 INFO:teuthology.orchestra.run.smithi142.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2020-01-16T05:41:18.324 INFO:teuthology.orchestra.run.smithi142.stdout: python-pytest-xdist python-mock python-cryptography-doc 2020-01-16T05:41:18.324 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi python3-crypto 2020-01-16T05:41:18.325 INFO:teuthology.orchestra.run.smithi142.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc dvipng 2020-01-16T05:41:18.325 INFO:teuthology.orchestra.run.smithi142.stdout: ffmpeg gir1.2-gtk-3.0 ghostscript inkscape ipython3 python-matplotlib-doc 2020-01-16T05:41:18.325 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cairocffi python3-gi-cairo python3-gobject python3-pyqt4 python3-sip 2020-01-16T05:41:18.325 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tornado texlive-extra-utils texlive-latex-extra ttf-staypuft 2020-01-16T05:41:18.325 INFO:teuthology.orchestra.run.smithi142.stdout: python-numpy-doc python3-dev python3-numpy-dbg python-openssl-doc 2020-01-16T05:41:18.325 INFO:teuthology.orchestra.run.smithi142.stdout: python3-openssl-dbg httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2020-01-16T05:41:18.325 INFO:teuthology.orchestra.run.smithi142.stdout: libjs-mochikit python-pecan-doc python-pil-doc python3-pil-dbg 2020-01-16T05:41:18.325 INFO:teuthology.orchestra.run.smithi142.stdout: python-pyinotify-doc python-pyparsing-doc python-scipy-doc 2020-01-16T05:41:18.326 INFO:teuthology.orchestra.run.smithi142.stdout: python-setuptools-doc python3-dap python-sklearn-doc python-sqlalchemy-doc 2020-01-16T05:41:18.326 INFO:teuthology.orchestra.run.smithi142.stdout: python3-psycopg2 python3-pymysql python3-fdb tix python3-tk-dbg 2020-01-16T05:41:18.326 INFO:teuthology.orchestra.run.smithi142.stdout: python-waitress-doc python-webob-doc python-webtest-doc python3-termcolor 2020-01-16T05:41:18.326 INFO:teuthology.orchestra.run.smithi142.stdout: python3-watchdog python-werkzeug-doc 2020-01-16T05:41:18.344 INFO:teuthology.orchestra.run.smithi084.stdout:The following NEW packages will be installed: 2020-01-16T05:41:18.345 INFO:teuthology.orchestra.run.smithi084.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2020-01-16T05:41:18.345 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-01-16T05:41:18.345 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mon 2020-01-16T05:41:18.347 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 libjq1 2020-01-16T05:41:18.347 INFO:teuthology.orchestra.run.smithi084.stdout: libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 2020-01-16T05:41:18.348 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka1 librgw2 libsnappy1v5 libxslt1.1 python-attr python-funcsigs 2020-01-16T05:41:18.348 INFO:teuthology.orchestra.run.smithi084.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2020-01-16T05:41:18.348 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-01-16T05:41:18.348 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs 2020-01-16T05:41:18.348 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi-backend python3-cherrypy3 python3-cmd2 python3-colorama 2020-01-16T05:41:18.348 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography python3-cycler python3-dateutil python3-decorator 2020-01-16T05:41:18.348 INFO:teuthology.orchestra.run.smithi084.stdout: python3-fasteners python3-html5lib python3-httplib2 python3-joblib 2020-01-16T05:41:18.349 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-01-16T05:41:18.349 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-01-16T05:41:18.349 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-01-16T05:41:18.349 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-01-16T05:41:18.349 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-01-16T05:41:18.349 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2020-01-16T05:41:18.349 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2020-01-16T05:41:18.350 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2020-01-16T05:41:18.350 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2020-01-16T05:41:18.350 INFO:teuthology.orchestra.run.smithi084.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-01-16T05:41:18.350 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2020-01-16T05:41:18.350 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2020-01-16T05:41:18.350 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2020-01-16T05:41:18.350 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages will be upgraded: 2020-01-16T05:41:18.351 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 librbd1 2020-01-16T05:41:18.432 INFO:teuthology.orchestra.run.smithi142.stdout:The following NEW packages will be installed: 2020-01-16T05:41:18.432 INFO:teuthology.orchestra.run.smithi142.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2020-01-16T05:41:18.439 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-01-16T05:41:18.439 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mon 2020-01-16T05:41:18.439 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 libjq1 2020-01-16T05:41:18.439 INFO:teuthology.orchestra.run.smithi142.stdout: libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 2020-01-16T05:41:18.439 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka1 librgw2 libsnappy1v5 libxslt1.1 python-attr python-funcsigs 2020-01-16T05:41:18.439 INFO:teuthology.orchestra.run.smithi142.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2020-01-16T05:41:18.439 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-01-16T05:41:18.440 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs 2020-01-16T05:41:18.440 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-backend python3-cherrypy3 python3-cmd2 python3-colorama 2020-01-16T05:41:18.440 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography python3-cycler python3-dateutil python3-decorator 2020-01-16T05:41:18.440 INFO:teuthology.orchestra.run.smithi142.stdout: python3-fasteners python3-html5lib python3-httplib2 python3-joblib 2020-01-16T05:41:18.440 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-01-16T05:41:18.440 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-01-16T05:41:18.440 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-01-16T05:41:18.440 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-01-16T05:41:18.441 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-01-16T05:41:18.441 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2020-01-16T05:41:18.441 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2020-01-16T05:41:18.441 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2020-01-16T05:41:18.441 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2020-01-16T05:41:18.441 INFO:teuthology.orchestra.run.smithi142.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-01-16T05:41:18.441 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2020-01-16T05:41:18.442 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2020-01-16T05:41:18.442 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2020-01-16T05:41:18.442 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages will be upgraded: 2020-01-16T05:41:18.442 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 librbd1 2020-01-16T05:41:18.514 INFO:teuthology.orchestra.run.smithi084.stdout:2 upgraded, 110 newly installed, 0 to remove and 28 not upgraded. 2020-01-16T05:41:18.514 INFO:teuthology.orchestra.run.smithi084.stdout:Need to get 151 MB of archives. 2020-01-16T05:41:18.514 INFO:teuthology.orchestra.run.smithi084.stdout:After this operation, 703 MB of additional disk space will be used. 2020-01-16T05:41:18.514 INFO:teuthology.orchestra.run.smithi084.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.0.0-9376-g0771362-1bionic [1,581 kB] 2020-01-16T05:41:18.538 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2020-01-16T05:41:18.573 INFO:teuthology.orchestra.run.smithi142.stdout:2 upgraded, 110 newly installed, 0 to remove and 28 not upgraded. 2020-01-16T05:41:18.573 INFO:teuthology.orchestra.run.smithi142.stdout:Need to get 151 MB of archives. 2020-01-16T05:41:18.573 INFO:teuthology.orchestra.run.smithi142.stdout:After this operation, 703 MB of additional disk space will be used. 2020-01-16T05:41:18.573 INFO:teuthology.orchestra.run.smithi142.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.0.0-9376-g0771362-1bionic [1,581 kB] 2020-01-16T05:41:18.618 INFO:teuthology.orchestra.run.smithi142.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2020-01-16T05:41:18.662 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.0.0-9376-g0771362-1bionic [3,050 kB] 2020-01-16T05:41:18.744 INFO:teuthology.orchestra.run.smithi142.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.0.0-9376-g0771362-1bionic [3,050 kB] 2020-01-16T05:41:18.805 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2020-01-16T05:41:18.813 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2020-01-16T05:41:18.823 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.0.0-9376-g0771362-1bionic [432 kB] 2020-01-16T05:41:18.845 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2020-01-16T05:41:18.851 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-01-16T05:41:18.851 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.0.0-9376-g0771362-1bionic [331 kB] 2020-01-16T05:41:18.882 INFO:teuthology.orchestra.run.smithi084.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.0.0-9376-g0771362-1bionic [20.5 kB] 2020-01-16T05:41:18.882 INFO:teuthology.orchestra.run.smithi084.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.0.0-9376-g0771362-1bionic [118 kB] 2020-01-16T05:41:18.882 INFO:teuthology.orchestra.run.smithi084.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.0.0-9376-g0771362-1bionic [18.4 kB] 2020-01-16T05:41:18.885 INFO:teuthology.orchestra.run.smithi084.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.0.0-9376-g0771362-1bionic [276 kB] 2020-01-16T05:41:18.886 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2020-01-16T05:41:18.892 INFO:teuthology.orchestra.run.smithi084.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.0.0-9376-g0771362-1bionic [4,622 kB] 2020-01-16T05:41:18.894 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2020-01-16T05:41:18.928 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2020-01-16T05:41:18.933 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-01-16T05:41:18.943 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.0.0-9376-g0771362-1bionic [432 kB] 2020-01-16T05:41:18.977 INFO:teuthology.orchestra.run.smithi142.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.0.0-9376-g0771362-1bionic [331 kB] 2020-01-16T05:41:18.987 INFO:teuthology.orchestra.run.smithi084.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2020-01-16T05:41:18.995 INFO:teuthology.orchestra.run.smithi084.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-01-16T05:41:19.009 INFO:teuthology.orchestra.run.smithi142.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.0.0-9376-g0771362-1bionic [20.5 kB] 2020-01-16T05:41:19.009 INFO:teuthology.orchestra.run.smithi142.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.0.0-9376-g0771362-1bionic [118 kB] 2020-01-16T05:41:19.010 INFO:teuthology.orchestra.run.smithi084.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2020-01-16T05:41:19.015 INFO:teuthology.orchestra.run.smithi142.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.0.0-9376-g0771362-1bionic [18.4 kB] 2020-01-16T05:41:19.015 INFO:teuthology.orchestra.run.smithi142.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.0.0-9376-g0771362-1bionic [276 kB] 2020-01-16T05:41:19.046 INFO:teuthology.orchestra.run.smithi142.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.0.0-9376-g0771362-1bionic [4,622 kB] 2020-01-16T05:41:19.067 INFO:teuthology.orchestra.run.smithi142.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2020-01-16T05:41:19.077 INFO:teuthology.orchestra.run.smithi142.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-01-16T05:41:19.090 INFO:teuthology.orchestra.run.smithi142.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2020-01-16T05:41:19.095 INFO:teuthology.orchestra.run.smithi084.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-01-16T05:41:19.098 INFO:teuthology.orchestra.run.smithi084.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-01-16T05:41:19.130 INFO:teuthology.orchestra.run.smithi084.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-01-16T05:41:19.130 INFO:teuthology.orchestra.run.smithi084.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2020-01-16T05:41:19.138 INFO:teuthology.orchestra.run.smithi084.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2020-01-16T05:41:19.142 INFO:teuthology.orchestra.run.smithi084.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2020-01-16T05:41:19.163 INFO:teuthology.orchestra.run.smithi084.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2020-01-16T05:41:19.164 INFO:teuthology.orchestra.run.smithi084.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2020-01-16T05:41:19.172 INFO:teuthology.orchestra.run.smithi142.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-01-16T05:41:19.173 INFO:teuthology.orchestra.run.smithi084.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.3 [221 kB] 2020-01-16T05:41:19.174 INFO:teuthology.orchestra.run.smithi084.stdout:Get:27 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.0.0-9376-g0771362-1bionic [99.3 kB] 2020-01-16T05:41:19.175 INFO:teuthology.orchestra.run.smithi142.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-01-16T05:41:19.177 INFO:teuthology.orchestra.run.smithi084.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.0.0-9376-g0771362-1bionic [334 kB] 2020-01-16T05:41:19.206 INFO:teuthology.orchestra.run.smithi142.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-01-16T05:41:19.207 INFO:teuthology.orchestra.run.smithi142.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2020-01-16T05:41:19.211 INFO:teuthology.orchestra.run.smithi084.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.0.0-9376-g0771362-1bionic [18.0 MB] 2020-01-16T05:41:19.217 INFO:teuthology.orchestra.run.smithi142.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2020-01-16T05:41:19.221 INFO:teuthology.orchestra.run.smithi142.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2020-01-16T05:41:19.231 INFO:teuthology.orchestra.run.smithi084.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2020-01-16T05:41:19.233 INFO:teuthology.orchestra.run.smithi084.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2020-01-16T05:41:19.235 INFO:teuthology.orchestra.run.smithi084.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2020-01-16T05:41:19.235 INFO:teuthology.orchestra.run.smithi084.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2020-01-16T05:41:19.240 INFO:teuthology.orchestra.run.smithi142.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2020-01-16T05:41:19.242 INFO:teuthology.orchestra.run.smithi142.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2020-01-16T05:41:19.250 INFO:teuthology.orchestra.run.smithi142.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.3 [221 kB] 2020-01-16T05:41:19.310 INFO:teuthology.orchestra.run.smithi142.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2020-01-16T05:41:19.312 INFO:teuthology.orchestra.run.smithi142.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2020-01-16T05:41:19.313 INFO:teuthology.orchestra.run.smithi142.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2020-01-16T05:41:19.314 INFO:teuthology.orchestra.run.smithi142.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2020-01-16T05:41:19.358 INFO:teuthology.orchestra.run.smithi142.stdout:Get:31 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.0.0-9376-g0771362-1bionic [99.3 kB] 2020-01-16T05:41:19.361 INFO:teuthology.orchestra.run.smithi142.stdout:Get:32 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.0.0-9376-g0771362-1bionic [334 kB] 2020-01-16T05:41:19.399 INFO:teuthology.orchestra.run.smithi084.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2020-01-16T05:41:19.402 INFO:teuthology.orchestra.run.smithi142.stdout:Get:33 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.0.0-9376-g0771362-1bionic [18.0 MB] 2020-01-16T05:41:19.480 INFO:teuthology.orchestra.run.smithi142.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2020-01-16T05:41:19.480 INFO:teuthology.orchestra.run.smithi084.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2020-01-16T05:41:19.493 INFO:teuthology.orchestra.run.smithi084.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-01-16T05:41:19.597 INFO:teuthology.orchestra.run.smithi142.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2020-01-16T05:41:19.613 INFO:teuthology.orchestra.run.smithi142.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-01-16T05:41:19.644 INFO:teuthology.orchestra.run.smithi084.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2020-01-16T05:41:19.718 INFO:teuthology.orchestra.run.smithi084.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2020-01-16T05:41:19.753 INFO:teuthology.orchestra.run.smithi084.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2020-01-16T05:41:19.760 INFO:teuthology.orchestra.run.smithi084.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-01-16T05:41:19.775 INFO:teuthology.orchestra.run.smithi142.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2020-01-16T05:41:19.845 INFO:teuthology.orchestra.run.smithi142.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2020-01-16T05:41:19.879 INFO:teuthology.orchestra.run.smithi142.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2020-01-16T05:41:19.886 INFO:teuthology.orchestra.run.smithi142.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-01-16T05:41:19.896 INFO:teuthology.orchestra.run.smithi084.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-01-16T05:41:19.896 INFO:teuthology.orchestra.run.smithi084.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2020-01-16T05:41:19.899 INFO:teuthology.orchestra.run.smithi084.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2020-01-16T05:41:19.903 INFO:teuthology.orchestra.run.smithi084.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2020-01-16T05:41:19.916 INFO:teuthology.orchestra.run.smithi084.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-01-16T05:41:19.939 INFO:teuthology.orchestra.run.smithi084.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2020-01-16T05:41:19.940 INFO:teuthology.orchestra.run.smithi084.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2020-01-16T05:41:19.944 INFO:teuthology.orchestra.run.smithi084.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2020-01-16T05:41:20.013 INFO:teuthology.orchestra.run.smithi142.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-01-16T05:41:20.014 INFO:teuthology.orchestra.run.smithi142.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2020-01-16T05:41:20.016 INFO:teuthology.orchestra.run.smithi142.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2020-01-16T05:41:20.021 INFO:teuthology.orchestra.run.smithi142.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2020-01-16T05:41:20.034 INFO:teuthology.orchestra.run.smithi142.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-01-16T05:41:20.058 INFO:teuthology.orchestra.run.smithi142.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2020-01-16T05:41:20.058 INFO:teuthology.orchestra.run.smithi142.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2020-01-16T05:41:20.062 INFO:teuthology.orchestra.run.smithi142.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2020-01-16T05:41:20.068 INFO:teuthology.orchestra.run.smithi084.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2020-01-16T05:41:20.069 INFO:teuthology.orchestra.run.smithi084.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2020-01-16T05:41:20.186 INFO:teuthology.orchestra.run.smithi142.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2020-01-16T05:41:20.186 INFO:teuthology.orchestra.run.smithi142.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2020-01-16T05:41:20.315 INFO:teuthology.orchestra.run.smithi084.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.0.0-9376-g0771362-1bionic [5,125 kB] 2020-01-16T05:41:20.328 INFO:teuthology.orchestra.run.smithi084.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2020-01-16T05:41:20.372 INFO:teuthology.orchestra.run.smithi084.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2020-01-16T05:41:20.373 INFO:teuthology.orchestra.run.smithi084.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2020-01-16T05:41:20.410 INFO:teuthology.orchestra.run.smithi084.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2020-01-16T05:41:20.452 INFO:teuthology.orchestra.run.smithi142.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2020-01-16T05:41:20.498 INFO:teuthology.orchestra.run.smithi142.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2020-01-16T05:41:20.499 INFO:teuthology.orchestra.run.smithi142.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2020-01-16T05:41:20.536 INFO:teuthology.orchestra.run.smithi142.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2020-01-16T05:41:20.574 INFO:teuthology.orchestra.run.smithi084.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2020-01-16T05:41:20.645 INFO:teuthology.orchestra.run.smithi142.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.0.0-9376-g0771362-1bionic [5,125 kB] 2020-01-16T05:41:20.646 INFO:teuthology.orchestra.run.smithi084.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.0.0-9376-g0771362-1bionic [1,394 kB] 2020-01-16T05:41:20.653 INFO:teuthology.orchestra.run.smithi084.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2020-01-16T05:41:20.665 INFO:teuthology.orchestra.run.smithi084.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.1 [28.6 kB] 2020-01-16T05:41:20.699 INFO:teuthology.orchestra.run.smithi142.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2020-01-16T05:41:20.729 INFO:teuthology.orchestra.run.smithi084.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.0.0-9376-g0771362-1bionic [5,932 kB] 2020-01-16T05:41:20.764 INFO:teuthology.orchestra.run.smithi084.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2020-01-16T05:41:20.799 INFO:teuthology.orchestra.run.smithi142.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2020-01-16T05:41:20.843 INFO:teuthology.orchestra.run.smithi084.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2020-01-16T05:41:20.845 INFO:teuthology.orchestra.run.smithi142.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.1 [28.6 kB] 2020-01-16T05:41:20.886 INFO:teuthology.orchestra.run.smithi084.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2020-01-16T05:41:20.905 INFO:teuthology.orchestra.run.smithi084.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2020-01-16T05:41:20.949 INFO:teuthology.orchestra.run.smithi142.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2020-01-16T05:41:21.016 INFO:teuthology.orchestra.run.smithi142.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.0.0-9376-g0771362-1bionic [1,394 kB] 2020-01-16T05:41:21.019 INFO:teuthology.orchestra.run.smithi142.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2020-01-16T05:41:21.064 INFO:teuthology.orchestra.run.smithi142.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2020-01-16T05:41:21.080 INFO:teuthology.orchestra.run.smithi142.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2020-01-16T05:41:21.097 INFO:teuthology.orchestra.run.smithi084.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.0.0-9376-g0771362-1bionic [22.7 MB] 2020-01-16T05:41:21.102 INFO:teuthology.orchestra.run.smithi084.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2020-01-16T05:41:21.103 INFO:teuthology.orchestra.run.smithi142.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.0.0-9376-g0771362-1bionic [5,932 kB] 2020-01-16T05:41:21.111 INFO:teuthology.orchestra.run.smithi084.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2020-01-16T05:41:21.139 INFO:teuthology.orchestra.run.smithi084.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-01-16T05:41:21.142 INFO:teuthology.orchestra.run.smithi084.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-01-16T05:41:21.159 INFO:teuthology.orchestra.run.smithi084.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-01-16T05:41:21.168 INFO:teuthology.orchestra.run.smithi084.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-01-16T05:41:21.176 INFO:teuthology.orchestra.run.smithi084.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-01-16T05:41:21.180 INFO:teuthology.orchestra.run.smithi084.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-01-16T05:41:21.201 INFO:teuthology.orchestra.run.smithi084.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-01-16T05:41:21.210 INFO:teuthology.orchestra.run.smithi084.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-01-16T05:41:21.264 INFO:teuthology.orchestra.run.smithi084.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2020-01-16T05:41:21.265 INFO:teuthology.orchestra.run.smithi084.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-01-16T05:41:21.265 INFO:teuthology.orchestra.run.smithi084.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-01-16T05:41:21.269 INFO:teuthology.orchestra.run.smithi142.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2020-01-16T05:41:21.277 INFO:teuthology.orchestra.run.smithi142.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2020-01-16T05:41:21.305 INFO:teuthology.orchestra.run.smithi142.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-01-16T05:41:21.308 INFO:teuthology.orchestra.run.smithi142.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-01-16T05:41:21.324 INFO:teuthology.orchestra.run.smithi142.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-01-16T05:41:21.335 INFO:teuthology.orchestra.run.smithi142.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-01-16T05:41:21.344 INFO:teuthology.orchestra.run.smithi142.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-01-16T05:41:21.347 INFO:teuthology.orchestra.run.smithi142.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-01-16T05:41:21.369 INFO:teuthology.orchestra.run.smithi142.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-01-16T05:41:21.376 INFO:teuthology.orchestra.run.smithi142.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-01-16T05:41:21.427 INFO:teuthology.orchestra.run.smithi084.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-01-16T05:41:21.428 INFO:teuthology.orchestra.run.smithi084.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-01-16T05:41:21.432 INFO:teuthology.orchestra.run.smithi142.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2020-01-16T05:41:21.433 INFO:teuthology.orchestra.run.smithi142.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-01-16T05:41:21.434 INFO:teuthology.orchestra.run.smithi142.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-01-16T05:41:21.516 INFO:teuthology.orchestra.run.smithi142.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.0.0-9376-g0771362-1bionic [22.7 MB] 2020-01-16T05:41:21.598 INFO:teuthology.orchestra.run.smithi142.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-01-16T05:41:21.641 INFO:teuthology.orchestra.run.smithi142.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-01-16T05:41:21.651 INFO:teuthology.orchestra.run.smithi084.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-01-16T05:41:21.775 INFO:teuthology.orchestra.run.smithi084.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2020-01-16T05:41:21.787 INFO:teuthology.orchestra.run.smithi084.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2020-01-16T05:41:21.791 INFO:teuthology.orchestra.run.smithi084.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2020-01-16T05:41:21.795 INFO:teuthology.orchestra.run.smithi084.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2020-01-16T05:41:21.829 INFO:teuthology.orchestra.run.smithi084.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2020-01-16T05:41:21.839 INFO:teuthology.orchestra.run.smithi142.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-01-16T05:41:21.951 INFO:teuthology.orchestra.run.smithi142.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2020-01-16T05:41:21.964 INFO:teuthology.orchestra.run.smithi142.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2020-01-16T05:41:21.968 INFO:teuthology.orchestra.run.smithi142.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2020-01-16T05:41:21.972 INFO:teuthology.orchestra.run.smithi142.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2020-01-16T05:41:21.998 INFO:teuthology.orchestra.run.smithi084.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2020-01-16T05:41:21.999 INFO:teuthology.orchestra.run.smithi084.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2020-01-16T05:41:22.002 INFO:teuthology.orchestra.run.smithi142.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2020-01-16T05:41:22.159 INFO:teuthology.orchestra.run.smithi084.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2020-01-16T05:41:22.160 INFO:teuthology.orchestra.run.smithi084.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2020-01-16T05:41:22.161 INFO:teuthology.orchestra.run.smithi084.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pil amd64 5.1.0-1 [328 kB] 2020-01-16T05:41:22.166 INFO:teuthology.orchestra.run.smithi142.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2020-01-16T05:41:22.167 INFO:teuthology.orchestra.run.smithi084.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2020-01-16T05:41:22.167 INFO:teuthology.orchestra.run.smithi084.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2020-01-16T05:41:22.168 INFO:teuthology.orchestra.run.smithi084.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2020-01-16T05:41:22.168 INFO:teuthology.orchestra.run.smithi084.stdout:Get:95 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2020-01-16T05:41:22.168 INFO:teuthology.orchestra.run.smithi142.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2020-01-16T05:41:22.170 INFO:teuthology.orchestra.run.smithi084.stdout:Get:96 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2020-01-16T05:41:22.171 INFO:teuthology.orchestra.run.smithi084.stdout:Get:97 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2020-01-16T05:41:22.323 INFO:teuthology.orchestra.run.smithi142.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2020-01-16T05:41:22.323 INFO:teuthology.orchestra.run.smithi142.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2020-01-16T05:41:22.324 INFO:teuthology.orchestra.run.smithi142.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pil amd64 5.1.0-1 [328 kB] 2020-01-16T05:41:22.333 INFO:teuthology.orchestra.run.smithi142.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2020-01-16T05:41:22.333 INFO:teuthology.orchestra.run.smithi142.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2020-01-16T05:41:22.334 INFO:teuthology.orchestra.run.smithi142.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2020-01-16T05:41:22.334 INFO:teuthology.orchestra.run.smithi142.stdout:Get:95 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2020-01-16T05:41:22.337 INFO:teuthology.orchestra.run.smithi142.stdout:Get:96 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2020-01-16T05:41:22.338 INFO:teuthology.orchestra.run.smithi142.stdout:Get:97 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2020-01-16T05:41:22.482 INFO:teuthology.orchestra.run.smithi084.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.0.0-9376-g0771362-1bionic [3,804 B] 2020-01-16T05:41:22.483 INFO:teuthology.orchestra.run.smithi084.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.0.0-9376-g0771362-1bionic [512 kB] 2020-01-16T05:41:22.528 INFO:teuthology.orchestra.run.smithi084.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.0.0-9376-g0771362-1bionic [1,832 kB] 2020-01-16T05:41:22.625 INFO:teuthology.orchestra.run.smithi084.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.0.0-9376-g0771362-1bionic [24.0 kB] 2020-01-16T05:41:22.626 INFO:teuthology.orchestra.run.smithi084.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.0.0-9376-g0771362-1bionic [19.8 kB] 2020-01-16T05:41:22.627 INFO:teuthology.orchestra.run.smithi084.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.0.0-9376-g0771362-1bionic [3,415 kB] 2020-01-16T05:41:22.845 INFO:teuthology.orchestra.run.smithi084.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.0.0-9376-g0771362-1bionic [34.2 kB] 2020-01-16T05:41:22.846 INFO:teuthology.orchestra.run.smithi084.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.0.0-9376-g0771362-1bionic [7,887 kB] 2020-01-16T05:41:23.112 INFO:teuthology.orchestra.run.smithi142.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.0.0-9376-g0771362-1bionic [3,804 B] 2020-01-16T05:41:23.113 INFO:teuthology.orchestra.run.smithi142.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.0.0-9376-g0771362-1bionic [512 kB] 2020-01-16T05:41:23.140 INFO:teuthology.orchestra.run.smithi142.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.0.0-9376-g0771362-1bionic [1,832 kB] 2020-01-16T05:41:23.267 INFO:teuthology.orchestra.run.smithi142.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.0.0-9376-g0771362-1bionic [24.0 kB] 2020-01-16T05:41:23.276 INFO:teuthology.orchestra.run.smithi142.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.0.0-9376-g0771362-1bionic [19.8 kB] 2020-01-16T05:41:23.276 INFO:teuthology.orchestra.run.smithi142.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.0.0-9376-g0771362-1bionic [3,415 kB] 2020-01-16T05:41:23.321 INFO:teuthology.orchestra.run.smithi084.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.0.0-9376-g0771362-1bionic [3,924 B] 2020-01-16T05:41:23.321 INFO:teuthology.orchestra.run.smithi084.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.0.0-9376-g0771362-1bionic [13.4 kB] 2020-01-16T05:41:23.322 INFO:teuthology.orchestra.run.smithi084.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.0.0-9376-g0771362-1bionic [41.5 MB] 2020-01-16T05:41:23.512 INFO:teuthology.orchestra.run.smithi142.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.0.0-9376-g0771362-1bionic [34.2 kB] 2020-01-16T05:41:23.514 INFO:teuthology.orchestra.run.smithi142.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.0.0-9376-g0771362-1bionic [7,887 kB] 2020-01-16T05:41:24.076 INFO:teuthology.orchestra.run.smithi142.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.0.0-9376-g0771362-1bionic [3,924 B] 2020-01-16T05:41:24.077 INFO:teuthology.orchestra.run.smithi142.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.0.0-9376-g0771362-1bionic [13.4 kB] 2020-01-16T05:41:24.077 INFO:teuthology.orchestra.run.smithi142.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.0.0-9376-g0771362-1bionic [41.5 MB] 2020-01-16T05:41:25.659 INFO:teuthology.orchestra.run.smithi084.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 15.0.0-9376-g0771362-1bionic [15.3 kB] 2020-01-16T05:41:25.659 INFO:teuthology.orchestra.run.smithi084.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.0.0-9376-g0771362-1bionic [17.3 kB] 2020-01-16T05:41:25.659 INFO:teuthology.orchestra.run.smithi084.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.0.0-9376-g0771362-1bionic [5,510 kB] 2020-01-16T05:41:25.952 INFO:teuthology.orchestra.run.smithi084.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.0.0-9376-g0771362-1bionic [62.2 kB] 2020-01-16T05:41:26.591 INFO:teuthology.orchestra.run.smithi142.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 15.0.0-9376-g0771362-1bionic [15.3 kB] 2020-01-16T05:41:26.591 INFO:teuthology.orchestra.run.smithi142.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.0.0-9376-g0771362-1bionic [17.3 kB] 2020-01-16T05:41:26.591 INFO:teuthology.orchestra.run.smithi142.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.0.0-9376-g0771362-1bionic [5,510 kB] 2020-01-16T05:41:26.650 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 151 MB in 8s (19.9 MB/s) 2020-01-16T05:41:26.765 INFO:teuthology.orchestra.run.smithi142.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200116.003219/07713629e135b47dc5ec2a85f60649826e17a6cd/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.0.0-9376-g0771362-1bionic [62.2 kB] 2020-01-16T05:41:26.792 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyparsing. 2020-01-16T05:41:26.846 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137449 files and directories currently installed.) 2020-01-16T05:41:26.846 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../000-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2020-01-16T05:41:26.890 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2020-01-16T05:41:27.162 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyperclip. 2020-01-16T05:41:27.173 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../001-python3-pyperclip_1.6.0-1_all.deb ... 2020-01-16T05:41:27.209 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2020-01-16T05:41:27.446 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cmd2. 2020-01-16T05:41:27.457 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 151 MB in 8s (18.1 MB/s) 2020-01-16T05:41:27.462 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../002-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2020-01-16T05:41:27.496 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2020-01-16T05:41:27.577 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyparsing. 2020-01-16T05:41:27.626 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137449 files and directories currently installed.) 2020-01-16T05:41:27.629 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../000-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2020-01-16T05:41:27.659 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2020-01-16T05:41:27.798 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-uritemplate. 2020-01-16T05:41:27.812 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../003-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2020-01-16T05:41:27.848 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2020-01-16T05:41:27.995 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyperclip. 2020-01-16T05:41:28.009 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../001-python3-pyperclip_1.6.0-1_all.deb ... 2020-01-16T05:41:28.053 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2020-01-16T05:41:28.142 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-01-16T05:41:28.157 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-01-16T05:41:28.226 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-01-16T05:41:28.356 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cmd2. 2020-01-16T05:41:28.373 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../002-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2020-01-16T05:41:28.406 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2020-01-16T05:41:28.543 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../005-librbd1_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:28.663 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librbd1 (15.0.0-9376-g0771362-1bionic) over (12.2.12-0ubuntu0.18.04.3) ... 2020-01-16T05:41:28.725 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-uritemplate. 2020-01-16T05:41:28.740 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../003-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2020-01-16T05:41:28.784 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2020-01-16T05:41:29.114 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-01-16T05:41:29.130 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-01-16T05:41:29.190 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../006-librados2_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:29.211 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-01-16T05:41:29.317 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librados2 (15.0.0-9376-g0771362-1bionic) over (12.2.12-0ubuntu0.18.04.3) ... 2020-01-16T05:41:29.545 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../005-librbd1_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:29.673 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librbd1 (15.0.0-9376-g0771362-1bionic) over (12.2.12-0ubuntu0.18.04.3) ... 2020-01-16T05:41:29.912 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libcephfs2. 2020-01-16T05:41:29.926 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../007-libcephfs2_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:29.971 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libcephfs2 (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:30.176 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../006-librados2_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:30.265 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rados. 2020-01-16T05:41:30.278 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../008-python3-rados_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:30.312 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librados2 (15.0.0-9376-g0771362-1bionic) over (12.2.12-0ubuntu0.18.04.3) ... 2020-01-16T05:41:30.323 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rados (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:30.667 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-01-16T05:41:30.681 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../009-python3-ceph-argparse_15.0.0-9376-g0771362-1bionic_all.deb ... 2020-01-16T05:41:30.725 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-ceph-argparse (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:30.897 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libcephfs2. 2020-01-16T05:41:30.910 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../007-libcephfs2_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:30.955 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libcephfs2 (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:30.987 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cephfs. 2020-01-16T05:41:30.999 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../010-python3-cephfs_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:31.028 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cephfs (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:31.258 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rados. 2020-01-16T05:41:31.271 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../008-python3-rados_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:31.300 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rados (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:31.364 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-ceph-common. 2020-01-16T05:41:31.378 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../011-python3-ceph-common_15.0.0-9376-g0771362-1bionic_all.deb ... 2020-01-16T05:41:31.422 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-ceph-common (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:31.644 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-01-16T05:41:31.659 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../009-python3-ceph-argparse_15.0.0-9376-g0771362-1bionic_all.deb ... 2020-01-16T05:41:31.702 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-ceph-argparse (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:31.733 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-prettytable. 2020-01-16T05:41:31.747 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-3_all.deb ... 2020-01-16T05:41:31.784 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2020-01-16T05:41:31.996 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cephfs. 2020-01-16T05:41:32.009 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../010-python3-cephfs_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:32.019 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rbd. 2020-01-16T05:41:32.032 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../013-python3-rbd_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:32.046 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cephfs (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:32.078 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rbd (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:32.382 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-ceph-common. 2020-01-16T05:41:32.396 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../011-python3-ceph-common_15.0.0-9376-g0771362-1bionic_all.deb ... 2020-01-16T05:41:32.431 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-01-16T05:41:32.441 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-ceph-common (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:32.444 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-01-16T05:41:32.472 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-01-16T05:41:32.719 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-prettytable. 2020-01-16T05:41:32.731 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-3_all.deb ... 2020-01-16T05:41:32.760 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2020-01-16T05:41:32.800 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-01-16T05:41:32.814 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2020-01-16T05:41:32.858 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2020-01-16T05:41:33.004 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rbd. 2020-01-16T05:41:33.019 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../013-python3-rbd_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:33.062 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rbd (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:33.186 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librgw2. 2020-01-16T05:41:33.201 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../016-librgw2_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:33.270 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librgw2 (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:33.415 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-01-16T05:41:33.429 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-01-16T05:41:33.466 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-01-16T05:41:33.768 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-01-16T05:41:33.783 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2020-01-16T05:41:33.818 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2020-01-16T05:41:33.880 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rgw. 2020-01-16T05:41:33.896 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../017-python3-rgw_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:33.930 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rgw (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:34.112 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librgw2. 2020-01-16T05:41:34.127 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../016-librgw2_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:34.171 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librgw2 (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:34.233 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-01-16T05:41:34.246 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-01-16T05:41:34.291 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-01-16T05:41:34.585 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-01-16T05:41:34.599 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2020-01-16T05:41:34.635 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-01-16T05:41:34.798 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rgw. 2020-01-16T05:41:34.811 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../017-python3-rgw_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:34.848 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rgw (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:35.013 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liboath0. 2020-01-16T05:41:35.027 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2020-01-16T05:41:35.063 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-01-16T05:41:35.217 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-01-16T05:41:35.232 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-01-16T05:41:35.276 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-01-16T05:41:35.324 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libradosstriper1. 2020-01-16T05:41:35.338 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../021-libradosstriper1_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:35.382 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libradosstriper1 (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:35.520 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-01-16T05:41:35.535 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2020-01-16T05:41:35.571 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-01-16T05:41:35.819 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-common. 2020-01-16T05:41:35.834 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../022-ceph-common_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:35.877 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-common (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:35.939 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liboath0. 2020-01-16T05:41:35.953 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2020-01-16T05:41:35.989 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-01-16T05:41:36.317 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libradosstriper1. 2020-01-16T05:41:36.331 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../021-libradosstriper1_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:36.375 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libradosstriper1 (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:36.762 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-common. 2020-01-16T05:41:36.775 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../022-ceph-common_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:36.803 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-common (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:37.482 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-base. 2020-01-16T05:41:37.497 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../023-ceph-base_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:37.541 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-base (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:38.328 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cffi-backend. 2020-01-16T05:41:38.342 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../024-python3-cffi-backend_1.11.5-1_amd64.deb ... 2020-01-16T05:41:38.387 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2020-01-16T05:41:38.642 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-base. 2020-01-16T05:41:38.656 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../023-ceph-base_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:38.697 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-bcrypt. 2020-01-16T05:41:38.709 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-base (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:38.710 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.4-2_amd64.deb ... 2020-01-16T05:41:38.747 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2020-01-16T05:41:39.066 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cherrypy3. 2020-01-16T05:41:39.086 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-2_all.deb ... 2020-01-16T05:41:39.124 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2020-01-16T05:41:39.486 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jwt. 2020-01-16T05:41:39.505 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../027-python3-jwt_1.5.3+ds1-1_all.deb ... 2020-01-16T05:41:39.544 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2020-01-16T05:41:39.571 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cffi-backend. 2020-01-16T05:41:39.584 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../024-python3-cffi-backend_1.11.5-1_amd64.deb ... 2020-01-16T05:41:39.613 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2020-01-16T05:41:39.855 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-asn1crypto. 2020-01-16T05:41:39.870 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../028-python3-asn1crypto_0.24.0-1_all.deb ... 2020-01-16T05:41:39.914 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2020-01-16T05:41:39.924 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-bcrypt. 2020-01-16T05:41:39.937 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.4-2_amd64.deb ... 2020-01-16T05:41:39.976 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2020-01-16T05:41:40.250 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cryptography. 2020-01-16T05:41:40.265 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../029-python3-cryptography_2.1.4-1ubuntu1.3_amd64.deb ... 2020-01-16T05:41:40.301 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cherrypy3. 2020-01-16T05:41:40.308 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-01-16T05:41:40.314 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-2_all.deb ... 2020-01-16T05:41:40.351 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2020-01-16T05:41:40.695 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-openssl. 2020-01-16T05:41:40.710 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../030-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2020-01-16T05:41:40.738 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jwt. 2020-01-16T05:41:40.759 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../027-python3-jwt_1.5.3+ds1-1_all.deb ... 2020-01-16T05:41:40.759 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2020-01-16T05:41:40.796 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2020-01-16T05:41:41.072 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-logutils. 2020-01-16T05:41:41.086 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../031-python3-logutils_0.3.3-5_all.deb ... 2020-01-16T05:41:41.107 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-asn1crypto. 2020-01-16T05:41:41.121 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../028-python3-asn1crypto_0.24.0-1_all.deb ... 2020-01-16T05:41:41.131 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-logutils (0.3.3-5) ... 2020-01-16T05:41:41.174 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2020-01-16T05:41:41.502 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cryptography. 2020-01-16T05:41:41.516 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../029-python3-cryptography_2.1.4-1ubuntu1.3_amd64.deb ... 2020-01-16T05:41:41.585 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-01-16T05:41:41.601 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-markupsafe. 2020-01-16T05:41:41.618 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../032-python3-markupsafe_1.0-1build1_amd64.deb ... 2020-01-16T05:41:41.708 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2020-01-16T05:41:41.930 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-openssl. 2020-01-16T05:41:41.946 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../030-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2020-01-16T05:41:41.969 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-mako. 2020-01-16T05:41:41.984 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../033-python3-mako_1.0.7+ds1-1_all.deb ... 2020-01-16T05:41:41.988 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2020-01-16T05:41:42.019 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2020-01-16T05:41:42.316 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-logutils. 2020-01-16T05:41:42.331 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-simplegeneric. 2020-01-16T05:41:42.331 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../031-python3-logutils_0.3.3-5_all.deb ... 2020-01-16T05:41:42.345 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../034-python3-simplegeneric_0.8.1-1_all.deb ... 2020-01-16T05:41:42.383 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-logutils (0.3.3-5) ... 2020-01-16T05:41:42.389 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2020-01-16T05:41:42.683 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-singledispatch. 2020-01-16T05:41:42.693 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-markupsafe. 2020-01-16T05:41:42.697 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../035-python3-singledispatch_3.4.0.3-2_all.deb ... 2020-01-16T05:41:42.708 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../032-python3-markupsafe_1.0-1build1_amd64.deb ... 2020-01-16T05:41:42.741 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2020-01-16T05:41:42.751 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2020-01-16T05:41:43.027 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-webob. 2020-01-16T05:41:43.042 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../036-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-01-16T05:41:43.055 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-mako. 2020-01-16T05:41:43.068 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../033-python3-mako_1.0.7+ds1-1_all.deb ... 2020-01-16T05:41:43.085 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2020-01-16T05:41:43.112 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2020-01-16T05:41:43.388 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-bs4. 2020-01-16T05:41:43.401 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../037-python3-bs4_4.6.0-1_all.deb ... 2020-01-16T05:41:43.406 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-simplegeneric. 2020-01-16T05:41:43.422 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../034-python3-simplegeneric_0.8.1-1_all.deb ... 2020-01-16T05:41:43.438 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2020-01-16T05:41:43.465 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2020-01-16T05:41:43.733 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-waitress. 2020-01-16T05:41:43.746 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../038-python3-waitress_1.0.1-1_all.deb ... 2020-01-16T05:41:43.776 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-singledispatch. 2020-01-16T05:41:43.783 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-waitress (1.0.1-1) ... 2020-01-16T05:41:43.789 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../035-python3-singledispatch_3.4.0.3-2_all.deb ... 2020-01-16T05:41:43.826 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2020-01-16T05:41:44.084 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-tempita. 2020-01-16T05:41:44.098 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-2_all.deb ... 2020-01-16T05:41:44.137 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-tempita (0.5.2-2) ... 2020-01-16T05:41:44.145 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-webob. 2020-01-16T05:41:44.160 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../036-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-01-16T05:41:44.203 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2020-01-16T05:41:44.445 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-paste. 2020-01-16T05:41:44.458 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../040-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-01-16T05:41:44.503 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-16T05:41:44.531 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-bs4. 2020-01-16T05:41:44.545 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../037-python3-bs4_4.6.0-1_all.deb ... 2020-01-16T05:41:44.590 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2020-01-16T05:41:44.817 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-01-16T05:41:44.831 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-01-16T05:41:44.867 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-01-16T05:41:44.956 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-waitress. 2020-01-16T05:41:44.971 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../038-python3-waitress_1.0.1-1_all.deb ... 2020-01-16T05:41:45.015 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-waitress (1.0.1-1) ... 2020-01-16T05:41:45.173 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pastedeploy. 2020-01-16T05:41:45.186 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../042-python3-pastedeploy_1.5.2-4_all.deb ... 2020-01-16T05:41:45.223 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2020-01-16T05:41:45.369 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-tempita. 2020-01-16T05:41:45.382 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-2_all.deb ... 2020-01-16T05:41:45.419 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-tempita (0.5.2-2) ... 2020-01-16T05:41:45.546 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-webtest. 2020-01-16T05:41:45.559 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../043-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2020-01-16T05:41:45.596 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2020-01-16T05:41:45.740 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-paste. 2020-01-16T05:41:45.753 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../040-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-01-16T05:41:45.791 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-16T05:41:45.934 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pecan. 2020-01-16T05:41:45.949 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../044-python3-pecan_1.2.1-2_all.deb ... 2020-01-16T05:41:45.992 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pecan (1.2.1-2) ... 2020-01-16T05:41:46.220 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-01-16T05:41:46.236 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-01-16T05:41:46.277 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-01-16T05:41:46.375 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-werkzeug. 2020-01-16T05:41:46.390 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../045-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-01-16T05:41:46.434 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2020-01-16T05:41:46.574 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pastedeploy. 2020-01-16T05:41:46.590 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../042-python3-pastedeploy_1.5.2-4_all.deb ... 2020-01-16T05:41:46.633 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2020-01-16T05:41:46.828 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr. 2020-01-16T05:41:46.839 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../046-ceph-mgr_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:46.876 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:46.945 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-webtest. 2020-01-16T05:41:46.958 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../043-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2020-01-16T05:41:46.995 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2020-01-16T05:41:47.330 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pecan. 2020-01-16T05:41:47.344 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../044-python3-pecan_1.2.1-2_all.deb ... 2020-01-16T05:41:47.386 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mon. 2020-01-16T05:41:47.388 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pecan (1.2.1-2) ... 2020-01-16T05:41:47.399 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../047-ceph-mon_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:47.446 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mon (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:47.721 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-werkzeug. 2020-01-16T05:41:47.734 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../045-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-01-16T05:41:47.771 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2020-01-16T05:41:48.137 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr. 2020-01-16T05:41:48.153 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../046-ceph-mgr_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:48.195 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:48.408 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-osd. 2020-01-16T05:41:48.423 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../048-ceph-osd_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:48.466 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-osd (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:48.697 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mon. 2020-01-16T05:41:48.710 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../047-ceph-mon_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:48.738 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mon (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:49.564 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-osd. 2020-01-16T05:41:49.578 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../048-ceph-osd_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:49.614 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-osd (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:50.307 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph. 2020-01-16T05:41:50.322 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../049-ceph_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:50.374 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:50.693 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-fuse. 2020-01-16T05:41:50.706 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../050-ceph-fuse_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:50.753 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-fuse (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:51.171 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mds. 2020-01-16T05:41:51.186 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../051-ceph-mds_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:51.238 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mds (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:52.358 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package cephadm. 2020-01-16T05:41:52.374 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../052-cephadm_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:52.416 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking cephadm (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:52.470 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph. 2020-01-16T05:41:52.486 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../049-ceph_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:52.529 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:52.710 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-01-16T05:41:52.726 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../053-ceph-mgr-cephadm_15.0.0-9376-g0771362-1bionic_all.deb ... 2020-01-16T05:41:52.769 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-cephadm (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:52.789 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-fuse. 2020-01-16T05:41:52.805 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../050-ceph-fuse_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:52.839 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-fuse (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:53.046 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-repoze.lru. 2020-01-16T05:41:53.062 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../054-python3-repoze.lru_0.7-1_all.deb ... 2020-01-16T05:41:53.104 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2020-01-16T05:41:53.234 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mds. 2020-01-16T05:41:53.250 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../051-ceph-mds_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:53.292 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mds (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:53.398 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-routes. 2020-01-16T05:41:53.415 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../055-python3-routes_2.4.1-1_all.deb ... 2020-01-16T05:41:53.465 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-routes (2.4.1-1) ... 2020-01-16T05:41:53.768 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-01-16T05:41:53.782 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_15.0.0-9376-g0771362-1bionic_all.deb ... 2020-01-16T05:41:53.812 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package cephadm. 2020-01-16T05:41:53.825 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../052-cephadm_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:41:53.826 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-dashboard (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:53.862 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking cephadm (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:54.123 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-01-16T05:41:54.136 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../053-ceph-mgr-cephadm_15.0.0-9376-g0771362-1bionic_all.deb ... 2020-01-16T05:41:54.165 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-cephadm (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:54.484 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-repoze.lru. 2020-01-16T05:41:54.497 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../054-python3-repoze.lru_0.7-1_all.deb ... 2020-01-16T05:41:54.534 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2020-01-16T05:41:54.743 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2020-01-16T05:41:54.763 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../057-ceph-mgr-diskprediction-cloud_15.0.0-9376-g0771362-1bionic_all.deb ... 2020-01-16T05:41:54.805 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:54.845 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-routes. 2020-01-16T05:41:54.858 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../055-python3-routes_2.4.1-1_all.deb ... 2020-01-16T05:41:54.920 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-routes (2.4.1-1) ... 2020-01-16T05:41:55.151 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-numpy. 2020-01-16T05:41:55.167 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../058-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2020-01-16T05:41:55.214 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2020-01-16T05:41:55.231 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-01-16T05:41:55.246 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_15.0.0-9376-g0771362-1bionic_all.deb ... 2020-01-16T05:41:55.298 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-dashboard (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:55.802 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-decorator. 2020-01-16T05:41:55.818 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../059-python3-decorator_4.1.2-1_all.deb ... 2020-01-16T05:41:55.861 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-decorator (4.1.2-1) ... 2020-01-16T05:41:56.180 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-scipy. 2020-01-16T05:41:56.194 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../060-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-01-16T05:41:56.218 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2020-01-16T05:41:56.234 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../057-ceph-mgr-diskprediction-cloud_15.0.0-9376-g0771362-1bionic_all.deb ... 2020-01-16T05:41:56.238 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2020-01-16T05:41:56.271 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:56.577 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-numpy. 2020-01-16T05:41:56.590 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../058-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2020-01-16T05:41:56.627 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2020-01-16T05:41:57.208 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-decorator. 2020-01-16T05:41:57.221 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../059-python3-decorator_4.1.2-1_all.deb ... 2020-01-16T05:41:57.266 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-decorator (4.1.2-1) ... 2020-01-16T05:41:57.466 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-01-16T05:41:57.481 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../061-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2020-01-16T05:41:57.524 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2020-01-16T05:41:57.560 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-scipy. 2020-01-16T05:41:57.569 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../060-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-01-16T05:41:57.610 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2020-01-16T05:41:58.002 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-joblib. 2020-01-16T05:41:58.019 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../062-python3-joblib_0.11-1_all.deb ... 2020-01-16T05:41:58.061 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-joblib (0.11-1) ... 2020-01-16T05:41:58.414 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-sklearn. 2020-01-16T05:41:58.429 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../063-python3-sklearn_0.19.1-3_all.deb ... 2020-01-16T05:41:58.472 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2020-01-16T05:41:58.760 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-01-16T05:41:58.774 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../061-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2020-01-16T05:41:58.826 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2020-01-16T05:41:59.012 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-01-16T05:41:59.028 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../064-ceph-mgr-diskprediction-local_15.0.0-9376-g0771362-1bionic_all.deb ... 2020-01-16T05:41:59.070 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-diskprediction-local (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:41:59.280 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-joblib. 2020-01-16T05:41:59.293 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../062-python3-joblib_0.11-1_all.deb ... 2020-01-16T05:41:59.338 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-joblib (0.11-1) ... 2020-01-16T05:41:59.683 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-sklearn. 2020-01-16T05:41:59.697 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../063-python3-sklearn_0.19.1-3_all.deb ... 2020-01-16T05:41:59.741 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2020-01-16T05:42:00.168 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-dateutil. 2020-01-16T05:42:00.182 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../065-python3-dateutil_2.6.1-1_all.deb ... 2020-01-16T05:42:00.223 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2020-01-16T05:42:00.289 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-01-16T05:42:00.303 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../064-ceph-mgr-diskprediction-local_15.0.0-9376-g0771362-1bionic_all.deb ... 2020-01-16T05:42:00.348 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-diskprediction-local (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:00.551 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-monotonic. 2020-01-16T05:42:00.565 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../066-python3-monotonic_1.1-2_all.deb ... 2020-01-16T05:42:00.609 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-monotonic (1.1-2) ... 2020-01-16T05:42:00.920 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-fasteners. 2020-01-16T05:42:00.934 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../067-python3-fasteners_0.12.0-3_all.deb ... 2020-01-16T05:42:00.978 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2020-01-16T05:42:01.282 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-httplib2. 2020-01-16T05:42:01.297 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../068-python3-httplib2_0.9.2+dfsg-1ubuntu0.1_all.deb ... 2020-01-16T05:42:01.340 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2020-01-16T05:42:01.442 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-dateutil. 2020-01-16T05:42:01.456 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../065-python3-dateutil_2.6.1-1_all.deb ... 2020-01-16T05:42:01.500 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2020-01-16T05:42:01.626 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyasn1. 2020-01-16T05:42:01.643 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../069-python3-pyasn1_0.4.2-3_all.deb ... 2020-01-16T05:42:01.684 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2020-01-16T05:42:01.871 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-monotonic. 2020-01-16T05:42:01.885 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../066-python3-monotonic_1.1-2_all.deb ... 2020-01-16T05:42:01.929 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-monotonic (1.1-2) ... 2020-01-16T05:42:02.046 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-01-16T05:42:02.063 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../070-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-01-16T05:42:02.104 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2020-01-16T05:42:02.232 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-fasteners. 2020-01-16T05:42:02.247 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../067-python3-fasteners_0.12.0-3_all.deb ... 2020-01-16T05:42:02.290 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2020-01-16T05:42:02.407 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rsa. 2020-01-16T05:42:02.423 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../071-python3-rsa_3.4.2-1_all.deb ... 2020-01-16T05:42:02.474 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rsa (3.4.2-1) ... 2020-01-16T05:42:02.593 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-httplib2. 2020-01-16T05:42:02.610 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../068-python3-httplib2_0.9.2+dfsg-1ubuntu0.1_all.deb ... 2020-01-16T05:42:02.673 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2020-01-16T05:42:02.785 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-sqlalchemy. 2020-01-16T05:42:02.801 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../072-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-01-16T05:42:02.843 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-01-16T05:42:02.963 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyasn1. 2020-01-16T05:42:02.977 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../069-python3-pyasn1_0.4.2-3_all.deb ... 2020-01-16T05:42:03.021 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2020-01-16T05:42:03.315 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-oauth2client. 2020-01-16T05:42:03.330 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../073-python3-oauth2client_4.1.2-3_all.deb ... 2020-01-16T05:42:03.358 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-01-16T05:42:03.373 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2020-01-16T05:42:03.373 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../070-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-01-16T05:42:03.416 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2020-01-16T05:42:03.709 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-setuptools. 2020-01-16T05:42:03.723 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../074-python3-setuptools_39.0.1-2_all.deb ... 2020-01-16T05:42:03.727 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rsa. 2020-01-16T05:42:03.743 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../071-python3-rsa_3.4.2-1_all.deb ... 2020-01-16T05:42:03.767 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2020-01-16T05:42:03.786 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rsa (3.4.2-1) ... 2020-01-16T05:42:04.114 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-sqlalchemy. 2020-01-16T05:42:04.130 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../072-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-01-16T05:42:04.170 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-websocket. 2020-01-16T05:42:04.180 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-01-16T05:42:04.185 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../075-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2020-01-16T05:42:04.229 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2020-01-16T05:42:04.582 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-kubernetes. 2020-01-16T05:42:04.597 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../076-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-01-16T05:42:04.626 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-oauth2client. 2020-01-16T05:42:04.641 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../073-python3-oauth2client_4.1.2-3_all.deb ... 2020-01-16T05:42:04.648 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2020-01-16T05:42:04.684 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2020-01-16T05:42:05.036 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-01-16T05:42:05.046 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-setuptools. 2020-01-16T05:42:05.050 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../077-ceph-mgr-k8sevents_15.0.0-9376-g0771362-1bionic_all.deb ... 2020-01-16T05:42:05.060 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../074-python3-setuptools_39.0.1-2_all.deb ... 2020-01-16T05:42:05.094 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-k8sevents (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:05.104 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2020-01-16T05:42:05.388 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-01-16T05:42:05.403 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../078-ceph-mgr-rook_15.0.0-9376-g0771362-1bionic_all.deb ... 2020-01-16T05:42:05.446 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-rook (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:05.508 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-websocket. 2020-01-16T05:42:05.524 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../075-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2020-01-16T05:42:05.566 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2020-01-16T05:42:05.774 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libonig4:amd64. 2020-01-16T05:42:05.790 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../079-libonig4_6.7.0-1_amd64.deb ... 2020-01-16T05:42:05.832 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-01-16T05:42:05.894 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-kubernetes. 2020-01-16T05:42:05.908 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../076-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-01-16T05:42:05.960 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2020-01-16T05:42:06.235 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libjq1:amd64. 2020-01-16T05:42:06.250 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../080-libjq1_1.5+dfsg-2_amd64.deb ... 2020-01-16T05:42:06.373 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-01-16T05:42:06.379 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-01-16T05:42:06.388 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../077-ceph-mgr-k8sevents_15.0.0-9376-g0771362-1bionic_all.deb ... 2020-01-16T05:42:06.431 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-k8sevents (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:06.649 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package jq. 2020-01-16T05:42:06.662 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../081-jq_1.5+dfsg-2_amd64.deb ... 2020-01-16T05:42:06.707 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-01-16T05:42:06.708 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-01-16T05:42:06.725 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../078-ceph-mgr-rook_15.0.0-9376-g0771362-1bionic_all.deb ... 2020-01-16T05:42:06.767 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-rook (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:06.968 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package socat. 2020-01-16T05:42:06.982 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../082-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-01-16T05:42:07.026 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-01-16T05:42:07.086 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libonig4:amd64. 2020-01-16T05:42:07.116 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../079-libonig4_6.7.0-1_amd64.deb ... 2020-01-16T05:42:07.144 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-01-16T05:42:07.421 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-01-16T05:42:07.437 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../083-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-01-16T05:42:07.479 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-01-16T05:42:07.531 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libjq1:amd64. 2020-01-16T05:42:07.547 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../080-libjq1_1.5+dfsg-2_amd64.deb ... 2020-01-16T05:42:07.675 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-01-16T05:42:07.766 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package xmlstarlet. 2020-01-16T05:42:07.783 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../084-xmlstarlet_1.6.1-2_amd64.deb ... 2020-01-16T05:42:07.824 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-01-16T05:42:07.952 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package jq. 2020-01-16T05:42:07.969 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../081-jq_1.5+dfsg-2_amd64.deb ... 2020-01-16T05:42:08.020 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-01-16T05:42:08.137 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-test. 2020-01-16T05:42:08.151 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../085-ceph-test_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:42:08.195 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-test (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:08.298 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package socat. 2020-01-16T05:42:08.311 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../082-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-01-16T05:42:08.355 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-01-16T05:42:08.775 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-01-16T05:42:08.789 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../083-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-01-16T05:42:08.842 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-01-16T05:42:09.128 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package xmlstarlet. 2020-01-16T05:42:09.144 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../084-xmlstarlet_1.6.1-2_amd64.deb ... 2020-01-16T05:42:09.186 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-01-16T05:42:09.549 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-test. 2020-01-16T05:42:09.564 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../085-ceph-test_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:42:09.607 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-test (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:11.340 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-colorama. 2020-01-16T05:42:11.355 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../086-python3-colorama_0.3.7-1_all.deb ... 2020-01-16T05:42:11.399 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-colorama (0.3.7-1) ... 2020-01-16T05:42:11.659 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package cephfs-shell. 2020-01-16T05:42:11.675 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../087-cephfs-shell_15.0.0-9376-g0771362-1bionic_all.deb ... 2020-01-16T05:42:11.726 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking cephfs-shell (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:11.970 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libcephfs-dev. 2020-01-16T05:42:11.985 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../088-libcephfs-dev_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:42:12.029 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libcephfs-dev (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:12.705 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-colorama. 2020-01-16T05:42:12.706 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-attr. 2020-01-16T05:42:12.718 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../086-python3-colorama_0.3.7-1_all.deb ... 2020-01-16T05:42:12.721 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../089-python-attr_17.4.0-2_all.deb ... 2020-01-16T05:42:12.763 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-colorama (0.3.7-1) ... 2020-01-16T05:42:12.764 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-attr (17.4.0-2) ... 2020-01-16T05:42:13.040 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package cephfs-shell. 2020-01-16T05:42:13.054 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../087-cephfs-shell_15.0.0-9376-g0771362-1bionic_all.deb ... 2020-01-16T05:42:13.075 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-funcsigs. 2020-01-16T05:42:13.092 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../090-python-funcsigs_1.0.2-4_all.deb ... 2020-01-16T05:42:13.098 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking cephfs-shell (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:13.134 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-01-16T05:42:13.334 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libcephfs-dev. 2020-01-16T05:42:13.349 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../088-libcephfs-dev_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:42:13.393 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libcephfs-dev (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:13.445 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-pluggy. 2020-01-16T05:42:13.461 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../091-python-pluggy_0.6.0-1_all.deb ... 2020-01-16T05:42:13.503 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-01-16T05:42:13.704 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-attr. 2020-01-16T05:42:13.719 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../089-python-attr_17.4.0-2_all.deb ... 2020-01-16T05:42:13.762 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-attr (17.4.0-2) ... 2020-01-16T05:42:13.798 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-py. 2020-01-16T05:42:13.811 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../092-python-py_1.5.2-1_all.deb ... 2020-01-16T05:42:13.848 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-py (1.5.2-1) ... 2020-01-16T05:42:14.048 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-funcsigs. 2020-01-16T05:42:14.065 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../090-python-funcsigs_1.0.2-4_all.deb ... 2020-01-16T05:42:14.106 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-01-16T05:42:14.184 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-pytest. 2020-01-16T05:42:14.200 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../093-python-pytest_3.3.2-2_all.deb ... 2020-01-16T05:42:14.242 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-01-16T05:42:14.409 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-pluggy. 2020-01-16T05:42:14.426 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../091-python-pluggy_0.6.0-1_all.deb ... 2020-01-16T05:42:14.467 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-01-16T05:42:14.587 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-attr. 2020-01-16T05:42:14.601 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../094-python3-attr_17.4.0-2_all.deb ... 2020-01-16T05:42:14.645 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-attr (17.4.0-2) ... 2020-01-16T05:42:14.770 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-py. 2020-01-16T05:42:14.784 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../092-python-py_1.5.2-1_all.deb ... 2020-01-16T05:42:14.847 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-py (1.5.2-1) ... 2020-01-16T05:42:14.948 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cycler. 2020-01-16T05:42:14.966 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../095-python3-cycler_0.10.0-1_all.deb ... 2020-01-16T05:42:15.007 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cycler (0.10.0-1) ... 2020-01-16T05:42:15.165 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-pytest. 2020-01-16T05:42:15.182 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../093-python-pytest_3.3.2-2_all.deb ... 2020-01-16T05:42:15.223 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-01-16T05:42:15.309 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-webencodings. 2020-01-16T05:42:15.325 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../096-python3-webencodings_0.5-2_all.deb ... 2020-01-16T05:42:15.376 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-webencodings (0.5-2) ... 2020-01-16T05:42:15.568 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-attr. 2020-01-16T05:42:15.585 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../094-python3-attr_17.4.0-2_all.deb ... 2020-01-16T05:42:15.626 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-attr (17.4.0-2) ... 2020-01-16T05:42:15.687 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-html5lib. 2020-01-16T05:42:15.701 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../097-python3-html5lib_0.999999999-1_all.deb ... 2020-01-16T05:42:15.745 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2020-01-16T05:42:15.938 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cycler. 2020-01-16T05:42:15.954 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../095-python3-cycler_0.10.0-1_all.deb ... 2020-01-16T05:42:16.004 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cycler (0.10.0-1) ... 2020-01-16T05:42:16.082 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-01-16T05:42:16.099 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../098-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-01-16T05:42:16.142 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-16T05:42:16.315 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-webencodings. 2020-01-16T05:42:16.329 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../096-python3-webencodings_0.5-2_all.deb ... 2020-01-16T05:42:16.382 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-webencodings (0.5-2) ... 2020-01-16T05:42:16.594 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-tz. 2020-01-16T05:42:16.610 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../099-python3-tz_2018.3-2_all.deb ... 2020-01-16T05:42:16.652 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-tz (2018.3-2) ... 2020-01-16T05:42:16.693 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-html5lib. 2020-01-16T05:42:16.708 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../097-python3-html5lib_0.999999999-1_all.deb ... 2020-01-16T05:42:16.751 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2020-01-16T05:42:16.955 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-matplotlib. 2020-01-16T05:42:16.968 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../100-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2020-01-16T05:42:17.012 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2020-01-16T05:42:17.080 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-01-16T05:42:17.096 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../098-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-01-16T05:42:17.138 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-16T05:42:17.566 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-tz. 2020-01-16T05:42:17.581 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../099-python3-tz_2018.3-2_all.deb ... 2020-01-16T05:42:17.624 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-tz (2018.3-2) ... 2020-01-16T05:42:17.685 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-olefile. 2020-01-16T05:42:17.699 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../101-python3-olefile_0.45.1-1_all.deb ... 2020-01-16T05:42:17.747 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-olefile (0.45.1-1) ... 2020-01-16T05:42:17.927 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-matplotlib. 2020-01-16T05:42:17.941 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../100-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2020-01-16T05:42:17.985 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2020-01-16T05:42:18.046 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pastescript. 2020-01-16T05:42:18.060 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-2_all.deb ... 2020-01-16T05:42:18.104 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2020-01-16T05:42:18.466 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pil:amd64. 2020-01-16T05:42:18.483 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../103-python3-pil_5.1.0-1_amd64.deb ... 2020-01-16T05:42:18.525 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pil:amd64 (5.1.0-1) ... 2020-01-16T05:42:18.666 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-olefile. 2020-01-16T05:42:18.683 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../101-python3-olefile_0.45.1-1_all.deb ... 2020-01-16T05:42:18.724 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-olefile (0.45.1-1) ... 2020-01-16T05:42:18.920 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pluggy. 2020-01-16T05:42:18.934 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../104-python3-pluggy_0.6.0-1_all.deb ... 2020-01-16T05:42:18.978 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2020-01-16T05:42:19.053 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pastescript. 2020-01-16T05:42:19.055 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-2_all.deb ... 2020-01-16T05:42:19.094 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2020-01-16T05:42:19.285 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-py. 2020-01-16T05:42:19.295 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../105-python3-py_1.5.2-1_all.deb ... 2020-01-16T05:42:19.348 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-py (1.5.2-1) ... 2020-01-16T05:42:19.481 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pil:amd64. 2020-01-16T05:42:19.496 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../103-python3-pil_5.1.0-1_amd64.deb ... 2020-01-16T05:42:19.539 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pil:amd64 (5.1.0-1) ... 2020-01-16T05:42:19.684 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyinotify. 2020-01-16T05:42:19.698 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../106-python3-pyinotify_0.9.6-1_all.deb ... 2020-01-16T05:42:19.742 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2020-01-16T05:42:19.884 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pluggy. 2020-01-16T05:42:19.900 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../104-python3-pluggy_0.6.0-1_all.deb ... 2020-01-16T05:42:19.942 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2020-01-16T05:42:20.070 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pytest. 2020-01-16T05:42:20.086 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../107-python3-pytest_3.3.2-2_all.deb ... 2020-01-16T05:42:20.128 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pytest (3.3.2-2) ... 2020-01-16T05:42:20.245 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-py. 2020-01-16T05:42:20.260 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../105-python3-py_1.5.2-1_all.deb ... 2020-01-16T05:42:20.303 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-py (1.5.2-1) ... 2020-01-16T05:42:20.506 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-simplejson. 2020-01-16T05:42:20.522 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../108-python3-simplejson_3.13.2-1_amd64.deb ... 2020-01-16T05:42:20.573 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2020-01-16T05:42:20.631 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyinotify. 2020-01-16T05:42:20.645 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../106-python3-pyinotify_0.9.6-1_all.deb ... 2020-01-16T05:42:20.698 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2020-01-16T05:42:20.917 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-tk:amd64. 2020-01-16T05:42:20.931 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../109-python3-tk_3.6.9-1~18.04_amd64.deb ... 2020-01-16T05:42:20.976 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2020-01-16T05:42:21.001 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pytest. 2020-01-16T05:42:21.014 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../107-python3-pytest_3.3.2-2_all.deb ... 2020-01-16T05:42:21.059 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pytest (3.3.2-2) ... 2020-01-16T05:42:21.421 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package radosgw. 2020-01-16T05:42:21.429 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-simplejson. 2020-01-16T05:42:21.430 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../110-radosgw_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:42:21.445 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../108-python3-simplejson_3.13.2-1_amd64.deb ... 2020-01-16T05:42:21.471 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking radosgw (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:21.520 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2020-01-16T05:42:21.840 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-tk:amd64. 2020-01-16T05:42:21.857 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../109-python3-tk_3.6.9-1~18.04_amd64.deb ... 2020-01-16T05:42:21.898 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2020-01-16T05:42:22.199 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package rbd-fuse. 2020-01-16T05:42:22.213 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../111-rbd-fuse_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:42:22.257 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking rbd-fuse (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:22.352 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package radosgw. 2020-01-16T05:42:22.367 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../110-radosgw_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:42:22.411 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking radosgw (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:22.573 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-logutils (0.3.3-5) ... 2020-01-16T05:42:22.862 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2020-01-16T05:42:23.122 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package rbd-fuse. 2020-01-16T05:42:23.136 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../111-rbd-fuse_15.0.0-9376-g0771362-1bionic_amd64.deb ... 2020-01-16T05:42:23.180 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking rbd-fuse (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:23.230 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2020-01-16T05:42:23.356 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-01-16T05:42:23.492 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-logutils (0.3.3-5) ... 2020-01-16T05:42:23.802 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2020-01-16T05:42:23.975 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pil:amd64 (5.1.0-1) ... 2020-01-16T05:42:24.162 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2020-01-16T05:42:24.296 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-01-16T05:42:24.352 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2020-01-16T05:42:24.628 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-webencodings (0.5-2) ... 2020-01-16T05:42:24.913 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-attr (17.4.0-2) ... 2020-01-16T05:42:24.924 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pil:amd64 (5.1.0-1) ... 2020-01-16T05:42:25.114 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2020-01-16T05:42:25.240 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-py (1.5.2-1) ... 2020-01-16T05:42:25.292 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2020-01-16T05:42:25.586 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-webencodings (0.5-2) ... 2020-01-16T05:42:25.594 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-waitress (1.0.1-1) ... 2020-01-16T05:42:25.877 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-attr (17.4.0-2) ... 2020-01-16T05:42:25.958 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-01-16T05:42:26.070 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2020-01-16T05:42:26.205 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-py (1.5.2-1) ... 2020-01-16T05:42:26.236 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-olefile (0.45.1-1) ... 2020-01-16T05:42:26.538 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-ceph-argparse (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:26.549 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-waitress (1.0.1-1) ... 2020-01-16T05:42:26.871 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-tempita (0.5.2-2) ... 2020-01-16T05:42:26.946 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-01-16T05:42:27.172 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-01-16T05:42:27.307 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2020-01-16T05:42:27.634 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-olefile (0.45.1-1) ... 2020-01-16T05:42:27.935 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-ceph-argparse (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:28.235 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2020-01-16T05:42:28.236 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-tempita (0.5.2-2) ... 2020-01-16T05:42:28.537 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-01-16T05:42:28.561 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2020-01-16T05:42:28.663 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2020-01-16T05:42:28.845 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-py (1.5.2-1) ... 2020-01-16T05:42:29.072 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-simplejson (3.13.2-1) ... 2020-01-16T05:42:29.407 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-01-16T05:42:29.532 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-01-16T05:42:29.583 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2020-01-16T05:42:29.734 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-colorama (0.3.7-1) ... 2020-01-16T05:42:29.910 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2020-01-16T05:42:30.035 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2020-01-16T05:42:30.206 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-py (1.5.2-1) ... 2020-01-16T05:42:30.336 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2020-01-16T05:42:30.437 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-simplejson (3.13.2-1) ... 2020-01-16T05:42:30.645 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cycler (0.10.0-1) ... 2020-01-16T05:42:30.772 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-01-16T05:42:30.898 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-01-16T05:42:30.947 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2020-01-16T05:42:31.099 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-colorama (0.3.7-1) ... 2020-01-16T05:42:31.298 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-bs4 (4.6.0-1) ... 2020-01-16T05:42:31.400 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2020-01-16T05:42:31.624 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pluggy (0.6.0-1) ... 2020-01-16T05:42:31.718 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2020-01-16T05:42:31.950 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up cephadm (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:32.011 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cycler (0.10.0-1) ... 2020-01-16T05:42:32.312 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2020-01-16T05:42:32.635 INFO:teuthology.orchestra.run.smithi084.stdout:Adding system user cephadm....done 2020-01-16T05:42:32.689 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-bs4 (4.6.0-1) ... 2020-01-16T05:42:32.799 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2020-01-16T05:42:33.023 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pluggy (0.6.0-1) ... 2020-01-16T05:42:33.100 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-01-16T05:42:33.226 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2020-01-16T05:42:33.341 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up cephadm (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:33.569 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-prettytable (0.7.2-3) ... 2020-01-16T05:42:33.878 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-01-16T05:42:34.004 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2020-01-16T05:42:34.042 INFO:teuthology.orchestra.run.smithi142.stdout:Adding system user cephadm....done 2020-01-16T05:42:34.206 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2020-01-16T05:42:34.339 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-ceph-common (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:34.491 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-01-16T05:42:34.616 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2020-01-16T05:42:34.658 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-monotonic (1.1-2) ... 2020-01-16T05:42:34.943 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-prettytable (0.7.2-3) ... 2020-01-16T05:42:34.967 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-01-16T05:42:35.093 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-html5lib (0.999999999-1) ... 2020-01-16T05:42:35.227 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-01-16T05:42:35.354 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2020-01-16T05:42:35.444 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-repoze.lru (0.7-1) ... 2020-01-16T05:42:35.705 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-ceph-common (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:35.737 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2020-01-16T05:42:36.015 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-monotonic (1.1-2) ... 2020-01-16T05:42:36.030 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2020-01-16T05:42:36.308 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-01-16T05:42:36.364 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-attr (17.4.0-2) ... 2020-01-16T05:42:36.436 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-html5lib (0.999999999-1) ... 2020-01-16T05:42:36.665 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-01-16T05:42:36.789 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-repoze.lru (0.7-1) ... 2020-01-16T05:42:36.867 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-16T05:42:37.086 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2020-01-16T05:42:37.260 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2020-01-16T05:42:37.350 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-01-16T05:42:37.396 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2020-01-16T05:42:37.605 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liboath0 (2.6.1-1) ... 2020-01-16T05:42:37.730 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-attr (17.4.0-2) ... 2020-01-16T05:42:37.805 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-01-16T05:42:37.935 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2020-01-16T05:42:38.040 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-01-16T05:42:38.175 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-01-16T05:42:38.282 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-16T05:42:38.302 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-setuptools (39.0.1-2) ... 2020-01-16T05:42:38.684 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2020-01-16T05:42:38.701 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-01-16T05:42:38.774 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-01-16T05:42:38.827 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-decorator (4.1.2-1) ... 2020-01-16T05:42:39.027 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liboath0 (2.6.1-1) ... 2020-01-16T05:42:39.120 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-tz (2018.3-2) ... 2020-01-16T05:42:39.204 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-01-16T05:42:39.330 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2020-01-16T05:42:39.429 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2020-01-16T05:42:39.598 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-01-16T05:42:39.722 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2020-01-16T05:42:39.774 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-setuptools (39.0.1-2) ... 2020-01-16T05:42:40.015 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-joblib (0.11-1) ... 2020-01-16T05:42:40.167 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-01-16T05:42:40.301 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-decorator (4.1.2-1) ... 2020-01-16T05:42:40.366 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-routes (2.4.1-1) ... 2020-01-16T05:42:40.586 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-tz (2018.3-2) ... 2020-01-16T05:42:40.676 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2020-01-16T05:42:40.887 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2020-01-16T05:42:40.977 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-dateutil (2.6.1-1) ... 2020-01-16T05:42:41.180 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2020-01-16T05:42:41.295 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2020-01-16T05:42:41.506 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-joblib (0.11-1) ... 2020-01-16T05:42:41.590 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-01-16T05:42:41.882 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-routes (2.4.1-1) ... 2020-01-16T05:42:41.950 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-fasteners (0.12.0-3) ... 2020-01-16T05:42:42.200 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2020-01-16T05:42:42.267 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up jq (1.5+dfsg-2) ... 2020-01-16T05:42:42.393 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2020-01-16T05:42:42.485 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-dateutil (2.6.1-1) ... 2020-01-16T05:42:42.803 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2020-01-16T05:42:43.113 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-01-16T05:42:43.456 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-fasteners (0.12.0-3) ... 2020-01-16T05:42:43.566 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-16T05:42:43.740 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up jq (1.5+dfsg-2) ... 2020-01-16T05:42:43.866 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2020-01-16T05:42:43.875 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2020-01-16T05:42:44.202 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2020-01-16T05:42:44.329 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pytest (3.3.2-2) ... 2020-01-16T05:42:44.696 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2020-01-16T05:42:44.997 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-pytest (3.3.2-2) ... 2020-01-16T05:42:45.030 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-16T05:42:45.257 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-01-16T05:42:45.322 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2020-01-16T05:42:45.382 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-01-16T05:42:45.519 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librados2 (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:45.632 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2020-01-16T05:42:45.648 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rsa (3.4.2-1) ... 2020-01-16T05:42:45.758 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pytest (3.3.2-2) ... 2020-01-16T05:42:45.967 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libcephfs2 (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:46.111 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libcephfs-dev (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:46.134 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2020-01-16T05:42:46.245 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rados (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:46.383 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2020-01-16T05:42:46.435 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-pytest (3.3.2-2) ... 2020-01-16T05:42:46.697 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-01-16T05:42:46.718 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2020-01-16T05:42:46.827 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-01-16T05:42:46.954 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librados2 (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:47.029 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2020-01-16T05:42:47.064 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rsa (3.4.2-1) ... 2020-01-16T05:42:47.365 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2020-01-16T05:42:47.366 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libcephfs2 (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:47.502 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libcephfs-dev (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:47.628 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rados (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:47.754 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2020-01-16T05:42:48.048 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2020-01-16T05:42:48.223 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-sklearn (0.19.1-3) ... 2020-01-16T05:42:48.358 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2020-01-16T05:42:48.696 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2020-01-16T05:42:49.150 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2020-01-16T05:42:49.440 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libradosstriper1 (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:49.515 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-sklearn (0.19.1-3) ... 2020-01-16T05:42:49.583 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cephfs (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:49.886 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librgw2 (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:50.012 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-fuse (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:50.233 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-01-16T05:42:50.234 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-01-16T05:42:50.421 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2020-01-16T05:42:50.503 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librbd1 (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:50.629 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up cephfs-shell (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:50.688 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libradosstriper1 (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:50.771 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pecan (1.2.1-2) ... 2020-01-16T05:42:50.797 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cephfs (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:50.848 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-01-16T05:42:50.878 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-01-16T05:42:51.074 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librgw2 (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:51.199 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-fuse (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:51.200 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2020-01-16T05:42:51.412 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-01-16T05:42:51.412 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-01-16T05:42:51.701 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librbd1 (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:51.826 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up cephfs-shell (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:51.885 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pastescript (2.0.2-2) ... 2020-01-16T05:42:51.952 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pecan (1.2.1-2) ... 2020-01-16T05:42:52.051 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-01-16T05:42:52.083 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-01-16T05:42:52.194 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rgw (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:52.320 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up rbd-fuse (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:52.400 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2020-01-16T05:42:52.446 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rbd (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:52.572 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-common (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:53.077 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pastescript (2.0.2-2) ... 2020-01-16T05:42:53.140 INFO:teuthology.orchestra.run.smithi084.stdout:Adding group ceph....done 2020-01-16T05:42:53.395 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rgw (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:53.513 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up rbd-fuse (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:53.530 INFO:teuthology.orchestra.run.smithi084.stdout:Adding system user ceph....done 2020-01-16T05:42:53.622 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rbd (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:53.723 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-common (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:53.732 INFO:teuthology.orchestra.run.smithi084.stdout:Setting system user ceph properties....done 2020-01-16T05:42:53.892 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-01-16T05:42:54.123 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-01-16T05:42:54.231 INFO:teuthology.orchestra.run.smithi142.stdout:Adding group ceph....done 2020-01-16T05:42:54.414 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up radosgw (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:54.623 INFO:teuthology.orchestra.run.smithi142.stdout:Adding system user ceph....done 2020-01-16T05:42:54.677 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-01-16T05:42:54.678 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-01-16T05:42:54.855 INFO:teuthology.orchestra.run.smithi142.stdout:Setting system user ceph properties....done 2020-01-16T05:42:55.009 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-01-16T05:42:55.077 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-test (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:55.203 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-base (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:55.238 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-01-16T05:42:55.523 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up radosgw (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:55.535 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-01-16T05:42:55.774 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-01-16T05:42:55.774 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-01-16T05:42:55.813 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:56.030 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-01-16T05:42:56.030 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-01-16T05:42:56.185 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-test (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:56.311 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-base (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:56.322 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-diskprediction-local (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:56.465 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-osd (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:56.642 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-01-16T05:42:56.938 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:56.947 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-01-16T05:42:56.947 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-01-16T05:42:57.163 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-01-16T05:42:57.163 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-01-16T05:42:57.242 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-cephadm (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:57.385 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-diskprediction-cloud (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:57.438 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-diskprediction-local (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:57.519 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-rook (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:57.556 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-osd (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:57.662 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mds (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:57.881 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-01-16T05:42:57.881 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-01-16T05:42:57.987 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-01-16T05:42:57.987 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-01-16T05:42:58.155 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mon (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:58.418 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-cephadm (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:58.553 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-diskprediction-cloud (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:58.554 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-01-16T05:42:58.554 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-01-16T05:42:58.695 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-rook (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:58.807 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-k8sevents (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:58.837 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mds (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:58.935 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-dashboard (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:59.055 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-01-16T05:42:59.055 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-01-16T05:42:59.084 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:59.198 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for systemd (237-3ubuntu10.33) ... 2020-01-16T05:42:59.346 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mon (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:59.421 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-01-16T05:42:59.547 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-01-16T05:42:59.548 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-01-16T05:42:59.831 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-k8sevents (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:42:59.940 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-dashboard (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:43:00.077 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph (15.0.0-9376-g0771362-1bionic) ... 2020-01-16T05:43:00.191 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for systemd (237-3ubuntu10.33) ... 2020-01-16T05:43:00.403 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-01-16T05:43:00.850 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-01-16T05:43:00.898 INFO:teuthology.orchestra.run.smithi084.stdout:ureadahead will be reprofiled on next reboot 2020-01-16T05:43:00.959 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2020-01-16T05:43:01.408 INFO:teuthology.orchestra.run.smithi084.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-01-16T05:43:01.410 INFO:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent 2020-01-16T05:43:01.491 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2020-01-16T05:43:01.742 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2020-01-16T05:43:01.742 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2020-01-16T05:43:01.837 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-01-16T05:43:01.883 INFO:teuthology.orchestra.run.smithi142.stdout:ureadahead will be reprofiled on next reboot 2020-01-16T05:43:01.904 INFO:teuthology.orchestra.run.smithi084.stdout:The following additional packages will be installed: 2020-01-16T05:43:01.905 INFO:teuthology.orchestra.run.smithi084.stdout: libbison-dev libfl-dev libfl2 zlib1g-dev 2020-01-16T05:43:01.907 INFO:teuthology.orchestra.run.smithi084.stdout:Suggested packages: 2020-01-16T05:43:01.907 INFO:teuthology.orchestra.run.smithi084.stdout: bison-doc flex-doc indent-doc libssl-doc 2020-01-16T05:43:01.931 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2020-01-16T05:43:01.933 INFO:teuthology.orchestra.run.smithi084.stdout:The following NEW packages will be installed: 2020-01-16T05:43:01.935 INFO:teuthology.orchestra.run.smithi084.stdout: bison dump flex indent libbison-dev libelf-dev libfl-dev libfl2 libssl-dev 2020-01-16T05:43:01.935 INFO:teuthology.orchestra.run.smithi084.stdout: zlib1g-dev 2020-01-16T05:43:02.137 INFO:teuthology.orchestra.run.smithi084.stdout:0 upgraded, 10 newly installed, 0 to remove and 28 not upgraded. 2020-01-16T05:43:02.137 INFO:teuthology.orchestra.run.smithi084.stdout:Need to get 2,947 kB of archives. 2020-01-16T05:43:02.138 INFO:teuthology.orchestra.run.smithi084.stdout:After this operation, 12.2 MB of additional disk space will be used. 2020-01-16T05:43:02.138 INFO:teuthology.orchestra.run.smithi084.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2020-01-16T05:43:02.379 INFO:teuthology.orchestra.run.smithi142.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-01-16T05:43:02.381 INFO:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent 2020-01-16T05:43:02.459 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2020-01-16T05:43:02.611 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2020-01-16T05:43:02.694 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2020-01-16T05:43:02.715 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2020-01-16T05:43:02.716 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2020-01-16T05:43:02.739 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 dump amd64 0.4b46-3 [129 kB] 2020-01-16T05:43:02.758 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 indent amd64 2.2.11-5 [80.7 kB] 2020-01-16T05:43:02.769 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2020-01-16T05:43:02.790 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2020-01-16T05:43:02.795 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2020-01-16T05:43:02.796 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2020-01-16T05:43:02.796 INFO:teuthology.orchestra.run.smithi084.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.5 [1,566 kB] 2020-01-16T05:43:02.879 INFO:teuthology.orchestra.run.smithi142.stdout:The following additional packages will be installed: 2020-01-16T05:43:02.880 INFO:teuthology.orchestra.run.smithi142.stdout: libbison-dev libfl-dev libfl2 zlib1g-dev 2020-01-16T05:43:02.882 INFO:teuthology.orchestra.run.smithi142.stdout:Suggested packages: 2020-01-16T05:43:02.882 INFO:teuthology.orchestra.run.smithi142.stdout: bison-doc flex-doc indent-doc libssl-doc 2020-01-16T05:43:02.908 INFO:teuthology.orchestra.run.smithi142.stdout:The following NEW packages will be installed: 2020-01-16T05:43:02.910 INFO:teuthology.orchestra.run.smithi142.stdout: bison dump flex indent libbison-dev libelf-dev libfl-dev libfl2 libssl-dev 2020-01-16T05:43:02.910 INFO:teuthology.orchestra.run.smithi142.stdout: zlib1g-dev 2020-01-16T05:43:03.093 INFO:teuthology.orchestra.run.smithi142.stdout:0 upgraded, 10 newly installed, 0 to remove and 28 not upgraded. 2020-01-16T05:43:03.093 INFO:teuthology.orchestra.run.smithi142.stdout:Need to get 2,947 kB of archives. 2020-01-16T05:43:03.093 INFO:teuthology.orchestra.run.smithi142.stdout:After this operation, 12.2 MB of additional disk space will be used. 2020-01-16T05:43:03.093 INFO:teuthology.orchestra.run.smithi142.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2020-01-16T05:43:03.272 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 2,947 kB in 1s (3,130 kB/s) 2020-01-16T05:43:03.544 INFO:teuthology.orchestra.run.smithi142.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2020-01-16T05:43:03.628 INFO:teuthology.orchestra.run.smithi142.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2020-01-16T05:43:03.642 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package flex. 2020-01-16T05:43:03.687 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 dump amd64 0.4b46-3 [129 kB] 2020-01-16T05:43:03.696 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 144981 files and directories currently installed.) 2020-01-16T05:43:03.700 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../0-flex_2.6.4-6_amd64.deb ... 2020-01-16T05:43:03.705 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 indent amd64 2.2.11-5 [80.7 kB] 2020-01-16T05:43:03.712 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2020-01-16T05:43:03.727 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2020-01-16T05:43:03.733 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2020-01-16T05:43:03.733 INFO:teuthology.orchestra.run.smithi142.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2020-01-16T05:43:03.734 INFO:teuthology.orchestra.run.smithi142.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.5 [1,566 kB] 2020-01-16T05:43:03.740 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking flex (2.6.4-6) ... 2020-01-16T05:43:04.119 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libbison-dev:amd64. 2020-01-16T05:43:04.134 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../1-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2020-01-16T05:43:04.177 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2020-01-16T05:43:04.211 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 2,947 kB in 1s (3,257 kB/s) 2020-01-16T05:43:04.332 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package flex. 2020-01-16T05:43:04.384 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 144981 files and directories currently installed.) 2020-01-16T05:43:04.388 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../0-flex_2.6.4-6_amd64.deb ... 2020-01-16T05:43:04.422 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking flex (2.6.4-6) ... 2020-01-16T05:43:04.480 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package bison. 2020-01-16T05:43:04.496 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../2-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2020-01-16T05:43:04.534 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2020-01-16T05:43:04.826 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libbison-dev:amd64. 2020-01-16T05:43:04.843 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../1-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2020-01-16T05:43:04.893 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2020-01-16T05:43:04.967 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package dump. 2020-01-16T05:43:04.981 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../3-dump_0.4b46-3_amd64.deb ... 2020-01-16T05:43:05.025 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking dump (0.4b46-3) ... 2020-01-16T05:43:05.221 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package bison. 2020-01-16T05:43:05.237 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../2-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2020-01-16T05:43:05.283 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2020-01-16T05:43:05.312 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package indent. 2020-01-16T05:43:05.329 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../4-indent_2.2.11-5_amd64.deb ... 2020-01-16T05:43:05.387 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking indent (2.2.11-5) ... 2020-01-16T05:43:05.641 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package dump. 2020-01-16T05:43:05.655 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../3-dump_0.4b46-3_amd64.deb ... 2020-01-16T05:43:05.665 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2020-01-16T05:43:05.682 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../5-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2020-01-16T05:43:05.691 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking dump (0.4b46-3) ... 2020-01-16T05:43:05.724 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2020-01-16T05:43:05.953 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package indent. 2020-01-16T05:43:05.969 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../4-indent_2.2.11-5_amd64.deb ... 2020-01-16T05:43:06.013 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking indent (2.2.11-5) ... 2020-01-16T05:43:06.013 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libelf-dev:amd64. 2020-01-16T05:43:06.026 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../6-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2020-01-16T05:43:06.059 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2020-01-16T05:43:06.264 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2020-01-16T05:43:06.280 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../5-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2020-01-16T05:43:06.331 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2020-01-16T05:43:06.432 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libfl2:amd64. 2020-01-16T05:43:06.449 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../7-libfl2_2.6.4-6_amd64.deb ... 2020-01-16T05:43:06.532 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2020-01-16T05:43:06.643 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libelf-dev:amd64. 2020-01-16T05:43:06.660 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../6-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2020-01-16T05:43:06.693 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2020-01-16T05:43:06.734 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libfl-dev:amd64. 2020-01-16T05:43:06.749 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6_amd64.deb ... 2020-01-16T05:43:06.784 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2020-01-16T05:43:07.012 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libssl-dev:amd64. 2020-01-16T05:43:07.027 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../9-libssl-dev_1.1.1-1ubuntu2.1~18.04.5_amd64.deb ... 2020-01-16T05:43:07.041 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libfl2:amd64. 2020-01-16T05:43:07.058 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../7-libfl2_2.6.4-6_amd64.deb ... 2020-01-16T05:43:07.070 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.5) ... 2020-01-16T05:43:07.141 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2020-01-16T05:43:07.369 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libfl-dev:amd64. 2020-01-16T05:43:07.383 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6_amd64.deb ... 2020-01-16T05:43:07.422 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2020-01-16T05:43:07.527 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up flex (2.6.4-6) ... 2020-01-16T05:43:07.658 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up dump (0.4b46-3) ... 2020-01-16T05:43:07.663 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libssl-dev:amd64. 2020-01-16T05:43:07.679 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../9-libssl-dev_1.1.1-1ubuntu2.1~18.04.5_amd64.deb ... 2020-01-16T05:43:07.721 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.5) ... 2020-01-16T05:43:07.770 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2020-01-16T05:43:07.835 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.5) ... 2020-01-16T05:43:07.962 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up indent (2.2.11-5) ... 2020-01-16T05:43:08.087 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2020-01-16T05:43:08.213 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2020-01-16T05:43:08.291 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up flex (2.6.4-6) ... 2020-01-16T05:43:08.343 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2020-01-16T05:43:08.418 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up dump (0.4b46-3) ... 2020-01-16T05:43:08.428 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2020-01-16T05:43:08.525 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2020-01-16T05:43:08.617 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.5) ... 2020-01-16T05:43:08.642 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2020-01-16T05:43:08.738 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up indent (2.2.11-5) ... 2020-01-16T05:43:08.776 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2020-01-16T05:43:08.863 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2020-01-16T05:43:08.902 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2020-01-16T05:43:08.989 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2020-01-16T05:43:09.044 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-01-16T05:43:09.115 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2020-01-16T05:43:09.205 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2020-01-16T05:43:09.284 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2020-01-16T05:43:09.418 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2020-01-16T05:43:09.544 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2020-01-16T05:43:09.669 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-01-16T05:43:11.121 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2020-01-16T05:43:11.447 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2020-01-16T05:43:11.598 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2020-01-16T05:43:11.903 INFO:teuthology.orchestra.run.smithi084.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-01-16T05:43:11.905 DEBUG:teuthology.parallel:result is None 2020-01-16T05:43:11.906 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2020-01-16T05:43:12.343 INFO:teuthology.orchestra.run.smithi142.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-01-16T05:43:12.348 DEBUG:teuthology.parallel:result is None 2020-01-16T05:43:12.348 INFO:teuthology.orchestra.run.smithi084:> sudo lsb_release -is 2020-01-16T05:43:12.404 INFO:teuthology.orchestra.run.smithi084.stdout:Ubuntu 2020-01-16T05:43:12.410 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-16T05:43:12.410 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=07713629e135b47dc5ec2a85f60649826e17a6cd 2020-01-16T05:43:12.576 INFO:teuthology.orchestra.run.smithi084:> dpkg-query -W -f '${Version}' ceph 2020-01-16T05:43:12.601 INFO:teuthology.orchestra.run.smithi084.stdout:15.0.0-9376-g0771362-1bionic 2020-01-16T05:43:12.602 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-9376-g0771362-1bionic 2020-01-16T05:43:12.602 INFO:teuthology.task.install:The correct ceph version 15.0.0-9376-g0771362-1bionic is installed. 2020-01-16T05:43:12.602 INFO:teuthology.orchestra.run.smithi142:> sudo lsb_release -is 2020-01-16T05:43:12.657 INFO:teuthology.orchestra.run.smithi142.stdout:Ubuntu 2020-01-16T05:43:12.663 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-16T05:43:12.663 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=07713629e135b47dc5ec2a85f60649826e17a6cd 2020-01-16T05:43:12.830 INFO:teuthology.orchestra.run.smithi142:> dpkg-query -W -f '${Version}' ceph 2020-01-16T05:43:12.855 INFO:teuthology.orchestra.run.smithi142.stdout:15.0.0-9376-g0771362-1bionic 2020-01-16T05:43:12.855 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-9376-g0771362-1bionic 2020-01-16T05:43:12.856 INFO:teuthology.task.install:The correct ceph version 15.0.0-9376-g0771362-1bionic is installed. 2020-01-16T05:43:12.856 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-01-16T05:43:12.856 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-01-16T05:43:12.872 INFO:teuthology.orchestra.run.smithi142:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-01-16T05:43:12.913 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-01-16T05:43:12.913 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-01-16T05:43:12.931 INFO:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-01-16T05:43:12.987 INFO:teuthology.orchestra.run.smithi142:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-01-16T05:43:13.002 INFO:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-01-16T05:43:13.059 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-01-16T05:43:13.059 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-01-16T05:43:13.105 INFO:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-01-16T05:43:13.159 INFO:teuthology.orchestra.run.smithi142:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-01-16T05:43:13.208 INFO:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-01-16T05:43:13.266 INFO:teuthology.run_tasks:Running task ceph... 2020-01-16T05:43:13.328 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-01-16T05:43:13.329 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 777 /var/log/ceph 2020-01-16T05:43:13.331 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2020-01-16T05:43:13.345 INFO:tasks.ceph:Disabling ceph logrotate... 2020-01-16T05:43:13.346 INFO:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/logrotate.d/ceph 2020-01-16T05:43:13.389 INFO:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2020-01-16T05:43:13.402 INFO:tasks.ceph:Creating extra log directories... 2020-01-16T05:43:13.402 INFO:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-01-16T05:43:13.445 INFO:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-01-16T05:43:13.460 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-01-16T05:43:13.460 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-01-16T05:43:13.461 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-01-16T05:43:13.461 INFO:teuthology.orchestra.run.smithi084:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-01-16T05:43:13.545 INFO:teuthology.orchestra.run.smithi084:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-01-16T05:43:13.620 INFO:teuthology.orchestra.run.smithi142:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-01-16T05:43:13.667 INFO:teuthology.orchestra.run.smithi142:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-01-16T05:43:13.745 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-01-16T05:43:13.745 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'not responding, replacing', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'global': {'ms inject delay type': 'osd mds', 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'mon client directed command retry': 5, 'ms inject socket failures': 2500}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'bluestore compression mode': 'aggressive', 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'osd op complaint time': 180}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}}} 2020-01-16T05:43:13.745 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': '07713629e135b47dc5ec2a85f60649826e17a6cd'}}, {'ceph': None}, {'mds_thrash': None}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['fs/misc/trivial_sync.sh']}}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200116.003219/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.5530', 'owner': 'scheduled_pdonnell@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'targets': {'smithi084.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCs4QDSE2u6b5Hf0HDm9GUBv8pQ6+bIM0N4icldK25MXrjTstWxc8xLKQK1wzTxkycMAm7r5cDtu2IJ8gA4WaSxzfJeCuWKxvb9sfEMjP1TGXTZvBWE9ByR5p55O9JPMeFAFAMxDgAzSkzC6NThx6RsUwLiG8G6qwZv40KcG2o7gKj+f8YP9IUYq7C8AeIksqnCohqq+xBX+UoM242usbJVra4DqvWdcb3/e8pHMbz2FOvpoL2vHT/k9TaEdAY6Z47z/yMw/VSRBZEo10SDfKYhUgtDF/eiujFteL+1pBOcsL5saisfr3YsPM59ReGaWh/T1ZkILnDxlE00vDFY110t', 'smithi142.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6aAEP9FTYdyZjQgJK2L0kDdgDRgTlUe3lOhBuBRC+J5BweFii71iN9JUSCultLd84cIALerWaiG/o9wqCL3Iamfxsum1KijlFQWIXARoGigtEasDQSNSEy5d9Ra+pyt3dYjU/w2cfmbj8vEhVarCLbuLbpi5uaNXYk1uKtGFoprbvZJzFfcFKgBgIv2A5UwAJPQYqeP7XK1cUsogPQM0l3jEI1Bd+d8THQCHxREZZWR61hXhr/Mlv41XE+nVZkXQrVvUyMP/4qkLsSAPLc82fzox7uQeUUG3qEmA6nzSnCE7Ngv35f2qAcju/4M6fTNWE3LeDi1r++yvKFeEa5MCT'}, 'job_id': '4672934', 'tube': 'smithi', 'suite_branch': 'wip-pdonnell-testing-20200116.003219', 'priority': 90, 'os_version': '18.04', 'first_in_suite': False, 'branch': 'wip-pdonnell-testing-20200116.003219', 'suite': 'fs', 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'email': 'pdonnell@redhat.com', 'archive_path': '/home/teuthworker/archive/pdonnell-2020-01-16_04:36:36-fs-wip-pdonnell-testing-20200116.003219-distro-basic-smithi/4672934', 'description': 'fs/thrash/{begin.yaml ceph-thrash/mds.yaml clusters/1-mds-1-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/cfuse_workunit_trivial_sync.yaml}', 'nuke-on-error': True, 'repo': 'git://git.ceph.com/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '07713629e135b47dc5ec2a85f60649826e17a6cd', 'name': 'pdonnell-2020-01-16_04:36:36-fs-wip-pdonnell-testing-20200116.003219-distro-basic-smithi', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'overrides': {'ceph': {'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'not responding, replacing', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'global': {'ms inject delay type': 'osd mds', 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'mon client directed command retry': 5, 'ms inject socket failures': 2500}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'bluestore compression mode': 'aggressive', 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'osd op complaint time': 180}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}}, 'fs': 'xfs', 'sha1': '07713629e135b47dc5ec2a85f60649826e17a6cd'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': '07713629e135b47dc5ec2a85f60649826e17a6cd'}}, 'admin_socket': {'branch': 'wip-pdonnell-testing-20200116.003219'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}, 'workunit': {'sha1': '07713629e135b47dc5ec2a85f60649826e17a6cd', 'branch': 'wip-pdonnell-testing-20200116.003219'}}, 'os_type': 'ubuntu', 'suite_sha1': '07713629e135b47dc5ec2a85f60649826e17a6cd'} 2020-01-16T05:43:13.746 INFO:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-01-16T05:43:13.749 INFO:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-01-16T05:43:13.792 INFO:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/run/ceph 2020-01-16T05:43:13.797 INFO:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2020-01-16T05:43:13.860 DEBUG:teuthology.orchestra.remote:smithi084:/scratch_devs is 72B 2020-01-16T05:43:13.912 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-01-16T05:43:13.913 INFO:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-01-16T05:43:13.919 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-01-16T05:43:13.920 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-01-16T05:43:13.920 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 443 Links: 1 2020-01-16T05:43:13.920 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-01-16T05:43:13.920 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2020-01-16 05:40:40.599189117 +0000 2020-01-16T05:43:13.920 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2020-01-16 05:40:40.479129118 +0000 2020-01-16T05:43:13.920 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2020-01-16 05:40:40.479129118 +0000 2020-01-16T05:43:13.920 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2020-01-16T05:43:13.929 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2020-01-16T05:43:13.930 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2020-01-16T05:43:13.930 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000419256 s, 1.2 MB/s 2020-01-16T05:43:13.934 INFO:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-01-16T05:43:13.982 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-01-16T05:43:13.982 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-01-16T05:43:13.982 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 449 Links: 1 2020-01-16T05:43:13.982 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-01-16T05:43:13.983 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2020-01-16 05:40:40.859319114 +0000 2020-01-16T05:43:13.983 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2020-01-16 05:40:40.731255116 +0000 2020-01-16T05:43:13.983 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2020-01-16 05:40:40.731255116 +0000 2020-01-16T05:43:13.983 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2020-01-16T05:43:13.991 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2020-01-16T05:43:13.991 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2020-01-16T05:43:13.991 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.00042544 s, 1.2 MB/s 2020-01-16T05:43:13.995 INFO:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-01-16T05:43:14.048 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-01-16T05:43:14.048 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-01-16T05:43:14.048 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 455 Links: 1 2020-01-16T05:43:14.048 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-01-16T05:43:14.048 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2020-01-16 05:40:41.159469111 +0000 2020-01-16T05:43:14.048 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2020-01-16 05:40:41.007393114 +0000 2020-01-16T05:43:14.049 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2020-01-16 05:40:41.007393114 +0000 2020-01-16T05:43:14.049 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2020-01-16T05:43:14.064 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2020-01-16T05:43:14.064 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2020-01-16T05:43:14.065 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000385354 s, 1.3 MB/s 2020-01-16T05:43:14.065 INFO:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-01-16T05:43:14.126 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-01-16T05:43:14.126 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-01-16T05:43:14.126 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 461 Links: 1 2020-01-16T05:43:14.127 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-01-16T05:43:14.127 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2020-01-16 05:42:50.303660865 +0000 2020-01-16T05:43:14.127 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2020-01-16 05:40:41.295537109 +0000 2020-01-16T05:43:14.127 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2020-01-16 05:40:41.295537109 +0000 2020-01-16T05:43:14.128 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2020-01-16T05:43:14.130 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2020-01-16T05:43:14.130 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2020-01-16T05:43:14.130 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000397083 s, 1.3 MB/s 2020-01-16T05:43:14.137 INFO:tasks.ceph:fs option selected, checking for scratch devs 2020-01-16T05:43:14.137 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-01-16T05:43:14.137 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2020-01-16T05:43:14.138 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-01-16T05:43:14.150 DEBUG:teuthology.orchestra.remote:smithi142:/scratch_devs is 72B 2020-01-16T05:43:14.198 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-01-16T05:43:14.199 INFO:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-01-16T05:43:14.205 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-01-16T05:43:14.206 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-01-16T05:43:14.206 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 442 Links: 1 2020-01-16T05:43:14.206 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-01-16T05:43:14.206 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2020-01-16 05:40:40.602270113 +0000 2020-01-16T05:43:14.206 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2020-01-16 05:40:40.598268114 +0000 2020-01-16T05:43:14.206 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2020-01-16 05:40:40.598268114 +0000 2020-01-16T05:43:14.206 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2020-01-16T05:43:14.215 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2020-01-16T05:43:14.215 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2020-01-16T05:43:14.215 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000300689 s, 1.7 MB/s 2020-01-16T05:43:14.220 INFO:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-01-16T05:43:14.268 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-01-16T05:43:14.268 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-01-16T05:43:14.268 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 448 Links: 1 2020-01-16T05:43:14.268 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-01-16T05:43:14.268 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2020-01-16 05:40:40.970454105 +0000 2020-01-16T05:43:14.269 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2020-01-16 05:40:40.870404107 +0000 2020-01-16T05:43:14.269 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2020-01-16 05:40:40.870404107 +0000 2020-01-16T05:43:14.269 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2020-01-16T05:43:14.277 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2020-01-16T05:43:14.277 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2020-01-16T05:43:14.277 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000371647 s, 1.4 MB/s 2020-01-16T05:43:14.280 INFO:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-01-16T05:43:14.328 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-01-16T05:43:14.328 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-01-16T05:43:14.328 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 454 Links: 1 2020-01-16T05:43:14.329 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-01-16T05:43:14.329 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2020-01-16 05:40:41.274606098 +0000 2020-01-16T05:43:14.329 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2020-01-16 05:40:41.118528102 +0000 2020-01-16T05:43:14.329 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2020-01-16 05:40:41.118528102 +0000 2020-01-16T05:43:14.329 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2020-01-16T05:43:14.337 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2020-01-16T05:43:14.338 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2020-01-16T05:43:14.338 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000415918 s, 1.2 MB/s 2020-01-16T05:43:14.342 INFO:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-01-16T05:43:14.396 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-01-16T05:43:14.396 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-01-16T05:43:14.396 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 460 Links: 1 2020-01-16T05:43:14.396 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-01-16T05:43:14.396 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2020-01-16 05:42:51.490626210 +0000 2020-01-16T05:43:14.396 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2020-01-16 05:40:41.442690095 +0000 2020-01-16T05:43:14.397 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2020-01-16 05:40:41.442690095 +0000 2020-01-16T05:43:14.397 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2020-01-16T05:43:14.405 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2020-01-16T05:43:14.406 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2020-01-16T05:43:14.406 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000403407 s, 1.3 MB/s 2020-01-16T05:43:14.409 INFO:tasks.ceph:fs option selected, checking for scratch devs 2020-01-16T05:43:14.409 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-01-16T05:43:14.410 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2020-01-16T05:43:14.410 INFO:tasks.ceph:dev map: {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-01-16T05:43:14.410 INFO:tasks.ceph:Generating config... 2020-01-16T05:43:14.412 INFO:tasks.ceph:[mds] mds debug frag = True 2020-01-16T05:43:14.412 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-01-16T05:43:14.412 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-01-16T05:43:14.413 INFO:tasks.ceph:[mds] debug mds = 20 2020-01-16T05:43:14.413 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-01-16T05:43:14.413 INFO:tasks.ceph:[mds] debug ms = 1 2020-01-16T05:43:14.413 INFO:tasks.ceph:[mds] mds bal frag = True 2020-01-16T05:43:14.413 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-01-16T05:43:14.413 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-01-16T05:43:14.413 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-01-16T05:43:14.413 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-01-16T05:43:14.414 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-01-16T05:43:14.414 INFO:tasks.ceph:[global] ms inject delay type = osd mds 2020-01-16T05:43:14.414 INFO:tasks.ceph:[global] ms inject delay max = 1 2020-01-16T05:43:14.414 INFO:tasks.ceph:[global] ms inject delay probability = 0.005 2020-01-16T05:43:14.414 INFO:tasks.ceph:[global] mon client directed command retry = 5 2020-01-16T05:43:14.414 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2020-01-16T05:43:14.414 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-01-16T05:43:14.414 INFO:tasks.ceph:[osd] debug ms = 1 2020-01-16T05:43:14.415 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-01-16T05:43:14.415 INFO:tasks.ceph:[osd] debug osd = 25 2020-01-16T05:43:14.415 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2020-01-16T05:43:14.415 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-01-16T05:43:14.415 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-01-16T05:43:14.415 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-01-16T05:43:14.415 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-01-16T05:43:14.415 INFO:tasks.ceph:[osd] debug journal = 20 2020-01-16T05:43:14.416 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-01-16T05:43:14.416 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-01-16T05:43:14.416 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-01-16T05:43:14.416 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-01-16T05:43:14.416 INFO:tasks.ceph:[osd] debug filestore = 20 2020-01-16T05:43:14.416 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-01-16T05:43:14.416 INFO:tasks.ceph:[mon] debug mon = 20 2020-01-16T05:43:14.417 INFO:tasks.ceph:[mon] debug paxos = 20 2020-01-16T05:43:14.417 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-01-16T05:43:14.417 INFO:tasks.ceph:[mon] debug ms = 1 2020-01-16T05:43:14.417 INFO:tasks.ceph:[client] debug ms = 1 2020-01-16T05:43:14.417 INFO:tasks.ceph:[client] debug client = 20 2020-01-16T05:43:14.417 INFO:tasks.ceph:[client] client mount timeout = 600 2020-01-16T05:43:14.418 INFO:tasks.ceph:Setting up mon.a... 2020-01-16T05:43:14.418 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-01-16T05:43:14.450 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.keyring 2020-01-16T05:43:14.453 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-01-16T05:43:14.536 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-01-16T05:43:14.593 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.84'), ('mon.c', '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]'), ('mon.b', '172.21.15.142')] 2020-01-16T05:43:14.594 INFO:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.84 --addv c '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]' --add b 172.21.15.142 --print /home/ubuntu/cephtest/ceph.monmap 2020-01-16T05:43:14.670 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-01-16T05:43:14.671 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: generated fsid cbc67508-4d2a-4483-a1fc-95d371063ac4 2020-01-16T05:43:14.671 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 0 2020-01-16T05:43:14.671 INFO:teuthology.orchestra.run.smithi084.stdout:fsid cbc67508-4d2a-4483-a1fc-95d371063ac4 2020-01-16T05:43:14.671 INFO:teuthology.orchestra.run.smithi084.stdout:last_changed 2020-01-16T05:43:14.669703+0000 2020-01-16T05:43:14.671 INFO:teuthology.orchestra.run.smithi084.stdout:created 2020-01-16T05:43:14.669703+0000 2020-01-16T05:43:14.671 INFO:teuthology.orchestra.run.smithi084.stdout:min_mon_release 0 (unknown) 2020-01-16T05:43:14.672 INFO:teuthology.orchestra.run.smithi084.stdout:0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2020-01-16T05:43:14.672 INFO:teuthology.orchestra.run.smithi084.stdout:1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.b 2020-01-16T05:43:14.672 INFO:teuthology.orchestra.run.smithi084.stdout:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2020-01-16T05:43:14.672 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-01-16T05:43:14.673 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID cbc67508-4d2a-4483-a1fc-95d371063ac4... 2020-01-16T05:43:14.674 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-01-16T05:43:14.713 INFO:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-01-16T05:43:14.744 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2020-01-16T05:43:14.744 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2020-01-16T05:43:14.744 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-01-16T05:43:14.745 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2020-01-16T05:43:14.745 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.745 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2020-01-16T05:43:14.745 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.745 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2020-01-16T05:43:14.745 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.746 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2020-01-16T05:43:14.746 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2020-01-16T05:43:14.746 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.746 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2020-01-16T05:43:14.746 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2020-01-16T05:43:14.746 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.747 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2020-01-16T05:43:14.747 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2020-01-16T05:43:14.747 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.747 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2020-01-16T05:43:14.747 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2020-01-16T05:43:14.747 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.747 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2020-01-16T05:43:14.748 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.748 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2020-01-16T05:43:14.748 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2020-01-16T05:43:14.748 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2020-01-16T05:43:14.748 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2020-01-16T05:43:14.749 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2020-01-16T05:43:14.749 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2020-01-16T05:43:14.749 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2020-01-16T05:43:14.749 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-01-16T05:43:14.749 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2020-01-16T05:43:14.749 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.749 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-01-16T05:43:14.750 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.750 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2020-01-16T05:43:14.750 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.750 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2020-01-16T05:43:14.750 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.750 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2020-01-16T05:43:14.751 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2020-01-16T05:43:14.751 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.84,[v2:172.21.15.142:3301,v1:172.21.15.142:6790],172.21.15.142" 2020-01-16T05:43:14.751 INFO:teuthology.orchestra.run.smithi142.stdout: ms inject delay type = osd mds 2020-01-16T05:43:14.752 INFO:teuthology.orchestra.run.smithi142.stdout: ms inject delay max = 1 2020-01-16T05:43:14.752 INFO:teuthology.orchestra.run.smithi142.stdout: ms inject delay probability = 0.005 2020-01-16T05:43:14.752 INFO:teuthology.orchestra.run.smithi142.stdout: mon client directed command retry = 5 2020-01-16T05:43:14.752 INFO:teuthology.orchestra.run.smithi142.stdout: ms inject socket failures = 2500 2020-01-16T05:43:14.752 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = cbc67508-4d2a-4483-a1fc-95d371063ac4 2020-01-16T05:43:14.752 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.752 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2020-01-16T05:43:14.752 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2020-01-16T05:43:14.753 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.753 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2020-01-16T05:43:14.753 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2020-01-16T05:43:14.753 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.753 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2020-01-16T05:43:14.753 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2020-01-16T05:43:14.754 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.754 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2020-01-16T05:43:14.754 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2020-01-16T05:43:14.754 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2020-01-16T05:43:14.754 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.754 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2020-01-16T05:43:14.755 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2020-01-16T05:43:14.755 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.755 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2020-01-16T05:43:14.755 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.755 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2020-01-16T05:43:14.755 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.755 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2020-01-16T05:43:14.756 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.756 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2020-01-16T05:43:14.756 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2020-01-16T05:43:14.756 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.756 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2020-01-16T05:43:14.756 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2020-01-16T05:43:14.756 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2020-01-16T05:43:14.756 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2020-01-16T05:43:14.757 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2020-01-16T05:43:14.757 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 25 2020-01-16T05:43:14.757 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore compression mode = aggressive 2020-01-16T05:43:14.757 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 20 2020-01-16T05:43:14.757 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 20 2020-01-16T05:43:14.757 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2020-01-16T05:43:14.757 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 10 2020-01-16T05:43:14.758 INFO:teuthology.orchestra.run.smithi142.stdout: debug journal = 20 2020-01-16T05:43:14.758 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2020-01-16T05:43:14.758 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2020-01-16T05:43:14.758 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2020-01-16T05:43:14.758 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2020-01-16T05:43:14.758 INFO:teuthology.orchestra.run.smithi142.stdout: debug filestore = 20 2020-01-16T05:43:14.758 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2020-01-16T05:43:14.758 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.759 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2020-01-16T05:43:14.759 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2020-01-16T05:43:14.759 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2020-01-16T05:43:14.759 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2020-01-16T05:43:14.759 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2020-01-16T05:43:14.759 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2020-01-16T05:43:14.759 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2020-01-16T05:43:14.760 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2020-01-16T05:43:14.760 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.760 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2020-01-16T05:43:14.760 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2020-01-16T05:43:14.760 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2020-01-16T05:43:14.760 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2020-01-16T05:43:14.760 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2020-01-16T05:43:14.760 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2020-01-16T05:43:14.761 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2020-01-16T05:43:14.761 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2020-01-16T05:43:14.761 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2020-01-16T05:43:14.761 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2020-01-16T05:43:14.761 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2020-01-16T05:43:14.761 INFO:teuthology.orchestra.run.smithi142.stdout: mon op complaint time = 120 2020-01-16T05:43:14.761 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-01-16T05:43:14.762 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2020-01-16T05:43:14.762 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2020-01-16T05:43:14.762 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2020-01-16T05:43:14.762 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2020-01-16T05:43:14.762 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-01-16T05:43:14.762 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-01-16T05:43:14.762 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2020-01-16T05:43:14.762 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2020-01-16T05:43:14.763 INFO:teuthology.orchestra.run.smithi142.stdout: client mount timeout = 600 2020-01-16T05:43:14.763 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2020-01-16T05:43:14.763 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2020-01-16T05:43:14.763 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2020-01-16T05:43:14.763 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2020-01-16T05:43:14.763 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2020-01-16T05:43:14.763 INFO:teuthology.orchestra.run.smithi142.stdout:[mds] 2020-01-16T05:43:14.764 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug frag = True 2020-01-16T05:43:14.764 INFO:teuthology.orchestra.run.smithi142.stdout: mds bal split bits = 3 2020-01-16T05:43:14.764 INFO:teuthology.orchestra.run.smithi142.stdout: mds bal split size = 100 2020-01-16T05:43:14.764 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds = 20 2020-01-16T05:43:14.764 INFO:teuthology.orchestra.run.smithi142.stdout: mds bal merge size = 5 2020-01-16T05:43:14.764 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2020-01-16T05:43:14.765 INFO:teuthology.orchestra.run.smithi142.stdout: mds bal frag = True 2020-01-16T05:43:14.765 INFO:teuthology.orchestra.run.smithi142.stdout: mds bal fragment size max = 10000 2020-01-16T05:43:14.765 INFO:teuthology.orchestra.run.smithi142.stdout: mds op complaint time = 180 2020-01-16T05:43:14.765 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug scatterstat = True 2020-01-16T05:43:14.766 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2020-01-16T05:43:14.766 INFO:teuthology.orchestra.run.smithi142.stdout: mds verify scatter = True 2020-01-16T05:43:14.767 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2020-01-16T05:43:14.767 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2020-01-16T05:43:14.768 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-01-16T05:43:14.768 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2020-01-16T05:43:14.768 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.768 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2020-01-16T05:43:14.768 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.768 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2020-01-16T05:43:14.769 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.769 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2020-01-16T05:43:14.769 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2020-01-16T05:43:14.769 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.769 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2020-01-16T05:43:14.769 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2020-01-16T05:43:14.769 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.769 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2020-01-16T05:43:14.770 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2020-01-16T05:43:14.770 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.770 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2020-01-16T05:43:14.770 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2020-01-16T05:43:14.770 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.770 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2020-01-16T05:43:14.770 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.771 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2020-01-16T05:43:14.771 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2020-01-16T05:43:14.771 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2020-01-16T05:43:14.771 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2020-01-16T05:43:14.771 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2020-01-16T05:43:14.771 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2020-01-16T05:43:14.771 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2020-01-16T05:43:14.771 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-01-16T05:43:14.772 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2020-01-16T05:43:14.772 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.772 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-01-16T05:43:14.772 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.772 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2020-01-16T05:43:14.772 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.772 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2020-01-16T05:43:14.773 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.773 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2020-01-16T05:43:14.773 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2020-01-16T05:43:14.773 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = "172.21.15.84,[v2:172.21.15.142:3301,v1:172.21.15.142:6790],172.21.15.142" 2020-01-16T05:43:14.773 INFO:teuthology.orchestra.run.smithi084.stdout: ms inject delay type = osd mds 2020-01-16T05:43:14.773 INFO:teuthology.orchestra.run.smithi084.stdout: ms inject delay max = 1 2020-01-16T05:43:14.773 INFO:teuthology.orchestra.run.smithi084.stdout: ms inject delay probability = 0.005 2020-01-16T05:43:14.773 INFO:teuthology.orchestra.run.smithi084.stdout: mon client directed command retry = 5 2020-01-16T05:43:14.774 INFO:teuthology.orchestra.run.smithi084.stdout: ms inject socket failures = 2500 2020-01-16T05:43:14.774 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = cbc67508-4d2a-4483-a1fc-95d371063ac4 2020-01-16T05:43:14.774 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.774 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2020-01-16T05:43:14.774 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2020-01-16T05:43:14.775 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.775 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2020-01-16T05:43:14.775 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2020-01-16T05:43:14.775 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.775 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2020-01-16T05:43:14.776 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2020-01-16T05:43:14.776 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.776 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2020-01-16T05:43:14.776 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2020-01-16T05:43:14.776 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2020-01-16T05:43:14.776 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.776 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2020-01-16T05:43:14.776 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2020-01-16T05:43:14.777 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.777 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2020-01-16T05:43:14.777 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.777 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2020-01-16T05:43:14.777 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.777 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2020-01-16T05:43:14.777 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.778 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2020-01-16T05:43:14.778 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2020-01-16T05:43:14.778 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.778 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2020-01-16T05:43:14.778 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2020-01-16T05:43:14.778 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd full ratio = 0.9 2020-01-16T05:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2020-01-16T05:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore fsck on mount = True 2020-01-16T05:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 25 2020-01-16T05:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore compression mode = aggressive 2020-01-16T05:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluestore = 20 2020-01-16T05:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluefs = 20 2020-01-16T05:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd backfillfull_ratio = 0.85 2020-01-16T05:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: debug rocksdb = 10 2020-01-16T05:43:14.780 INFO:teuthology.orchestra.run.smithi084.stdout: debug journal = 20 2020-01-16T05:43:14.780 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd nearfull ratio = 0.8 2020-01-16T05:43:14.780 INFO:teuthology.orchestra.run.smithi084.stdout: osd objectstore = bluestore 2020-01-16T05:43:14.780 INFO:teuthology.orchestra.run.smithi084.stdout: osd failsafe full ratio = 0.95 2020-01-16T05:43:14.780 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore block size = 96636764160 2020-01-16T05:43:14.780 INFO:teuthology.orchestra.run.smithi084.stdout: debug filestore = 20 2020-01-16T05:43:14.780 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2020-01-16T05:43:14.781 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.781 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2020-01-16T05:43:14.781 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2020-01-16T05:43:14.781 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2020-01-16T05:43:14.781 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2020-01-16T05:43:14.781 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2020-01-16T05:43:14.781 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2020-01-16T05:43:14.782 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2020-01-16T05:43:14.782 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2020-01-16T05:43:14.782 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.782 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2020-01-16T05:43:14.782 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2020-01-16T05:43:14.782 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2020-01-16T05:43:14.782 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2020-01-16T05:43:14.782 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2020-01-16T05:43:14.783 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2020-01-16T05:43:14.783 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2020-01-16T05:43:14.783 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2020-01-16T05:43:14.783 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2020-01-16T05:43:14.783 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2020-01-16T05:43:14.783 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2020-01-16T05:43:14.783 INFO:teuthology.orchestra.run.smithi084.stdout: mon op complaint time = 120 2020-01-16T05:43:14.783 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:43:14.784 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2020-01-16T05:43:14.784 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2020-01-16T05:43:14.784 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2020-01-16T05:43:14.784 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2020-01-16T05:43:14.784 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-01-16T05:43:14.784 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-01-16T05:43:14.785 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2020-01-16T05:43:14.785 INFO:teuthology.orchestra.run.smithi084.stdout: debug client = 20 2020-01-16T05:43:14.785 INFO:teuthology.orchestra.run.smithi084.stdout: client mount timeout = 600 2020-01-16T05:43:14.785 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2020-01-16T05:43:14.785 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.c] 2020-01-16T05:43:14.786 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.b] 2020-01-16T05:43:14.786 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2020-01-16T05:43:14.786 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2020-01-16T05:43:14.786 INFO:teuthology.orchestra.run.smithi084.stdout:[mds] 2020-01-16T05:43:14.787 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug frag = True 2020-01-16T05:43:14.787 INFO:teuthology.orchestra.run.smithi084.stdout: mds bal split bits = 3 2020-01-16T05:43:14.788 INFO:teuthology.orchestra.run.smithi084.stdout: mds bal split size = 100 2020-01-16T05:43:14.788 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds = 20 2020-01-16T05:43:14.788 INFO:teuthology.orchestra.run.smithi084.stdout: mds bal merge size = 5 2020-01-16T05:43:14.788 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2020-01-16T05:43:14.788 INFO:teuthology.orchestra.run.smithi084.stdout: mds bal frag = True 2020-01-16T05:43:14.788 INFO:teuthology.orchestra.run.smithi084.stdout: mds bal fragment size max = 10000 2020-01-16T05:43:14.788 INFO:teuthology.orchestra.run.smithi084.stdout: mds op complaint time = 180 2020-01-16T05:43:14.789 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug scatterstat = True 2020-01-16T05:43:14.789 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2020-01-16T05:43:14.789 INFO:teuthology.orchestra.run.smithi084.stdout: mds verify scatter = True 2020-01-16T05:43:14.789 INFO:tasks.ceph:Creating admin key on mon.a... 2020-01-16T05:43:14.789 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-01-16T05:43:14.856 INFO:tasks.ceph:Copying monmap to all nodes... 2020-01-16T05:43:14.862 DEBUG:teuthology.orchestra.remote:smithi084:/etc/ceph/ceph.keyring is 206B 2020-01-16T05:43:14.923 DEBUG:teuthology.orchestra.remote:smithi084:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-01-16T05:43:14.933 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi084.front.sepia.ceph.com 2020-01-16T05:43:14.934 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-01-16T05:43:14.990 INFO:teuthology.orchestra.run.smithi084:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-01-16T05:43:15.076 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2020-01-16T05:43:15.076 INFO:teuthology.orchestra.run.smithi142:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-01-16T05:43:15.133 INFO:teuthology.orchestra.run.smithi142:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-01-16T05:43:15.223 INFO:tasks.ceph:Setting up mon nodes... 2020-01-16T05:43:15.223 INFO:tasks.ceph:Setting up mgr nodes... 2020-01-16T05:43:15.223 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-01-16T05:43:15.265 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-01-16T05:43:15.267 INFO:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-01-16T05:43:15.309 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-01-16T05:43:15.312 INFO:tasks.ceph:Setting up mds nodes... 2020-01-16T05:43:15.312 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-01-16T05:43:15.353 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-01-16T05:43:15.355 INFO:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-01-16T05:43:15.414 INFO:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-01-16T05:43:15.459 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-01-16T05:43:15.493 INFO:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-01-16T05:43:15.566 INFO:tasks.ceph_client:Setting up client nodes... 2020-01-16T05:43:15.567 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-01-16T05:43:15.605 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-01-16T05:43:15.615 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-01-16T05:43:15.615 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'}} 2020-01-16T05:43:15.615 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-01-16T05:43:15.675 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-01-16T05:43:15.675 INFO:tasks.ceph:{} 2020-01-16T05:43:15.675 INFO:tasks.ceph:osd.0 2020-01-16T05:43:15.675 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com 2020-01-16T05:43:15.675 INFO:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-01-16T05:43:16.198 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-01-16T05:43:16.198 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2020-01-16T05:43:16.198 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-01-16T05:43:16.198 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-01-16T05:43:16.198 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2020-01-16T05:43:16.199 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-01-16T05:43:16.199 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-01-16T05:43:16.199 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-01-16T05:43:16.199 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-01-16T05:43:16.200 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2020-01-16T05:43:16.200 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2020-01-16T05:43:16.273 INFO:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-01-16T05:43:16.284 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: /sbin/restorecon: command not found 2020-01-16T05:43:16.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-01-16T05:43:16.285 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-01-16T05:43:16.345 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-01-16T05:43:16.345 INFO:tasks.ceph:{} 2020-01-16T05:43:16.345 INFO:tasks.ceph:osd.1 2020-01-16T05:43:16.345 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com 2020-01-16T05:43:16.345 INFO:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-01-16T05:43:16.871 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-01-16T05:43:16.871 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2020-01-16T05:43:16.872 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-01-16T05:43:16.872 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-01-16T05:43:16.872 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2020-01-16T05:43:16.873 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-01-16T05:43:16.873 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-01-16T05:43:16.873 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-01-16T05:43:16.873 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-01-16T05:43:16.874 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2020-01-16T05:43:16.874 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2020-01-16T05:43:16.937 INFO:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-01-16T05:43:16.948 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: /sbin/restorecon: command not found 2020-01-16T05:43:16.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-01-16T05:43:16.949 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-01-16T05:43:17.008 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-01-16T05:43:17.008 INFO:tasks.ceph:{} 2020-01-16T05:43:17.008 INFO:tasks.ceph:osd.2 2020-01-16T05:43:17.008 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com 2020-01-16T05:43:17.008 INFO:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-01-16T05:43:17.515 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-01-16T05:43:17.515 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2020-01-16T05:43:17.515 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-01-16T05:43:17.515 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-01-16T05:43:17.515 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2020-01-16T05:43:17.515 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-01-16T05:43:17.516 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-01-16T05:43:17.516 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-01-16T05:43:17.516 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-01-16T05:43:17.517 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2020-01-16T05:43:17.517 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2020-01-16T05:43:17.560 INFO:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-01-16T05:43:17.615 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: /sbin/restorecon: command not found 2020-01-16T05:43:17.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-01-16T05:43:17.616 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-01-16T05:43:17.673 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-01-16T05:43:17.674 INFO:tasks.ceph:{} 2020-01-16T05:43:17.674 INFO:tasks.ceph:osd.3 2020-01-16T05:43:17.674 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com 2020-01-16T05:43:17.674 INFO:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-01-16T05:43:18.210 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-01-16T05:43:18.210 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2020-01-16T05:43:18.210 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-01-16T05:43:18.210 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-01-16T05:43:18.210 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2020-01-16T05:43:18.211 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-01-16T05:43:18.211 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-01-16T05:43:18.211 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-01-16T05:43:18.211 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-01-16T05:43:18.212 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2020-01-16T05:43:18.212 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2020-01-16T05:43:18.266 INFO:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-01-16T05:43:18.276 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: /sbin/restorecon: command not found 2020-01-16T05:43:18.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-01-16T05:43:18.277 INFO:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-01-16T05:43:18.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:18.379+0000 7fdfbee14d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-01-16T05:43:18.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:18.383+0000 7fdfbee14d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-01-16T05:43:18.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:18.383+0000 7fdfbee14d80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-01-16T05:43:18.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:18.383+0000 7fdfbee14d80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-01-16T05:43:18.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:18.383+0000 7fdfbee14d80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-01-16T05:43:18.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:18.391+0000 7fdfbee14d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-01-16T05:43:20.865 INFO:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-01-16T05:43:20.910 INFO:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-01-16T05:43:21.182 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:21.179+0000 7fb73621ad80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-01-16T05:43:21.182 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:21.179+0000 7fb73621ad80 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-01-16T05:43:21.182 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:21.179+0000 7fb73621ad80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-01-16T05:43:21.182 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:21.179+0000 7fb73621ad80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-01-16T05:43:21.183 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:21.179+0000 7fb73621ad80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-01-16T05:43:21.183 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:21.179+0000 7fb73621ad80 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-01-16T05:43:23.618 INFO:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-01-16T05:43:23.675 INFO:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-01-16T05:43:23.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:23.755+0000 7f5db0bbad80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-01-16T05:43:23.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:23.755+0000 7f5db0bbad80 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-01-16T05:43:23.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:23.755+0000 7f5db0bbad80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-01-16T05:43:23.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:23.755+0000 7f5db0bbad80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-01-16T05:43:23.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:23.755+0000 7f5db0bbad80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-01-16T05:43:23.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:23.755+0000 7f5db0bbad80 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-01-16T05:43:26.186 INFO:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-01-16T05:43:26.242 INFO:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-01-16T05:43:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:26.319+0000 7fa93c320d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-01-16T05:43:26.320 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:26.319+0000 7fa93c320d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-01-16T05:43:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:26.319+0000 7fa93c320d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-01-16T05:43:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:26.319+0000 7fa93c320d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-01-16T05:43:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:26.319+0000 7fa93c320d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-01-16T05:43:26.321 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:26.319+0000 7fa93c320d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-01-16T05:43:28.773 INFO:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-01-16T05:43:28.834 INFO:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-01-16T05:43:28.850 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-01-16T05:43:28.850 INFO:tasks.ceph:{} 2020-01-16T05:43:28.850 INFO:tasks.ceph:osd.4 2020-01-16T05:43:28.851 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2020-01-16T05:43:28.851 INFO:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-01-16T05:43:29.368 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-01-16T05:43:29.368 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2020-01-16T05:43:29.369 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-01-16T05:43:29.369 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-01-16T05:43:29.369 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2020-01-16T05:43:29.369 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-01-16T05:43:29.369 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-01-16T05:43:29.369 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-01-16T05:43:29.370 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-01-16T05:43:29.370 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2020-01-16T05:43:29.371 INFO:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2020-01-16T05:43:29.452 INFO:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-01-16T05:43:29.462 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2020-01-16T05:43:29.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-01-16T05:43:29.463 INFO:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-01-16T05:43:29.520 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-01-16T05:43:29.521 INFO:tasks.ceph:{} 2020-01-16T05:43:29.521 INFO:tasks.ceph:osd.5 2020-01-16T05:43:29.521 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2020-01-16T05:43:29.521 INFO:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-01-16T05:43:30.033 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-01-16T05:43:30.033 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2020-01-16T05:43:30.034 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-01-16T05:43:30.034 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-01-16T05:43:30.034 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2020-01-16T05:43:30.034 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-01-16T05:43:30.034 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-01-16T05:43:30.034 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-01-16T05:43:30.034 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-01-16T05:43:30.035 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2020-01-16T05:43:30.036 INFO:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-5 2020-01-16T05:43:30.108 INFO:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-01-16T05:43:30.119 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2020-01-16T05:43:30.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-01-16T05:43:30.120 INFO:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-01-16T05:43:30.176 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-01-16T05:43:30.176 INFO:tasks.ceph:{} 2020-01-16T05:43:30.176 INFO:tasks.ceph:osd.6 2020-01-16T05:43:30.176 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2020-01-16T05:43:30.177 INFO:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-01-16T05:43:30.668 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-01-16T05:43:30.669 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2020-01-16T05:43:30.669 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-01-16T05:43:30.669 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-01-16T05:43:30.669 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2020-01-16T05:43:30.669 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-01-16T05:43:30.670 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-01-16T05:43:30.670 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-01-16T05:43:30.670 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-01-16T05:43:30.671 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2020-01-16T05:43:30.671 INFO:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2020-01-16T05:43:30.724 INFO:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-01-16T05:43:30.734 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2020-01-16T05:43:30.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-01-16T05:43:30.736 INFO:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-01-16T05:43:30.792 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-01-16T05:43:30.793 INFO:tasks.ceph:{} 2020-01-16T05:43:30.793 INFO:tasks.ceph:osd.7 2020-01-16T05:43:30.793 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2020-01-16T05:43:30.793 INFO:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-01-16T05:43:31.334 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-01-16T05:43:31.335 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2020-01-16T05:43:31.335 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-01-16T05:43:31.335 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-01-16T05:43:31.335 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2020-01-16T05:43:31.335 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-01-16T05:43:31.335 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-01-16T05:43:31.336 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-01-16T05:43:31.336 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-01-16T05:43:31.336 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2020-01-16T05:43:31.336 INFO:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2020-01-16T05:43:31.389 INFO:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-01-16T05:43:31.443 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2020-01-16T05:43:31.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-01-16T05:43:31.444 INFO:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-01-16T05:43:31.541 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:31.538+0000 7f952cc84d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-01-16T05:43:31.544 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:31.542+0000 7f952cc84d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-01-16T05:43:31.544 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:31.542+0000 7f952cc84d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-01-16T05:43:31.544 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:31.542+0000 7f952cc84d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-01-16T05:43:31.544 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:31.542+0000 7f952cc84d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-01-16T05:43:31.551 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:31.550+0000 7f952cc84d80 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-01-16T05:43:34.000 INFO:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-01-16T05:43:34.015 INFO:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-01-16T05:43:34.095 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:34.094+0000 7f4eda4d6d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-01-16T05:43:34.096 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:34.094+0000 7f4eda4d6d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-01-16T05:43:34.096 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:34.094+0000 7f4eda4d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-01-16T05:43:34.096 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:34.094+0000 7f4eda4d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-01-16T05:43:34.096 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:34.094+0000 7f4eda4d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-01-16T05:43:34.097 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:34.094+0000 7f4eda4d6d80 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-01-16T05:43:36.552 INFO:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-01-16T05:43:36.608 INFO:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-01-16T05:43:36.688 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:36.686+0000 7f3bdb1a3d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-01-16T05:43:36.689 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:36.686+0000 7f3bdb1a3d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-01-16T05:43:36.689 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:36.686+0000 7f3bdb1a3d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-01-16T05:43:36.689 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:36.686+0000 7f3bdb1a3d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-01-16T05:43:36.689 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:36.686+0000 7f3bdb1a3d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-01-16T05:43:36.689 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:36.690+0000 7f3bdb1a3d80 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-01-16T05:43:39.139 INFO:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-01-16T05:43:39.196 INFO:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-01-16T05:43:39.273 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:39.270+0000 7faaf0979d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-01-16T05:43:39.273 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:39.270+0000 7faaf0979d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-01-16T05:43:39.273 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:39.274+0000 7faaf0979d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-01-16T05:43:39.274 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:39.274+0000 7faaf0979d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-01-16T05:43:39.274 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:39.274+0000 7faaf0979d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-01-16T05:43:39.275 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:39.274+0000 7faaf0979d80 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-01-16T05:43:41.715 INFO:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-01-16T05:43:41.772 INFO:tasks.ceph:Reading keys from all nodes... 2020-01-16T05:43:41.773 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-01-16T05:43:41.779 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.6yUXovCY9z 2020-01-16T05:43:41.779 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.6yUXovCY9z 2020-01-16T05:43:41.837 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.6yUXovCY9z 2020-01-16T05:43:41.947 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.6yUXovCY9z is 56B 2020-01-16T05:43:41.959 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.6yUXovCY9z 2020-01-16T05:43:41.965 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-01-16T05:43:42.012 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.25KTfZOiAz 2020-01-16T05:43:42.013 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.25KTfZOiAz 2020-01-16T05:43:42.070 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.25KTfZOiAz 2020-01-16T05:43:42.175 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.25KTfZOiAz is 56B 2020-01-16T05:43:42.186 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.25KTfZOiAz 2020-01-16T05:43:42.192 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-01-16T05:43:42.240 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.OaJ4bcahU4 2020-01-16T05:43:42.240 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.OaJ4bcahU4 2020-01-16T05:43:42.297 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.OaJ4bcahU4 2020-01-16T05:43:42.402 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.OaJ4bcahU4 is 56B 2020-01-16T05:43:42.413 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.OaJ4bcahU4 2020-01-16T05:43:42.419 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-01-16T05:43:42.468 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.HLto96JKsz 2020-01-16T05:43:42.468 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.HLto96JKsz 2020-01-16T05:43:42.525 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.HLto96JKsz 2020-01-16T05:43:42.631 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.HLto96JKsz is 56B 2020-01-16T05:43:42.642 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.HLto96JKsz 2020-01-16T05:43:42.648 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-01-16T05:43:42.696 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.ZlRmMNGqAK 2020-01-16T05:43:42.696 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.ZlRmMNGqAK 2020-01-16T05:43:42.753 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.ZlRmMNGqAK 2020-01-16T05:43:42.858 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.ZlRmMNGqAK is 56B 2020-01-16T05:43:42.869 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.ZlRmMNGqAK 2020-01-16T05:43:42.875 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-01-16T05:43:42.924 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.mZqvLJMBP4 2020-01-16T05:43:42.925 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.mZqvLJMBP4 2020-01-16T05:43:42.983 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.mZqvLJMBP4 2020-01-16T05:43:43.091 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.mZqvLJMBP4 is 56B 2020-01-16T05:43:43.101 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.mZqvLJMBP4 2020-01-16T05:43:43.107 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-01-16T05:43:43.113 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.2yrF41VE9w 2020-01-16T05:43:43.113 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.2yrF41VE9w 2020-01-16T05:43:43.174 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.2yrF41VE9w 2020-01-16T05:43:43.280 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.2yrF41VE9w is 56B 2020-01-16T05:43:43.291 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.2yrF41VE9w 2020-01-16T05:43:43.296 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-01-16T05:43:43.342 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.rHndl5YlJ9 2020-01-16T05:43:43.343 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.rHndl5YlJ9 2020-01-16T05:43:43.400 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.rHndl5YlJ9 2020-01-16T05:43:43.504 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.rHndl5YlJ9 is 56B 2020-01-16T05:43:43.558 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.rHndl5YlJ9 2020-01-16T05:43:43.564 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-01-16T05:43:43.611 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.CIHTzc3g8k 2020-01-16T05:43:43.611 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.CIHTzc3g8k 2020-01-16T05:43:43.668 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.CIHTzc3g8k 2020-01-16T05:43:43.748 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:43:43.750 INFO:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:43:43.854 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.CIHTzc3g8k is 56B 2020-01-16T05:43:43.864 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.CIHTzc3g8k 2020-01-16T05:43:43.870 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-01-16T05:43:43.920 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.IAcMWQygCB 2020-01-16T05:43:43.920 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.IAcMWQygCB 2020-01-16T05:43:43.976 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.IAcMWQygCB 2020-01-16T05:43:44.087 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.IAcMWQygCB is 56B 2020-01-16T05:43:44.099 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.IAcMWQygCB 2020-01-16T05:43:44.106 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-01-16T05:43:44.155 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.Hpdj3yBNHr 2020-01-16T05:43:44.155 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.Hpdj3yBNHr 2020-01-16T05:43:44.214 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.Hpdj3yBNHr 2020-01-16T05:43:44.320 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.Hpdj3yBNHr is 56B 2020-01-16T05:43:44.331 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.Hpdj3yBNHr 2020-01-16T05:43:44.440 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-01-16T05:43:44.446 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.vOuQkc6ZAR 2020-01-16T05:43:44.446 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.vOuQkc6ZAR 2020-01-16T05:43:44.503 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.vOuQkc6ZAR 2020-01-16T05:43:44.616 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.vOuQkc6ZAR is 56B 2020-01-16T05:43:44.628 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.vOuQkc6ZAR 2020-01-16T05:43:44.648 DEBUG:teuthology.orchestra.remote:smithi084:/etc/ceph/ceph.client.0.keyring is 59B 2020-01-16T05:43:44.659 INFO:tasks.ceph:Adding keys to all mons... 2020-01-16T05:43:44.660 INFO:teuthology.orchestra.run.smithi084:> sudo tee -a /etc/ceph/ceph.keyring 2020-01-16T05:43:44.662 INFO:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2020-01-16T05:43:44.693 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2020-01-16T05:43:44.693 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDz9x9ePDPdDxAAH0O39cBYxer2CCujmwVT9w== 2020-01-16T05:43:44.693 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2020-01-16T05:43:44.694 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDz9x9eOfwpFRAAqxhNdD/w46I4CSR9CSy4Uw== 2020-01-16T05:43:44.694 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2020-01-16T05:43:44.694 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQD29x9e2DHvFhAAvQeZMT9deMbGwqcIWKx7Eg== 2020-01-16T05:43:44.694 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2020-01-16T05:43:44.694 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQD59x9ejFrqChAAx6IJSOTvrkKAy341Sbe2Rw== 2020-01-16T05:43:44.694 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2020-01-16T05:43:44.694 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQD79x9ePK40LRAASDkCutXYJPjwUQs87TUgHQ== 2020-01-16T05:43:44.695 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2020-01-16T05:43:44.695 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQD+9x9edUswExAAYCdS6Wn1SH51tQr3nNBniA== 2020-01-16T05:43:44.695 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2020-01-16T05:43:44.695 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDz9x9eBsuNEhAA+GEsK1moGZ2HxN6e4JuuHw== 2020-01-16T05:43:44.695 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2020-01-16T05:43:44.695 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDz9x9ev61gGxAAQyDIfzDf+1uCd8mCO1uMUA== 2020-01-16T05:43:44.695 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2020-01-16T05:43:44.696 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAD+B9e56lcIBAAE1YISciMnSXCGYqI3uGwrw== 2020-01-16T05:43:44.696 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2020-01-16T05:43:44.696 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAG+B9en3XFBRAAcemI34X+1yf/8umMY3So5A== 2020-01-16T05:43:44.696 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2020-01-16T05:43:44.696 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAI+B9exBImKRAAv9A6dF4ZUhphEIVbcm89gQ== 2020-01-16T05:43:44.696 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2020-01-16T05:43:44.696 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAL+B9eFv1kEBAAFeZWhC9XVsAF1eSxTw4f8A== 2020-01-16T05:43:44.696 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2020-01-16T05:43:44.697 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDz9x9ey8EaJBAAP216fzH0gQ/l1V+Y53SRBA== 2020-01-16T05:43:44.703 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.y] 2020-01-16T05:43:44.703 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDz9x9ePDPdDxAAH0O39cBYxer2CCujmwVT9w== 2020-01-16T05:43:44.703 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2020-01-16T05:43:44.703 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDz9x9eOfwpFRAAqxhNdD/w46I4CSR9CSy4Uw== 2020-01-16T05:43:44.703 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.0] 2020-01-16T05:43:44.703 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQD29x9e2DHvFhAAvQeZMT9deMbGwqcIWKx7Eg== 2020-01-16T05:43:44.704 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.1] 2020-01-16T05:43:44.704 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQD59x9ejFrqChAAx6IJSOTvrkKAy341Sbe2Rw== 2020-01-16T05:43:44.704 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.2] 2020-01-16T05:43:44.704 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQD79x9ePK40LRAASDkCutXYJPjwUQs87TUgHQ== 2020-01-16T05:43:44.704 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.3] 2020-01-16T05:43:44.704 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQD+9x9edUswExAAYCdS6Wn1SH51tQr3nNBniA== 2020-01-16T05:43:44.704 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.x] 2020-01-16T05:43:44.705 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDz9x9eBsuNEhAA+GEsK1moGZ2HxN6e4JuuHw== 2020-01-16T05:43:44.705 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2020-01-16T05:43:44.705 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDz9x9ev61gGxAAQyDIfzDf+1uCd8mCO1uMUA== 2020-01-16T05:43:44.705 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.4] 2020-01-16T05:43:44.705 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAD+B9e56lcIBAAE1YISciMnSXCGYqI3uGwrw== 2020-01-16T05:43:44.705 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.5] 2020-01-16T05:43:44.705 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAG+B9en3XFBRAAcemI34X+1yf/8umMY3So5A== 2020-01-16T05:43:44.705 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.6] 2020-01-16T05:43:44.706 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAI+B9exBImKRAAv9A6dF4ZUhphEIVbcm89gQ== 2020-01-16T05:43:44.706 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.7] 2020-01-16T05:43:44.706 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAL+B9eFv1kEBAAFeZWhC9XVsAF1eSxTw4f8A== 2020-01-16T05:43:44.706 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2020-01-16T05:43:44.706 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDz9x9ey8EaJBAAP216fzH0gQ/l1V+Y53SRBA== 2020-01-16T05:43:44.707 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-01-16T05:43:44.752 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-01-16T05:43:44.793 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-01-16T05:43:44.836 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-01-16T05:43:44.881 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-16T05:43:44.920 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-16T05:43:44.965 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-16T05:43:45.008 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-16T05:43:45.050 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-16T05:43:45.092 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-16T05:43:45.138 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-16T05:43:45.176 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-16T05:43:45.221 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-01-16T05:43:45.260 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-01-16T05:43:45.310 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-01-16T05:43:45.344 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-01-16T05:43:45.396 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-16T05:43:45.428 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-16T05:43:45.482 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-16T05:43:45.512 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-16T05:43:45.562 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-16T05:43:45.596 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-16T05:43:45.646 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-16T05:43:45.680 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-16T05:43:45.730 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-01-16T05:43:45.772 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-01-16T05:43:45.816 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-01-16T05:43:45.817 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-01-16T05:43:45.869 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-01-16T05:43:45.981 INFO:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-01-16T05:43:46.001 INFO:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-01-16T05:43:46.030 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-01-16T05:43:46.147 INFO:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-01-16T05:43:46.163 INFO:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-01-16T05:43:46.219 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-01-16T05:43:46.340 INFO:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-01-16T05:43:46.362 INFO:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-01-16T05:43:46.364 INFO:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-01-16T05:43:46.410 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-01-16T05:43:46.411 INFO:tasks.ceph.mon.a:Restarting daemon 2020-01-16T05:43:46.411 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-01-16T05:43:46.413 INFO:tasks.ceph.mon.a:Started 2020-01-16T05:43:46.413 INFO:tasks.ceph.mon.b:Restarting daemon 2020-01-16T05:43:46.413 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-01-16T05:43:46.454 INFO:tasks.ceph.mon.b:Started 2020-01-16T05:43:46.454 INFO:tasks.ceph.mon.c:Restarting daemon 2020-01-16T05:43:46.455 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-01-16T05:43:46.457 INFO:tasks.ceph.mon.c:Started 2020-01-16T05:43:46.457 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-01-16T05:43:46.457 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-01-16T05:43:46.457 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-01-16T05:43:46.459 INFO:tasks.ceph.mgr.y:Started 2020-01-16T05:43:46.460 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-01-16T05:43:46.460 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-01-16T05:43:46.462 INFO:tasks.ceph.mgr.x:Started 2020-01-16T05:43:46.462 INFO:tasks.ceph:Setting crush tunables to default 2020-01-16T05:43:46.462 INFO:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd crush tunables default 2020-01-16T05:43:46.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.719+0000 7f40eb59e700 1 Processor -- start 2020-01-16T05:43:46.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.719+0000 7f40eb59e700 1 -- start start 2020-01-16T05:43:46.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.719+0000 7f40eb59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f40e403c700 0x7f40e40e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:46.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.719+0000 7f40eb59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40e6c40 0x7f40e4020ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:46.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.719+0000 7f40eb59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f40e40211f0 0x7f40e4022ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:46.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.719+0000 7f40eb59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e4022570 con 0x7f40e403c700 2020-01-16T05:43:46.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.719+0000 7f40eb59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e4022810 con 0x7f40e40211f0 2020-01-16T05:43:46.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.719+0000 7f40eb59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e4023000 con 0x7f40e40e6c40 2020-01-16T05:43:46.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.719+0000 7f40ead9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f40e403c700 0x7f40e40e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:46.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.719+0000 7f40ead9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f40e403c700 0x7f40e40e66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33454/0 (socket says 172.21.15.84:33454) 2020-01-16T05:43:46.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.719+0000 7f40ead9d700 1 -- 172.21.15.84:0/405016822 learned_addr learned my addr 172.21.15.84:0/405016822 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:43:46.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.719+0000 7f40ead9d700 1 -- 172.21.15.84:0/405016822 >> v2:172.21.15.84:3300/0 conn(0x7f40e403c700 msgr2=0x7f40e40e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-01-16T05:43:46.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.719+0000 7f40ead9d700 1 -- 172.21.15.84:0/405016822 >> v2:172.21.15.84:3300/0 conn(0x7f40e403c700 msgr2=0x7f40e40e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-01-16T05:43:46.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.719+0000 7f40f0b33700 1 --2- 172.21.15.84:0/405016822 >> v2:172.21.15.142:3300/0 conn(0x7f40e40211f0 0x7f40e4022ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:46.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.719+0000 7f40ead9d700 1 --2- 172.21.15.84:0/405016822 >> v2:172.21.15.84:3300/0 conn(0x7f40e403c700 0x7f40e40e66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-01-16T05:43:46.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.723+0000 7f40ead9d700 1 --2- 172.21.15.84:0/405016822 >> v2:172.21.15.84:3300/0 conn(0x7f40e403c700 0x7f40e40e66f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-16T05:43:46.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.719+0000 7f40ea59c700 1 --2- 172.21.15.84:0/405016822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40e6c40 0x7f40e4020ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:46.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.723+0000 7f40f0b33700 1 -- 172.21.15.84:0/405016822 >> v2:172.21.15.142:3300/0 conn(0x7f40e40211f0 msgr2=0x7f40e4022ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-01-16T05:43:46.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.723+0000 7f40f0b33700 1 -- 172.21.15.84:0/405016822 >> v2:172.21.15.142:3300/0 conn(0x7f40e40211f0 msgr2=0x7f40e4022ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-01-16T05:43:46.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.723+0000 7f40f0b33700 1 --2- 172.21.15.84:0/405016822 >> v2:172.21.15.142:3300/0 conn(0x7f40e40211f0 0x7f40e4022ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-01-16T05:43:46.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.723+0000 7f40f0b33700 1 --2- 172.21.15.84:0/405016822 >> v2:172.21.15.142:3300/0 conn(0x7f40e40211f0 0x7f40e4022ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-16T05:43:46.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.723+0000 7f40ea59c700 1 -- 172.21.15.84:0/405016822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40e6c40 msgr2=0x7f40e4020ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-01-16T05:43:46.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.723+0000 7f40ea59c700 1 -- 172.21.15.84:0/405016822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40e6c40 msgr2=0x7f40e4020ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-01-16T05:43:46.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.723+0000 7f40ea59c700 1 --2- 172.21.15.84:0/405016822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40e6c40 0x7f40e4020ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-01-16T05:43:46.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.723+0000 7f40ea59c700 1 --2- 172.21.15.84:0/405016822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40e6c40 0x7f40e4020ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-16T05:43:46.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40ead9d700 1 --2- 172.21.15.84:0/405016822 >> v2:172.21.15.84:3300/0 conn(0x7f40e403c700 0x7f40e40e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:46.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40ea59c700 1 --2- 172.21.15.84:0/405016822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40e6c40 0x7f40e4020ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:46.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40f0b33700 1 --2- 172.21.15.84:0/405016822 >> v2:172.21.15.142:3300/0 conn(0x7f40e40211f0 0x7f40e4022ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:46.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40ead9d700 1 -- 172.21.15.84:0/405016822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40e6c40 msgr2=0x7f40e4020ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:46.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40ead9d700 1 --2- 172.21.15.84:0/405016822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40e6c40 0x7f40e4020ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:46.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40ead9d700 1 -- 172.21.15.84:0/405016822 >> v2:172.21.15.142:3300/0 conn(0x7f40e40211f0 msgr2=0x7f40e4022ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:46.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40ead9d700 1 --2- 172.21.15.84:0/405016822 >> v2:172.21.15.142:3300/0 conn(0x7f40e40211f0 0x7f40e4022ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:46.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40ead9d700 1 -- 172.21.15.84:0/405016822 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e40231f0 con 0x7f40e403c700 2020-01-16T05:43:46.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40ea59c700 1 --2- 172.21.15.84:0/405016822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40e6c40 0x7f40e4020ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:43:46.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40ead9d700 1 --2- 172.21.15.84:0/405016822 >> v2:172.21.15.84:3300/0 conn(0x7f40e403c700 0x7f40e40e66f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f40e4003cd0 tx=0x7f40dc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:46.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40ead9d700 1 --2- 172.21.15.84:0/405016822 >> v2:172.21.15.84:3300/0 conn(0x7f40e403c700 0x7f40e40e66f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f40e4003cd0 tx=0x7f40dc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:46.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40ead9d700 1 --2- 172.21.15.84:0/405016822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e403c700 0x7f40e40e66f0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f40e4003cd0 tx=0x7f40dc00ff30).ready entity=mon.0 client_cookie=bb5a53dc6108e09b server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:46.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40ead9d700 1 --2- 172.21.15.84:0/405016822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e403c700 0x7f40e40e66f0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f40e4003cd0 tx=0x7f40dc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:46.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40e9d9b700 1 -- 172.21.15.84:0/405016822 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40dc011760 con 0x7f40e403c700 2020-01-16T05:43:46.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40ead9d700 1 --2- 172.21.15.84:0/405016822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e403c700 0x7f40e40e66f0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f40e4003cd0 tx=0x7f40dc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:46.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40ead9d700 1 --2- 172.21.15.84:0/405016822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e403c700 0x7f40e40e66f0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f40e4003cd0 tx=0x7f40dc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:46.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40e9d9b700 1 -- 172.21.15.84:0/405016822 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc008d30 con 0x7f40e403c700 2020-01-16T05:43:46.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40e9d9b700 1 -- 172.21.15.84:0/405016822 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40dc011d40 con 0x7f40e403c700 2020-01-16T05:43:46.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40eb59e700 1 -- 172.21.15.84:0/405016822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e403c700 msgr2=0x7f40e40e66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:46.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40eb59e700 1 --2- 172.21.15.84:0/405016822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e403c700 0x7f40e40e66f0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f40e4003cd0 tx=0x7f40dc00ff30).stop 2020-01-16T05:43:46.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40eb59e700 1 -- 172.21.15.84:0/405016822 shutdown_connections 2020-01-16T05:43:46.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40eb59e700 1 --2- 172.21.15.84:0/405016822 >> v2:172.21.15.142:3300/0 conn(0x7f40e40211f0 0x7f40e4022ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:46.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40eb59e700 1 --2- 172.21.15.84:0/405016822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e403c700 0x7f40e40e66f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:46.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40eb59e700 1 --2- 172.21.15.84:0/405016822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40e6c40 0x7f40e4020ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:46.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40eb59e700 1 -- 172.21.15.84:0/405016822 shutdown_connections 2020-01-16T05:43:46.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40eb59e700 1 -- 172.21.15.84:0/405016822 wait complete. 2020-01-16T05:43:46.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.927+0000 7f40eb59e700 1 -- 172.21.15.84:0/405016822 >> 172.21.15.84:0/405016822 conn(0x7f40e403d870 msgr2=0x7f40e403dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.931+0000 7f40eb59e700 1 Processor -- start 2020-01-16T05:43:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.931+0000 7f40eb59e700 1 -- start start 2020-01-16T05:43:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.931+0000 7f40eb59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f40e40e95d0 0x7f40e40e70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.931+0000 7f40eb59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40c0480 0x7f40e40c08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:46.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40eb59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e40c0e00 con 0x7f40e4038c70 2020-01-16T05:43:46.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40eb59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e402d9c0 con 0x7f40e40e95d0 2020-01-16T05:43:46.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40eb59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40e9ee0 con 0x7f40e40c0480 2020-01-16T05:43:46.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40ead9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f40e4038c70 0x7f40e402d100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50682/0 (socket says 172.21.15.84:50682) 2020-01-16T05:43:46.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40ead9d700 1 -- 172.21.15.84:0/1033520581 learned_addr learned my addr 172.21.15.84:0/1033520581 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:43:46.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40ea59c700 1 --2- 172.21.15.84:0/1033520581 >> v2:172.21.15.142:3300/0 conn(0x7f40e40e95d0 0x7f40e40e70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:46.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40f0b33700 1 --2- 172.21.15.84:0/1033520581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40c0480 0x7f40e40c08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:46.944 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40db7fe700 1 -- 172.21.15.84:0/1033520581 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910517908 0 0) 0x7f40e40c0e00 con 0x7f40e4038c70 2020-01-16T05:43:46.944 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40ea59c700 1 -- 172.21.15.84:0/1033520581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40c0480 msgr2=0x7f40e40c08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:46.944 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40ea59c700 1 --2- 172.21.15.84:0/1033520581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40c0480 0x7f40e40c08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:46.944 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40ea59c700 1 -- 172.21.15.84:0/1033520581 >> v1:172.21.15.84:6789/0 conn(0x7f40e4038c70 legacy=0x7f40e402d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:46.944 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40ea59c700 1 -- 172.21.15.84:0/1033520581 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e40e9a00 con 0x7f40e40e95d0 2020-01-16T05:43:46.944 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40ea59c700 1 --2- 172.21.15.84:0/1033520581 >> v2:172.21.15.142:3300/0 conn(0x7f40e40e95d0 0x7f40e40e70a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f40e0002f30 tx=0x7f40e0010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:46.944 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40ea59c700 1 --2- 172.21.15.84:0/1033520581 >> v2:172.21.15.142:3300/0 conn(0x7f40e40e95d0 0x7f40e40e70a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f40e0002f30 tx=0x7f40e0010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:46.945 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40ea59c700 1 --2- 172.21.15.84:0/1033520581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e40e95d0 0x7f40e40e70a0 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7f40e0002f30 tx=0x7f40e0010ee0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:46.945 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40ea59c700 1 --2- 172.21.15.84:0/1033520581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e40e95d0 0x7f40e40e70a0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f40e0002f30 tx=0x7f40e0010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:46.945 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40db7fe700 1 -- 172.21.15.84:0/1033520581 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40e00059c0 con 0x7f40e40e95d0 2020-01-16T05:43:46.945 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40ea59c700 1 --2- 172.21.15.84:0/1033520581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e40e95d0 0x7f40e40e70a0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f40e0002f30 tx=0x7f40e0010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:46.945 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40ea59c700 1 --2- 172.21.15.84:0/1033520581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e40e95d0 0x7f40e40e70a0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f40e0002f30 tx=0x7f40e0010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:46.945 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40db7fe700 1 -- 172.21.15.84:0/1033520581 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e0007160 con 0x7f40e40e95d0 2020-01-16T05:43:46.945 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40eb59e700 1 -- 172.21.15.84:0/1033520581 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e40e75f0 con 0x7f40e40e95d0 2020-01-16T05:43:46.945 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40db7fe700 1 -- 172.21.15.84:0/1033520581 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40e0008950 con 0x7f40e40e95d0 2020-01-16T05:43:46.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40eb59e700 1 -- 172.21.15.84:0/1033520581 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e40d8130 con 0x7f40e40e95d0 2020-01-16T05:43:46.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40ea59c700 1 --2- 172.21.15.84:0/1033520581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e40e95d0 0x7f40e40e70a0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f40e0002f30 tx=0x7f40e0010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:46.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40db7fe700 1 -- 172.21.15.84:0/1033520581 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7f40e000b250 con 0x7f40e40e95d0 2020-01-16T05:43:46.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40ea59c700 1 --2- 172.21.15.84:0/1033520581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e40e95d0 0x7f40e40e70a0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f40e0002f30 tx=0x7f40e0010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:46.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40db7fe700 1 -- 172.21.15.84:0/1033520581 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f40e000b560 con 0x7f40e40e95d0 2020-01-16T05:43:46.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.935+0000 7f40eb59e700 1 -- 172.21.15.84:0/1033520581 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e4004cf0 con 0x7f40e40e95d0 2020-01-16T05:43:46.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.943+0000 7f40ea59c700 1 --2- 172.21.15.84:0/1033520581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e40e95d0 0x7f40e40e70a0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f40e0002f30 tx=0x7f40e0010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:46.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:46.943+0000 7f40db7fe700 1 -- 172.21.15.84:0/1033520581 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67593 (secure 0 0 0) 0x7f40e0012c40 con 0x7f40e40e95d0 2020-01-16T05:43:47.013 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:47.011+0000 7f40eb59e700 1 -- 172.21.15.84:0/1033520581 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f40e4008210 con 0x7f40e40e95d0 2020-01-16T05:43:47.021 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:47.019+0000 7f40ea59c700 1 --2- 172.21.15.84:0/1033520581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e40e95d0 0x7f40e40e70a0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f40e0002f30 tx=0x7f40e0010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:47.021 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:47.019+0000 7f40db7fe700 1 -- 172.21.15.84:0/1033520581 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f40e000c9b0 con 0x7f40e40e95d0 2020-01-16T05:43:47.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:47.019+0000 7f40eb59e700 1 -- 172.21.15.84:0/1033520581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e40e95d0 msgr2=0x7f40e40e70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:47.019+0000 7f40eb59e700 1 --2- 172.21.15.84:0/1033520581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e40e95d0 0x7f40e40e70a0 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7f40e0002f30 tx=0x7f40e0010ee0).stop 2020-01-16T05:43:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:47.019+0000 7f40eb59e700 1 -- 172.21.15.84:0/1033520581 shutdown_connections 2020-01-16T05:43:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:47.019+0000 7f40eb59e700 1 --2- 172.21.15.84:0/1033520581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40c0480 0x7f40e40c08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:47.019+0000 7f40eb59e700 1 --2- 172.21.15.84:0/1033520581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e40e95d0 0x7f40e40e70a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:47.019+0000 7f40eb59e700 1 -- 172.21.15.84:0/1033520581 shutdown_connections 2020-01-16T05:43:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:47.019+0000 7f40eb59e700 1 -- 172.21.15.84:0/1033520581 wait complete. 2020-01-16T05:43:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:47.019+0000 7f40eb59e700 1 -- 172.21.15.84:0/1033520581 >> 172.21.15.84:0/1033520581 conn(0x7f40e403d840 msgr2=0x7f40e402f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:adjusted tunables profile to default 2020-01-16T05:43:47.035 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-01-16T05:43:47.036 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-01-16T05:43:47.041 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.xCKnQUcbeB 2020-01-16T05:43:47.041 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.xCKnQUcbeB 2020-01-16T05:43:47.102 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.xCKnQUcbeB 2020-01-16T05:43:47.210 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.xCKnQUcbeB is 37B 2020-01-16T05:43:47.229 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.xCKnQUcbeB 2020-01-16T05:43:47.237 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-01-16T05:43:47.280 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.I9aRNYX2vq 2020-01-16T05:43:47.280 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.I9aRNYX2vq 2020-01-16T05:43:47.337 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.I9aRNYX2vq 2020-01-16T05:43:47.442 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.I9aRNYX2vq is 37B 2020-01-16T05:43:47.454 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.I9aRNYX2vq 2020-01-16T05:43:47.459 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-01-16T05:43:47.512 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.87rMQi5iAb 2020-01-16T05:43:47.513 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.87rMQi5iAb 2020-01-16T05:43:47.571 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.87rMQi5iAb 2020-01-16T05:43:47.682 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.87rMQi5iAb is 37B 2020-01-16T05:43:47.736 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.87rMQi5iAb 2020-01-16T05:43:47.743 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-01-16T05:43:47.793 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.vJrEdImIQ8 2020-01-16T05:43:47.806 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.vJrEdImIQ8 2020-01-16T05:43:47.848 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.vJrEdImIQ8 2020-01-16T05:43:47.954 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.vJrEdImIQ8 is 37B 2020-01-16T05:43:47.970 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.vJrEdImIQ8 2020-01-16T05:43:47.976 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-01-16T05:43:47.982 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.PPdvh8vXBj 2020-01-16T05:43:47.982 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.PPdvh8vXBj 2020-01-16T05:43:48.040 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.PPdvh8vXBj 2020-01-16T05:43:48.144 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.PPdvh8vXBj is 37B 2020-01-16T05:43:48.154 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.PPdvh8vXBj 2020-01-16T05:43:48.160 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-01-16T05:43:48.211 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.GSYP0BWYQX 2020-01-16T05:43:48.211 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.GSYP0BWYQX 2020-01-16T05:43:48.268 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.GSYP0BWYQX 2020-01-16T05:43:48.372 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.GSYP0BWYQX is 37B 2020-01-16T05:43:48.385 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.GSYP0BWYQX 2020-01-16T05:43:48.394 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-01-16T05:43:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.tsC738WgRv 2020-01-16T05:43:48.443 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.tsC738WgRv 2020-01-16T05:43:48.499 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.tsC738WgRv 2020-01-16T05:43:48.600 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.tsC738WgRv is 37B 2020-01-16T05:43:48.659 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.tsC738WgRv 2020-01-16T05:43:48.665 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-01-16T05:43:48.714 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.w7NWzpnLyj 2020-01-16T05:43:48.715 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.w7NWzpnLyj 2020-01-16T05:43:48.771 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.w7NWzpnLyj 2020-01-16T05:43:48.876 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.w7NWzpnLyj is 37B 2020-01-16T05:43:48.886 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.w7NWzpnLyj 2020-01-16T05:43:48.892 INFO:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 15da60bb-4d16-44cc-80c6-cd2c7fa77364 0 2020-01-16T05:43:49.064 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.058+0000 7f64f9d27700 1 Processor -- start 2020-01-16T05:43:49.064 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.058+0000 7f64f9d27700 1 -- start start 2020-01-16T05:43:49.064 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.058+0000 7f64f9d27700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64ec03c700 0x7f64ec0e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:49.065 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.058+0000 7f64f9d27700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f64ec0e6c40 0x7f64ec020ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:49.065 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.058+0000 7f64f9d27700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ec0232b0 con 0x7f64ec0211f0 2020-01-16T05:43:49.065 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.058+0000 7f64f9d27700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ec022570 con 0x7f64ec0e6c40 2020-01-16T05:43:49.065 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.058+0000 7f64f9d27700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec022810 con 0x7f64ec03c700 2020-01-16T05:43:49.065 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.058+0000 7f64f9526700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64ec03c700 0x7f64ec0e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.065 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.058+0000 7f64f9526700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64ec03c700 0x7f64ec0e66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:47018/0 (socket says 172.21.15.142:47018) 2020-01-16T05:43:49.065 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.058+0000 7f64f9526700 1 -- 172.21.15.142:0/2833980468 learned_addr learned my addr 172.21.15.142:0/2833980468 (peer_addr_for_me v2:172.21.15.142:0/0) 2020-01-16T05:43:49.066 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.058+0000 7f64f8d25700 1 --2- 172.21.15.142:0/2833980468 >> v2:172.21.15.84:3300/0 conn(0x7f64ec0e6c40 0x7f64ec020ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.066 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f9526700 1 -- 172.21.15.142:0/2833980468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64ec03c700 msgr2=0x7f64ec0e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-01-16T05:43:49.066 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f9526700 1 -- 172.21.15.142:0/2833980468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64ec03c700 msgr2=0x7f64ec0e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-01-16T05:43:49.066 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f9526700 1 --2- 172.21.15.142:0/2833980468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64ec03c700 0x7f64ec0e66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-01-16T05:43:49.066 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f9526700 1 --2- 172.21.15.142:0/2833980468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64ec03c700 0x7f64ec0e66f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-16T05:43:49.066 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64ebfff700 1 -- 172.21.15.142:0/2833980468 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 271448639 0 0) 0x7f64ec0232b0 con 0x7f64ec0211f0 2020-01-16T05:43:49.067 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64ebfff700 1 -- 172.21.15.142:0/2833980468 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64e0003230 con 0x7f64ec0211f0 2020-01-16T05:43:49.067 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f8d25700 1 -- 172.21.15.142:0/2833980468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64ec03c700 msgr2=0x7f64ec0e66f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-16T05:43:49.067 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f8d25700 1 --2- 172.21.15.142:0/2833980468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64ec03c700 0x7f64ec0e66f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:49.068 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f8d25700 1 -- 172.21.15.142:0/2833980468 >> v1:172.21.15.84:6789/0 conn(0x7f64ec0211f0 legacy=0x7f64ec022ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.068 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f8d25700 1 -- 172.21.15.142:0/2833980468 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec0234e0 con 0x7f64ec0e6c40 2020-01-16T05:43:49.068 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f8d25700 1 --2- 172.21.15.142:0/2833980468 >> v2:172.21.15.84:3300/0 conn(0x7f64ec0e6c40 0x7f64ec020ca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f64ec003cd0 tx=0x7f64f000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.068 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f8d25700 1 --2- 172.21.15.142:0/2833980468 >> v2:172.21.15.84:3300/0 conn(0x7f64ec0e6c40 0x7f64ec020ca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f64ec003cd0 tx=0x7f64f000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.069 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f8d25700 1 --2- 172.21.15.142:0/2833980468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64ec0e6c40 0x7f64ec020ca0 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7f64ec003cd0 tx=0x7f64f000fdf0).ready entity=mon.0 client_cookie=13dcb22faff56 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:49.069 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f8d25700 1 --2- 172.21.15.142:0/2833980468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64ec0e6c40 0x7f64ec020ca0 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f64ec003cd0 tx=0x7f64f000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.069 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64ebfff700 1 -- 172.21.15.142:0/2833980468 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64f0011660 con 0x7f64ec0e6c40 2020-01-16T05:43:49.069 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f8d25700 1 --2- 172.21.15.142:0/2833980468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64ec0e6c40 0x7f64ec020ca0 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f64ec003cd0 tx=0x7f64f000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.069 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f8d25700 1 --2- 172.21.15.142:0/2833980468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64ec0e6c40 0x7f64ec020ca0 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f64ec003cd0 tx=0x7f64f000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.069 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64ebfff700 1 -- 172.21.15.142:0/2833980468 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f0008c50 con 0x7f64ec0e6c40 2020-01-16T05:43:49.069 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64ebfff700 1 -- 172.21.15.142:0/2833980468 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64f0011c40 con 0x7f64ec0e6c40 2020-01-16T05:43:49.070 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f9d27700 1 -- 172.21.15.142:0/2833980468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64ec0e6c40 msgr2=0x7f64ec020ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.070 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f9d27700 1 --2- 172.21.15.142:0/2833980468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64ec0e6c40 0x7f64ec020ca0 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7f64ec003cd0 tx=0x7f64f000fdf0).stop 2020-01-16T05:43:49.070 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f9d27700 1 -- 172.21.15.142:0/2833980468 shutdown_connections 2020-01-16T05:43:49.070 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f9d27700 1 --2- 172.21.15.142:0/2833980468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64ec03c700 0x7f64ec0e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:49.070 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f9d27700 1 --2- 172.21.15.142:0/2833980468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64ec0e6c40 0x7f64ec020ca0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:49.070 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f9d27700 1 -- 172.21.15.142:0/2833980468 shutdown_connections 2020-01-16T05:43:49.070 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f9d27700 1 -- 172.21.15.142:0/2833980468 wait complete. 2020-01-16T05:43:49.071 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f9d27700 1 -- 172.21.15.142:0/2833980468 >> 172.21.15.142:0/2833980468 conn(0x7f64ec03d870 msgr2=0x7f64ec03dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:49.074 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f9d27700 1 Processor -- start 2020-01-16T05:43:49.074 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.062+0000 7f64f9d27700 1 -- start start 2020-01-16T05:43:49.075 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9d27700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64ec0c6fe0 0x7f64ec03a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:49.075 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9d27700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ec03ab40 con 0x7f64ec0e7b90 2020-01-16T05:43:49.075 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9d27700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ec0e77e0 con 0x7f64ec0e9ac0 2020-01-16T05:43:49.075 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9d27700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ec0e9580 con 0x7f64ec0c6fe0 2020-01-16T05:43:49.075 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9526700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64ec0c6fe0 0x7f64ec03a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.075 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9526700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64ec0c6fe0 0x7f64ec03a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36208/0 (socket says 172.21.15.142:36208) 2020-01-16T05:43:49.075 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9526700 1 -- 172.21.15.142:0/656942115 learned_addr learned my addr 172.21.15.142:0/656942115 (peer_addr_for_me v2:172.21.15.142:0/0) 2020-01-16T05:43:49.076 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9526700 1 -- 172.21.15.142:0/656942115 >> v1:172.21.15.142:6789/0 conn(0x7f64ec0e9ac0 legacy=0x7f64ec0c03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.076 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64e9ffb700 1 -- 172.21.15.142:0/656942115 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593347618 0 0) 0x7f64ec0e77e0 con 0x7f64ec0e9ac0 2020-01-16T05:43:49.076 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9526700 1 -- 172.21.15.142:0/656942115 >> v1:172.21.15.84:6789/0 conn(0x7f64ec0e7b90 legacy=0x7f64ec0db8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.076 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9526700 1 -- 172.21.15.142:0/656942115 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec0e84c0 con 0x7f64ec0c6fe0 2020-01-16T05:43:49.076 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9526700 1 --2- 172.21.15.142:0/656942115 >> v2:172.21.15.142:3300/0 conn(0x7f64ec0c6fe0 0x7f64ec03a5f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f64e4002f30 tx=0x7f64f4069740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.076 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9526700 1 --2- 172.21.15.142:0/656942115 >> v2:172.21.15.142:3300/0 conn(0x7f64ec0c6fe0 0x7f64ec03a5f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f64e4002f30 tx=0x7f64f4069740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.076 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9526700 1 --2- 172.21.15.142:0/656942115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64ec0c6fe0 0x7f64ec03a5f0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f64e4002f30 tx=0x7f64f4069740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:49.077 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9526700 1 --2- 172.21.15.142:0/656942115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64ec0c6fe0 0x7f64ec03a5f0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f64e4002f30 tx=0x7f64f4069740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.077 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64e9ffb700 1 -- 172.21.15.142:0/656942115 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64e4007340 con 0x7f64ec0c6fe0 2020-01-16T05:43:49.077 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9526700 1 --2- 172.21.15.142:0/656942115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64ec0c6fe0 0x7f64ec03a5f0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f64e4002f30 tx=0x7f64f4069740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.077 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9526700 1 --2- 172.21.15.142:0/656942115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64ec0c6fe0 0x7f64ec03a5f0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f64e4002f30 tx=0x7f64f4069740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.077 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64e9ffb700 1 -- 172.21.15.142:0/656942115 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e400d0c0 con 0x7f64ec0c6fe0 2020-01-16T05:43:49.077 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9d27700 1 -- 172.21.15.142:0/656942115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ec0e7fc0 con 0x7f64ec0c6fe0 2020-01-16T05:43:49.077 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64e9ffb700 1 -- 172.21.15.142:0/656942115 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64e4014a80 con 0x7f64ec0c6fe0 2020-01-16T05:43:49.078 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9d27700 1 -- 172.21.15.142:0/656942115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ec0056b0 con 0x7f64ec0c6fe0 2020-01-16T05:43:49.078 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9526700 1 --2- 172.21.15.142:0/656942115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64ec0c6fe0 0x7f64ec03a5f0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f64e4002f30 tx=0x7f64f4069740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.078 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64e9ffb700 1 -- 172.21.15.142:0/656942115 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7f64e4005890 con 0x7f64ec0c6fe0 2020-01-16T05:43:49.078 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64f9526700 1 --2- 172.21.15.142:0/656942115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64ec0c6fe0 0x7f64ec03a5f0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f64e4002f30 tx=0x7f64f4069740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.079 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.066+0000 7f64e9ffb700 1 -- 172.21.15.142:0/656942115 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f64e400e990 con 0x7f64ec0c6fe0 2020-01-16T05:43:49.079 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.070+0000 7f64f9d27700 1 -- 172.21.15.142:0/656942115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ec004cf0 con 0x7f64ec0c6fe0 2020-01-16T05:43:49.080 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.070+0000 7f64f9526700 1 --2- 172.21.15.142:0/656942115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64ec0c6fe0 0x7f64ec03a5f0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f64e4002f30 tx=0x7f64f4069740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.080 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.070+0000 7f64e9ffb700 1 -- 172.21.15.142:0/656942115 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67593 (secure 0 0 0) 0x7f64ec0e84c0 con 0x7f64ec0c6fe0 2020-01-16T05:43:49.152 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.150+0000 7f64f9d27700 1 -- 172.21.15.142:0/656942115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "15da60bb-4d16-44cc-80c6-cd2c7fa77364", "id": 0} v 0) v1 -- 0x7f64ec0e9360 con 0x7f64ec0c6fe0 2020-01-16T05:43:49.158 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.158+0000 7f64f9526700 1 --2- 172.21.15.142:0/656942115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64ec0c6fe0 0x7f64ec03a5f0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f64e4002f30 tx=0x7f64f4069740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.159 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.158+0000 7f64e9ffb700 1 -- 172.21.15.142:0/656942115 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15da60bb-4d16-44cc-80c6-cd2c7fa77364", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f64e400ecb0 con 0x7f64ec0c6fe0 2020-01-16T05:43:49.159 INFO:teuthology.orchestra.run.smithi142.stdout:0 2020-01-16T05:43:49.160 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.158+0000 7f64f9d27700 1 -- 172.21.15.142:0/656942115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64ec0c6fe0 msgr2=0x7f64ec03a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.160 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.158+0000 7f64f9d27700 1 --2- 172.21.15.142:0/656942115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64ec0c6fe0 0x7f64ec03a5f0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f64e4002f30 tx=0x7f64f4069740).stop 2020-01-16T05:43:49.160 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.158+0000 7f64f9d27700 1 -- 172.21.15.142:0/656942115 shutdown_connections 2020-01-16T05:43:49.161 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.158+0000 7f64f9d27700 1 --2- 172.21.15.142:0/656942115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64ec0c6fe0 0x7f64ec03a5f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:49.161 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.158+0000 7f64f9d27700 1 -- 172.21.15.142:0/656942115 shutdown_connections 2020-01-16T05:43:49.161 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.158+0000 7f64f9d27700 1 -- 172.21.15.142:0/656942115 wait complete. 2020-01-16T05:43:49.161 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.158+0000 7f64f9d27700 1 -- 172.21.15.142:0/656942115 >> 172.21.15.142:0/656942115 conn(0x7f64ec004f00 msgr2=0x7f64ec030900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:49.170 INFO:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 0800533c-1d5b-4f9f-99bb-34b8133c8b18 1 2020-01-16T05:43:49.300 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8896242700 1 Processor -- start 2020-01-16T05:43:49.300 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8896242700 1 -- start start 2020-01-16T05:43:49.300 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8896242700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f88900a4250 0x7f88900abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:49.300 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8896242700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8890066880 con 0x7f889007ff10 2020-01-16T05:43:49.300 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8896242700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8890066ab0 con 0x7f88900a9b30 2020-01-16T05:43:49.301 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8896242700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88900a4830 con 0x7f88900a4250 2020-01-16T05:43:49.301 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8895a41700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f88900a9b30 0x7f88900a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56376/0 (socket says 172.21.15.142:56376) 2020-01-16T05:43:49.301 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8895a41700 1 -- 172.21.15.142:0/3372023344 learned_addr learned my addr 172.21.15.142:0/3372023344 (peer_addr_for_me v1:172.21.15.142:0/0) 2020-01-16T05:43:49.301 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f88974a4700 1 --2- 172.21.15.142:0/3372023344 >> v2:172.21.15.84:3300/0 conn(0x7f88900a4250 0x7f88900abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.301 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8894a3f700 1 -- 172.21.15.142:0/3372023344 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930834710 0 0) 0x7f8890066ab0 con 0x7f88900a9b30 2020-01-16T05:43:49.301 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8894a3f700 1 -- 172.21.15.142:0/3372023344 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f887c003230 con 0x7f88900a9b30 2020-01-16T05:43:49.301 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8894a3f700 1 -- 172.21.15.142:0/3372023344 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1784482212 0 0) 0x7f887c003230 con 0x7f88900a9b30 2020-01-16T05:43:49.302 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8894a3f700 1 -- 172.21.15.142:0/3372023344 >> v2:172.21.15.84:3300/0 conn(0x7f88900a4250 msgr2=0x7f88900abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:49.302 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8894a3f700 1 --2- 172.21.15.142:0/3372023344 >> v2:172.21.15.84:3300/0 conn(0x7f88900a4250 0x7f88900abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:49.302 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8894a3f700 1 -- 172.21.15.142:0/3372023344 >> v1:172.21.15.84:6789/0 conn(0x7f889007ff10 legacy=0x7f889014dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.302 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8894a3f700 1 -- 172.21.15.142:0/3372023344 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8890066ce0 con 0x7f88900a9b30 2020-01-16T05:43:49.302 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8894a3f700 1 -- 172.21.15.142:0/3372023344 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f8880001750 con 0x7f88900a9b30 2020-01-16T05:43:49.302 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8894a3f700 1 -- 172.21.15.142:0/3372023344 >> v1:172.21.15.142:6789/0 conn(0x7f88900a9b30 legacy=0x7f88900a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.302 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8894a3f700 1 --2- 172.21.15.142:0/3372023344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f887c003860 0x7f887c003cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:49.303 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8894a3f700 1 --2- 172.21.15.142:0/3372023344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f887c0045a0 0x7f887c0049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:49.303 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8894a3f700 1 --2- 172.21.15.142:0/3372023344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f887c004f20 0x7f887c00b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:49.303 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8894a3f700 1 -- 172.21.15.142:0/3372023344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88900a4830 con 0x7f887c0045a0 2020-01-16T05:43:49.303 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8894a3f700 1 -- 172.21.15.142:0/3372023344 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c04fde0 con 0x7f887c004f20 2020-01-16T05:43:49.303 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8894a3f700 1 -- 172.21.15.142:0/3372023344 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c050020 con 0x7f887c003860 2020-01-16T05:43:49.303 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8895a41700 1 --2- 172.21.15.142:0/3372023344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f887c003860 0x7f887c003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.303 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f88974a4700 1 --2- 172.21.15.142:0/3372023344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f887c004f20 0x7f887c00b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.303 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.294+0000 7f8895240700 1 --2- 172.21.15.142:0/3372023344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f887c0045a0 0x7f887c0049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.304 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f88974a4700 1 -- 172.21.15.142:0/3372023344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f887c003860 msgr2=0x7f887c003cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:49.304 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f88974a4700 1 --2- 172.21.15.142:0/3372023344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f887c003860 0x7f887c003cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:49.304 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f88974a4700 1 -- 172.21.15.142:0/3372023344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f887c0045a0 msgr2=0x7f887c0049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:49.304 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f88974a4700 1 --2- 172.21.15.142:0/3372023344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f887c0045a0 0x7f887c0049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:49.305 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f88974a4700 1 -- 172.21.15.142:0/3372023344 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c050320 con 0x7f887c004f20 2020-01-16T05:43:49.305 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8895a41700 1 --2- 172.21.15.142:0/3372023344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f887c003860 0x7f887c003cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:43:49.305 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f88974a4700 1 --2- 172.21.15.142:0/3372023344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f887c004f20 0x7f887c00b7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f88880032b0 tx=0x7f88880104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.305 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f88974a4700 1 -- 172.21.15.142:0/3372023344 reap_dead start 2020-01-16T05:43:49.305 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f88974a4700 1 --2- 172.21.15.142:0/3372023344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f887c004f20 0x7f887c00b7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f88880032b0 tx=0x7f88880104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.305 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f88974a4700 1 --2- 172.21.15.142:0/3372023344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f887c004f20 0x7f887c00b7f0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f88880032b0 tx=0x7f88880104b0).ready entity=mon.1 client_cookie=8cc3f288f5c29289 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:49.305 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f88974a4700 1 --2- 172.21.15.142:0/3372023344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f887c004f20 0x7f887c00b7f0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f88880032b0 tx=0x7f88880104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.306 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8894a3f700 1 -- 172.21.15.142:0/3372023344 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88880110c0 con 0x7f887c004f20 2020-01-16T05:43:49.306 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f88974a4700 1 --2- 172.21.15.142:0/3372023344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f887c004f20 0x7f887c00b7f0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f88880032b0 tx=0x7f88880104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.306 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8894a3f700 1 -- 172.21.15.142:0/3372023344 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8888005a40 con 0x7f887c004f20 2020-01-16T05:43:49.306 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f88974a4700 1 --2- 172.21.15.142:0/3372023344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f887c004f20 0x7f887c00b7f0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f88880032b0 tx=0x7f88880104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.306 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8896242700 1 -- 172.21.15.142:0/3372023344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f887c004f20 msgr2=0x7f887c00b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.306 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8894a3f700 1 -- 172.21.15.142:0/3372023344 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88880116a0 con 0x7f887c004f20 2020-01-16T05:43:49.306 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8896242700 1 --2- 172.21.15.142:0/3372023344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f887c004f20 0x7f887c00b7f0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f88880032b0 tx=0x7f88880104b0).stop 2020-01-16T05:43:49.307 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8896242700 1 -- 172.21.15.142:0/3372023344 shutdown_connections 2020-01-16T05:43:49.307 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8896242700 1 --2- 172.21.15.142:0/3372023344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f887c004f20 0x7f887c00b7f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:49.307 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8896242700 1 -- 172.21.15.142:0/3372023344 shutdown_connections 2020-01-16T05:43:49.307 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8896242700 1 -- 172.21.15.142:0/3372023344 wait complete. 2020-01-16T05:43:49.307 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8896242700 1 -- 172.21.15.142:0/3372023344 >> 172.21.15.142:0/3372023344 conn(0x7f88900acfc0 msgr2=0x7f88900a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:49.307 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8896242700 1 Processor -- start 2020-01-16T05:43:49.307 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8896242700 1 -- start start 2020-01-16T05:43:49.310 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8896242700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f88900a57e0 0x7f88900a81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:49.310 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8896242700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88900a8e40 con 0x7f889009faa0 2020-01-16T05:43:49.310 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8896242700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8890065fc0 con 0x7f889007b870 2020-01-16T05:43:49.310 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8896242700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88900a6d70 con 0x7f88900a57e0 2020-01-16T05:43:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8895a41700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f88900a57e0 0x7f88900a81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8895240700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f889007b870 0x7f889009f2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56390/0 (socket says 172.21.15.142:56390) 2020-01-16T05:43:49.318 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.298+0000 7f8895240700 1 -- 172.21.15.142:0/2202195953 learned_addr learned my addr 172.21.15.142:0/2202195953 (peer_addr_for_me v1:172.21.15.142:0/0) 2020-01-16T05:43:49.318 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f88867fc700 1 -- 172.21.15.142:0/2202195953 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208063115 0 0) 0x7f8888005a40 con 0x7f889009faa0 2020-01-16T05:43:49.318 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f8895a41700 1 -- 172.21.15.142:0/2202195953 >> v1:172.21.15.142:6789/0 conn(0x7f889007b870 legacy=0x7f889009f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.318 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f8895a41700 1 -- 172.21.15.142:0/2202195953 >> v1:172.21.15.84:6789/0 conn(0x7f889009faa0 legacy=0x7f889013f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.318 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f8895a41700 1 -- 172.21.15.142:0/2202195953 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889007cbf0 con 0x7f88900a57e0 2020-01-16T05:43:49.319 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f8895a41700 1 --2- 172.21.15.142:0/2202195953 >> v2:172.21.15.142:3300/0 conn(0x7f88900a57e0 0x7f88900a81f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f888c000ed0 tx=0x7f888c001310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.319 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f8895a41700 1 --2- 172.21.15.142:0/2202195953 >> v2:172.21.15.142:3300/0 conn(0x7f88900a57e0 0x7f88900a81f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f888c000ed0 tx=0x7f888c001310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.319 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f8895a41700 1 --2- 172.21.15.142:0/2202195953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88900a57e0 0x7f88900a81f0 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f888c000ed0 tx=0x7f888c001310).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:49.319 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f8895a41700 1 --2- 172.21.15.142:0/2202195953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88900a57e0 0x7f88900a81f0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f888c000ed0 tx=0x7f888c001310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.319 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f88867fc700 1 -- 172.21.15.142:0/2202195953 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88800127d0 con 0x7f88900a57e0 2020-01-16T05:43:49.319 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f8895a41700 1 --2- 172.21.15.142:0/2202195953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88900a57e0 0x7f88900a81f0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f888c000ed0 tx=0x7f888c001310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.319 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f88867fc700 1 -- 172.21.15.142:0/2202195953 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888000ebb0 con 0x7f88900a57e0 2020-01-16T05:43:49.320 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f8895a41700 1 --2- 172.21.15.142:0/2202195953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88900a57e0 0x7f88900a81f0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f888c000ed0 tx=0x7f888c001310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.320 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f8896242700 1 -- 172.21.15.142:0/2202195953 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889007bca0 con 0x7f88900a57e0 2020-01-16T05:43:49.320 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f88867fc700 1 -- 172.21.15.142:0/2202195953 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8880012db0 con 0x7f88900a57e0 2020-01-16T05:43:49.320 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f8896242700 1 -- 172.21.15.142:0/2202195953 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88901408d0 con 0x7f88900a57e0 2020-01-16T05:43:49.320 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f8895a41700 1 --2- 172.21.15.142:0/2202195953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88900a57e0 0x7f88900a81f0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f888c000ed0 tx=0x7f888c001310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.320 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f88867fc700 1 -- 172.21.15.142:0/2202195953 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7f88800088c0 con 0x7f88900a57e0 2020-01-16T05:43:49.320 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f8895a41700 1 --2- 172.21.15.142:0/2202195953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88900a57e0 0x7f88900a81f0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f888c000ed0 tx=0x7f888c001310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.321 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f88867fc700 1 -- 172.21.15.142:0/2202195953 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f888000b8f0 con 0x7f88900a57e0 2020-01-16T05:43:49.321 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.302+0000 7f8896242700 1 -- 172.21.15.142:0/2202195953 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889005e1c0 con 0x7f88900a57e0 2020-01-16T05:43:49.321 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.306+0000 7f8895a41700 1 --2- 172.21.15.142:0/2202195953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88900a57e0 0x7f88900a81f0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f888c000ed0 tx=0x7f888c001310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.321 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.306+0000 7f88867fc700 1 -- 172.21.15.142:0/2202195953 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67593 (secure 0 0 0) 0x7f8880010900 con 0x7f88900a57e0 2020-01-16T05:43:49.386 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.386+0000 7f8896242700 1 -- 172.21.15.142:0/2202195953 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0800533c-1d5b-4f9f-99bb-34b8133c8b18", "id": 1} v 0) v1 -- 0x7f889007c480 con 0x7f88900a57e0 2020-01-16T05:43:49.395 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.394+0000 7f8895a41700 1 --2- 172.21.15.142:0/2202195953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88900a57e0 0x7f88900a81f0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f888c000ed0 tx=0x7f888c001310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.395 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.394+0000 7f88867fc700 1 -- 172.21.15.142:0/2202195953 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0800533c-1d5b-4f9f-99bb-34b8133c8b18", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8880008cb0 con 0x7f88900a57e0 2020-01-16T05:43:49.395 INFO:teuthology.orchestra.run.smithi142.stdout:1 2020-01-16T05:43:49.397 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.394+0000 7f8896242700 1 -- 172.21.15.142:0/2202195953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88900a57e0 msgr2=0x7f88900a81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.397 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.394+0000 7f8896242700 1 --2- 172.21.15.142:0/2202195953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88900a57e0 0x7f88900a81f0 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f888c000ed0 tx=0x7f888c001310).stop 2020-01-16T05:43:49.397 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.394+0000 7f8896242700 1 -- 172.21.15.142:0/2202195953 shutdown_connections 2020-01-16T05:43:49.397 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.394+0000 7f8896242700 1 --2- 172.21.15.142:0/2202195953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88900a57e0 0x7f88900a81f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:49.397 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.394+0000 7f8896242700 1 -- 172.21.15.142:0/2202195953 shutdown_connections 2020-01-16T05:43:49.397 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.394+0000 7f8896242700 1 -- 172.21.15.142:0/2202195953 wait complete. 2020-01-16T05:43:49.397 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.394+0000 7f8896242700 1 -- 172.21.15.142:0/2202195953 >> 172.21.15.142:0/2202195953 conn(0x7f889005bbb0 msgr2=0x7f8890024ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:49.411 INFO:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 519cc27f-5cf9-4ecf-ad66-f722c37339df 2 2020-01-16T05:43:49.529 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f81cf1700 1 Processor -- start 2020-01-16T05:43:49.529 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f81cf1700 1 -- start start 2020-01-16T05:43:49.529 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f81cf1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f7c0a4250 0x7f1f7c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:49.529 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f81cf1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7c066880 con 0x7f1f7c0a9b30 2020-01-16T05:43:49.529 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f81cf1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7c066ab0 con 0x7f1f7c07ff10 2020-01-16T05:43:49.530 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f81cf1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7c0a4830 con 0x7f1f7c0a4250 2020-01-16T05:43:49.530 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f80cef700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1f7c07ff10 0x7f1f7c14dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56394/0 (socket says 172.21.15.142:56394) 2020-01-16T05:43:49.530 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f80cef700 1 -- 172.21.15.142:0/1298731255 learned_addr learned my addr 172.21.15.142:0/1298731255 (peer_addr_for_me v1:172.21.15.142:0/0) 2020-01-16T05:43:49.530 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f82f53700 1 --2- 172.21.15.142:0/1298731255 >> v2:172.21.15.84:3300/0 conn(0x7f1f7c0a4250 0x7f1f7c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.530 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f7bfff700 1 -- 172.21.15.142:0/1298731255 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318796595 0 0) 0x7f1f7c066ab0 con 0x7f1f7c07ff10 2020-01-16T05:43:49.530 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f7bfff700 1 -- 172.21.15.142:0/1298731255 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f64003230 con 0x7f1f7c07ff10 2020-01-16T05:43:49.530 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f7bfff700 1 -- 172.21.15.142:0/1298731255 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 543347791 0 0) 0x7f1f64003230 con 0x7f1f7c07ff10 2020-01-16T05:43:49.531 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f7bfff700 1 -- 172.21.15.142:0/1298731255 >> v2:172.21.15.84:3300/0 conn(0x7f1f7c0a4250 msgr2=0x7f1f7c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:49.531 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f7bfff700 1 --2- 172.21.15.142:0/1298731255 >> v2:172.21.15.84:3300/0 conn(0x7f1f7c0a4250 0x7f1f7c0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:49.531 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f7bfff700 1 -- 172.21.15.142:0/1298731255 >> v1:172.21.15.84:6789/0 conn(0x7f1f7c0a9b30 legacy=0x7f1f7c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.531 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f7bfff700 1 -- 172.21.15.142:0/1298731255 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c066ce0 con 0x7f1f7c07ff10 2020-01-16T05:43:49.531 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f7bfff700 1 -- 172.21.15.142:0/1298731255 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f1f6c001ad0 con 0x7f1f7c07ff10 2020-01-16T05:43:49.531 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f7bfff700 1 -- 172.21.15.142:0/1298731255 >> v1:172.21.15.142:6789/0 conn(0x7f1f7c07ff10 legacy=0x7f1f7c14dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.531 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f7bfff700 1 --2- 172.21.15.142:0/1298731255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f64003860 0x7f1f64003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:49.532 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f7bfff700 1 --2- 172.21.15.142:0/1298731255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f640045a0 0x7f1f640049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:49.532 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f7bfff700 1 --2- 172.21.15.142:0/1298731255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f64004f20 0x7f1f6400b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:49.532 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f7bfff700 1 -- 172.21.15.142:0/1298731255 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c0a4830 con 0x7f1f64003860 2020-01-16T05:43:49.532 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f7bfff700 1 -- 172.21.15.142:0/1298731255 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6404fd50 con 0x7f1f64004f20 2020-01-16T05:43:49.532 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f7bfff700 1 -- 172.21.15.142:0/1298731255 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6404ff90 con 0x7f1f640045a0 2020-01-16T05:43:49.532 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f82f53700 1 --2- 172.21.15.142:0/1298731255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f64004f20 0x7f1f6400b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.532 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f814f0700 1 --2- 172.21.15.142:0/1298731255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f64003860 0x7f1f64003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.532 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f80cef700 1 --2- 172.21.15.142:0/1298731255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f640045a0 0x7f1f640049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.533 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f814f0700 1 -- 172.21.15.142:0/1298731255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f640045a0 msgr2=0x7f1f640049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:49.533 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f814f0700 1 --2- 172.21.15.142:0/1298731255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f640045a0 0x7f1f640049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:49.533 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f814f0700 1 -- 172.21.15.142:0/1298731255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f64004f20 msgr2=0x7f1f6400b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:49.533 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f814f0700 1 --2- 172.21.15.142:0/1298731255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f64004f20 0x7f1f6400b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:49.533 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f814f0700 1 -- 172.21.15.142:0/1298731255 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f64050290 con 0x7f1f64003860 2020-01-16T05:43:49.533 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f80cef700 1 --2- 172.21.15.142:0/1298731255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f640045a0 0x7f1f640049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:43:49.534 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.518+0000 7f1f82f53700 1 --2- 172.21.15.142:0/1298731255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f64004f20 0x7f1f6400b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:43:49.534 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f82f53700 1 -- 172.21.15.142:0/1298731255 reap_dead start 2020-01-16T05:43:49.534 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f814f0700 1 --2- 172.21.15.142:0/1298731255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f64003860 0x7f1f64003c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1f70000fe0 tx=0x7f1f7000ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.534 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f814f0700 1 --2- 172.21.15.142:0/1298731255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f64003860 0x7f1f64003c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1f70000fe0 tx=0x7f1f7000ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.534 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f814f0700 1 --2- 172.21.15.142:0/1298731255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f64003860 0x7f1f64003c90 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f1f70000fe0 tx=0x7f1f7000ff00).ready entity=mon.0 client_cookie=e2dded6fa4aa6b93 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:49.534 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f814f0700 1 --2- 172.21.15.142:0/1298731255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f64003860 0x7f1f64003c90 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f1f70000fe0 tx=0x7f1f7000ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.534 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f7bfff700 1 -- 172.21.15.142:0/1298731255 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f70003540 con 0x7f1f64003860 2020-01-16T05:43:49.535 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f814f0700 1 --2- 172.21.15.142:0/1298731255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f64003860 0x7f1f64003c90 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f1f70000fe0 tx=0x7f1f7000ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.535 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f814f0700 1 --2- 172.21.15.142:0/1298731255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f64003860 0x7f1f64003c90 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f1f70000fe0 tx=0x7f1f7000ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.535 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f7bfff700 1 -- 172.21.15.142:0/1298731255 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f70003160 con 0x7f1f64003860 2020-01-16T05:43:49.535 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f7bfff700 1 -- 172.21.15.142:0/1298731255 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f70003b20 con 0x7f1f64003860 2020-01-16T05:43:49.535 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f81cf1700 1 -- 172.21.15.142:0/1298731255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f64003860 msgr2=0x7f1f64003c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.535 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f81cf1700 1 --2- 172.21.15.142:0/1298731255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f64003860 0x7f1f64003c90 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f1f70000fe0 tx=0x7f1f7000ff00).stop 2020-01-16T05:43:49.535 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f81cf1700 1 -- 172.21.15.142:0/1298731255 shutdown_connections 2020-01-16T05:43:49.535 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f81cf1700 1 --2- 172.21.15.142:0/1298731255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f64003860 0x7f1f64003c90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:49.536 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f81cf1700 1 -- 172.21.15.142:0/1298731255 shutdown_connections 2020-01-16T05:43:49.536 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f81cf1700 1 -- 172.21.15.142:0/1298731255 wait complete. 2020-01-16T05:43:49.536 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f81cf1700 1 -- 172.21.15.142:0/1298731255 >> 172.21.15.142:0/1298731255 conn(0x7f1f7c0acfc0 msgr2=0x7f1f7c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:49.536 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f81cf1700 1 Processor -- start 2020-01-16T05:43:49.536 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.522+0000 7f1f81cf1700 1 -- start start 2020-01-16T05:43:49.536 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f81cf1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f7c07e5a0 0x7f1f7c07c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:49.536 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f81cf1700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1f7c0a82e0 0x7f1f7c134a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:49.537 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f81cf1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7c0a37b0 con 0x7f1f7c134f60 2020-01-16T05:43:49.537 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f81cf1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7c0a7da0 con 0x7f1f7c07e5a0 2020-01-16T05:43:49.537 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f81cf1700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7c0a8040 con 0x7f1f7c0a82e0 2020-01-16T05:43:49.537 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f80cef700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1f7c0a82e0 0x7f1f7c134a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.537 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f80cef700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1f7c0a82e0 0x7f1f7c134a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36246/0 (socket says 172.21.15.142:36246) 2020-01-16T05:43:49.537 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f80cef700 1 -- 172.21.15.142:0/4266592067 learned_addr learned my addr 172.21.15.142:0/4266592067 (peer_addr_for_me v2:172.21.15.142:0/0) 2020-01-16T05:43:49.537 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f82f53700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1f7c134f60 0x7f1f7c09eac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56410/0 (socket says 172.21.15.142:56410) 2020-01-16T05:43:49.538 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f814f0700 1 --2- 172.21.15.142:0/4266592067 >> v2:172.21.15.84:3300/0 conn(0x7f1f7c07e5a0 0x7f1f7c07c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.538 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f80cef700 1 -- 172.21.15.142:0/4266592067 >> v2:172.21.15.84:3300/0 conn(0x7f1f7c07e5a0 msgr2=0x7f1f7c07c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.538 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f80cef700 1 --2- 172.21.15.142:0/4266592067 >> v2:172.21.15.84:3300/0 conn(0x7f1f7c07e5a0 0x7f1f7c07c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:49.538 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f80cef700 1 -- 172.21.15.142:0/4266592067 >> v1:172.21.15.142:6789/0 conn(0x7f1f7c134f60 legacy=0x7f1f7c09eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.538 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f79ffb700 1 -- 172.21.15.142:0/4266592067 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481481115 0 0) 0x7f1f7c0a37b0 con 0x7f1f7c134f60 2020-01-16T05:43:49.538 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f80cef700 1 -- 172.21.15.142:0/4266592067 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c07ca10 con 0x7f1f7c0a82e0 2020-01-16T05:43:49.538 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f80cef700 1 --2- 172.21.15.142:0/4266592067 >> v2:172.21.15.142:3300/0 conn(0x7f1f7c0a82e0 0x7f1f7c134a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f7c0a74e0 tx=0x7f1f6c0112c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.539 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f80cef700 1 --2- 172.21.15.142:0/4266592067 >> v2:172.21.15.142:3300/0 conn(0x7f1f7c0a82e0 0x7f1f7c134a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f7c0a74e0 tx=0x7f1f6c0112c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.539 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f80cef700 1 --2- 172.21.15.142:0/4266592067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f7c0a82e0 0x7f1f7c134a10 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7f1f7c0a74e0 tx=0x7f1f6c0112c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:49.539 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f80cef700 1 --2- 172.21.15.142:0/4266592067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f7c0a82e0 0x7f1f7c134a10 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f1f7c0a74e0 tx=0x7f1f6c0112c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.539 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f79ffb700 1 -- 172.21.15.142:0/4266592067 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f6c004870 con 0x7f1f7c0a82e0 2020-01-16T05:43:49.539 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f80cef700 1 --2- 172.21.15.142:0/4266592067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f7c0a82e0 0x7f1f7c134a10 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f1f7c0a74e0 tx=0x7f1f6c0112c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.539 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f81cf1700 1 -- 172.21.15.142:0/4266592067 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7c125380 con 0x7f1f7c0a82e0 2020-01-16T05:43:49.539 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f79ffb700 1 -- 172.21.15.142:0/4266592067 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6c011b50 con 0x7f1f7c0a82e0 2020-01-16T05:43:49.540 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f80cef700 1 --2- 172.21.15.142:0/4266592067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f7c0a82e0 0x7f1f7c134a10 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f1f7c0a74e0 tx=0x7f1f6c0112c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.540 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f79ffb700 1 -- 172.21.15.142:0/4266592067 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f6c0120c0 con 0x7f1f7c0a82e0 2020-01-16T05:43:49.540 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f81cf1700 1 -- 172.21.15.142:0/4266592067 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7c0a88b0 con 0x7f1f7c0a82e0 2020-01-16T05:43:49.540 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f80cef700 1 --2- 172.21.15.142:0/4266592067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f7c0a82e0 0x7f1f7c134a10 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f1f7c0a74e0 tx=0x7f1f6c0112c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.540 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f79ffb700 1 -- 172.21.15.142:0/4266592067 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7f1f6c012530 con 0x7f1f7c0a82e0 2020-01-16T05:43:49.540 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f80cef700 1 --2- 172.21.15.142:0/4266592067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f7c0a82e0 0x7f1f7c134a10 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f1f7c0a74e0 tx=0x7f1f6c0112c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.540 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f79ffb700 1 -- 172.21.15.142:0/4266592067 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f1f6c012840 con 0x7f1f7c0a82e0 2020-01-16T05:43:49.541 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.526+0000 7f1f81cf1700 1 -- 172.21.15.142:0/4266592067 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7c05e1c0 con 0x7f1f7c0a82e0 2020-01-16T05:43:49.541 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.530+0000 7f1f80cef700 1 --2- 172.21.15.142:0/4266592067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f7c0a82e0 0x7f1f7c134a10 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f1f7c0a74e0 tx=0x7f1f6c0112c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.541 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.530+0000 7f1f79ffb700 1 -- 172.21.15.142:0/4266592067 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67593 (secure 0 0 0) 0x7f1f7c07ca10 con 0x7f1f7c0a82e0 2020-01-16T05:43:49.609 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.610+0000 7f1f81cf1700 1 -- 172.21.15.142:0/4266592067 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "519cc27f-5cf9-4ecf-ad66-f722c37339df", "id": 2} v 0) v1 -- 0x7f1f7c0a8bc0 con 0x7f1f7c0a82e0 2020-01-16T05:43:49.618 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.618+0000 7f1f80cef700 1 --2- 172.21.15.142:0/4266592067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f7c0a82e0 0x7f1f7c134a10 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f1f7c0a74e0 tx=0x7f1f6c0112c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.618 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.618+0000 7f1f79ffb700 1 -- 172.21.15.142:0/4266592067 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "519cc27f-5cf9-4ecf-ad66-f722c37339df", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1f6c00e020 con 0x7f1f7c0a82e0 2020-01-16T05:43:49.618 INFO:teuthology.orchestra.run.smithi142.stdout:2 2020-01-16T05:43:49.619 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.618+0000 7f1f81cf1700 1 -- 172.21.15.142:0/4266592067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f7c0a82e0 msgr2=0x7f1f7c134a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.619 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.618+0000 7f1f81cf1700 1 --2- 172.21.15.142:0/4266592067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f7c0a82e0 0x7f1f7c134a10 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7f1f7c0a74e0 tx=0x7f1f6c0112c0).stop 2020-01-16T05:43:49.619 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.618+0000 7f1f81cf1700 1 -- 172.21.15.142:0/4266592067 shutdown_connections 2020-01-16T05:43:49.619 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.618+0000 7f1f81cf1700 1 --2- 172.21.15.142:0/4266592067 >> v2:172.21.15.84:3300/0 conn(0x7f1f7c07e5a0 0x7f1f7c07c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:49.620 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.618+0000 7f1f81cf1700 1 --2- 172.21.15.142:0/4266592067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f7c0a82e0 0x7f1f7c134a10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:49.620 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.618+0000 7f1f81cf1700 1 -- 172.21.15.142:0/4266592067 shutdown_connections 2020-01-16T05:43:49.620 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.618+0000 7f1f81cf1700 1 -- 172.21.15.142:0/4266592067 wait complete. 2020-01-16T05:43:49.620 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.618+0000 7f1f81cf1700 1 -- 172.21.15.142:0/4266592067 >> 172.21.15.142:0/4266592067 conn(0x7f1f7c092240 msgr2=0x7f1f7c07da60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:49.632 INFO:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new aec305a6-bbac-4e01-8ea1-6077d49e27e2 3 2020-01-16T05:43:49.747 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.742+0000 7fc6e2759700 1 Processor -- start 2020-01-16T05:43:49.747 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.742+0000 7fc6e2759700 1 -- start start 2020-01-16T05:43:49.747 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.742+0000 7fc6e2759700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc6dc0a9b30 0x7fc6dc0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:49.748 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.742+0000 7fc6e2759700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc6dc07ff10 0x7fc6dc066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:49.748 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.742+0000 7fc6e2759700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6dc066dd0 con 0x7fc6dc0a4250 2020-01-16T05:43:49.748 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.742+0000 7fc6e2759700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6dc0a4830 con 0x7fc6dc07ff10 2020-01-16T05:43:49.748 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.742+0000 7fc6e2759700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6dc07f9d0 con 0x7fc6dc0a9b30 2020-01-16T05:43:49.748 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.742+0000 7fc6e1f58700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc6dc0a9b30 0x7fc6dc0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.748 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.742+0000 7fc6e1f58700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc6dc0a9b30 0x7fc6dc0abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36254/0 (socket says 172.21.15.142:36254) 2020-01-16T05:43:49.749 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.742+0000 7fc6e1f58700 1 -- 172.21.15.142:0/2693265085 learned_addr learned my addr 172.21.15.142:0/2693265085 (peer_addr_for_me v2:172.21.15.142:0/0) 2020-01-16T05:43:49.749 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.742+0000 7fc6e1757700 1 --2- 172.21.15.142:0/2693265085 >> v2:172.21.15.84:3300/0 conn(0x7fc6dc07ff10 0x7fc6dc066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.749 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e1f58700 1 -- 172.21.15.142:0/2693265085 >> v2:172.21.15.84:3300/0 conn(0x7fc6dc07ff10 msgr2=0x7fc6dc066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:49.749 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e1f58700 1 --2- 172.21.15.142:0/2693265085 >> v2:172.21.15.84:3300/0 conn(0x7fc6dc07ff10 0x7fc6dc066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:49.749 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e1f58700 1 -- 172.21.15.142:0/2693265085 >> v1:172.21.15.84:6789/0 conn(0x7fc6dc0a4250 legacy=0x7fc6dc0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.749 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e1f58700 1 -- 172.21.15.142:0/2693265085 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc150ce0 con 0x7fc6dc0a9b30 2020-01-16T05:43:49.749 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e1f58700 1 --2- 172.21.15.142:0/2693265085 >> v2:172.21.15.142:3300/0 conn(0x7fc6dc0a9b30 0x7fc6dc0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc6cc002f30 tx=0x7fc6cc00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.750 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e1f58700 1 --2- 172.21.15.142:0/2693265085 >> v2:172.21.15.142:3300/0 conn(0x7fc6dc0a9b30 0x7fc6dc0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc6cc002f30 tx=0x7fc6cc00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.750 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e1f58700 1 --2- 172.21.15.142:0/2693265085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6dc0a9b30 0x7fc6dc0abdd0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7fc6cc002f30 tx=0x7fc6cc00feb0).ready entity=mon.1 client_cookie=d24187604f3aeb8e server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:49.750 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e1f58700 1 --2- 172.21.15.142:0/2693265085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6dc0a9b30 0x7fc6dc0abdd0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fc6cc002f30 tx=0x7fc6cc00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.750 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e0f56700 1 -- 172.21.15.142:0/2693265085 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6cc0116e0 con 0x7fc6dc0a9b30 2020-01-16T05:43:49.750 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e1f58700 1 --2- 172.21.15.142:0/2693265085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6dc0a9b30 0x7fc6dc0abdd0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fc6cc002f30 tx=0x7fc6cc00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.750 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e1f58700 1 --2- 172.21.15.142:0/2693265085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6dc0a9b30 0x7fc6dc0abdd0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fc6cc002f30 tx=0x7fc6cc00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.750 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e0f56700 1 -- 172.21.15.142:0/2693265085 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6cc008d30 con 0x7fc6dc0a9b30 2020-01-16T05:43:49.751 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e0f56700 1 -- 172.21.15.142:0/2693265085 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6cc011cc0 con 0x7fc6dc0a9b30 2020-01-16T05:43:49.751 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e2759700 1 -- 172.21.15.142:0/2693265085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6dc0a9b30 msgr2=0x7fc6dc0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.751 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e2759700 1 --2- 172.21.15.142:0/2693265085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6dc0a9b30 0x7fc6dc0abdd0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7fc6cc002f30 tx=0x7fc6cc00feb0).stop 2020-01-16T05:43:49.751 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e2759700 1 -- 172.21.15.142:0/2693265085 shutdown_connections 2020-01-16T05:43:49.751 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e2759700 1 --2- 172.21.15.142:0/2693265085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6dc0a9b30 0x7fc6dc0abdd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:49.751 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e2759700 1 --2- 172.21.15.142:0/2693265085 >> v2:172.21.15.84:3300/0 conn(0x7fc6dc07ff10 0x7fc6dc066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:49.751 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e2759700 1 -- 172.21.15.142:0/2693265085 shutdown_connections 2020-01-16T05:43:49.752 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e2759700 1 -- 172.21.15.142:0/2693265085 wait complete. 2020-01-16T05:43:49.752 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e2759700 1 -- 172.21.15.142:0/2693265085 >> 172.21.15.142:0/2693265085 conn(0x7fc6dc0acfc0 msgr2=0x7fc6dc0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:49.755 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e2759700 1 Processor -- start 2020-01-16T05:43:49.755 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.746+0000 7fc6e2759700 1 -- start start 2020-01-16T05:43:49.755 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e2759700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6dc062680 0x7fc6dc0611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:49.755 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e2759700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc6dc063870 0x7fc6dc13c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:49.756 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e2759700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6dc061b80 con 0x7fc6dc05bef0 2020-01-16T05:43:49.756 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e2759700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6dc062180 con 0x7fc6dc063870 2020-01-16T05:43:49.756 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e2759700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc061720 con 0x7fc6dc062680 2020-01-16T05:43:49.757 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e1f58700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc6dc05bef0 0x7fc6dc07dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56418/0 (socket says 172.21.15.142:56418) 2020-01-16T05:43:49.757 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e1f58700 1 -- 172.21.15.142:0/923042854 learned_addr learned my addr 172.21.15.142:0/923042854 (peer_addr_for_me v1:172.21.15.142:0/0) 2020-01-16T05:43:49.757 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e1757700 1 --2- 172.21.15.142:0/923042854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6dc062680 0x7fc6dc0611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.757 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e39bb700 1 --2- 172.21.15.142:0/923042854 >> v2:172.21.15.84:3300/0 conn(0x7fc6dc063870 0x7fc6dc13c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.757 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6d27fc700 1 -- 172.21.15.142:0/923042854 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351694346 0 0) 0x7fc6dc061b80 con 0x7fc6dc05bef0 2020-01-16T05:43:49.757 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6d27fc700 1 -- 172.21.15.142:0/923042854 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6c4003230 con 0x7fc6dc05bef0 2020-01-16T05:43:49.757 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e1757700 1 -- 172.21.15.142:0/923042854 >> v2:172.21.15.84:3300/0 conn(0x7fc6dc063870 msgr2=0x7fc6dc13c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.758 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e1757700 1 --2- 172.21.15.142:0/923042854 >> v2:172.21.15.84:3300/0 conn(0x7fc6dc063870 0x7fc6dc13c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:49.758 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e1757700 1 -- 172.21.15.142:0/923042854 >> v1:172.21.15.142:6789/0 conn(0x7fc6dc05bef0 legacy=0x7fc6dc07dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.758 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e1757700 1 -- 172.21.15.142:0/923042854 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc063ca0 con 0x7fc6dc062680 2020-01-16T05:43:49.758 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e1757700 1 --2- 172.21.15.142:0/923042854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6dc062680 0x7fc6dc0611d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc6d8002f30 tx=0x7fc6d8010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.758 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e1757700 1 --2- 172.21.15.142:0/923042854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6dc062680 0x7fc6dc0611d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc6d8002f30 tx=0x7fc6d8010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.758 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e1757700 1 --2- 172.21.15.142:0/923042854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6dc062680 0x7fc6dc0611d0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fc6d8002f30 tx=0x7fc6d8010cf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:49.758 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e1757700 1 --2- 172.21.15.142:0/923042854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6dc062680 0x7fc6dc0611d0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fc6d8002f30 tx=0x7fc6d8010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.759 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6d27fc700 1 -- 172.21.15.142:0/923042854 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6d80127a0 con 0x7fc6dc062680 2020-01-16T05:43:49.759 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e1757700 1 --2- 172.21.15.142:0/923042854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6dc062680 0x7fc6dc0611d0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fc6d8002f30 tx=0x7fc6d8010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.759 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6d27fc700 1 -- 172.21.15.142:0/923042854 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d8007150 con 0x7fc6dc062680 2020-01-16T05:43:49.759 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e1757700 1 --2- 172.21.15.142:0/923042854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6dc062680 0x7fc6dc0611d0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fc6d8002f30 tx=0x7fc6d8010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.759 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e2759700 1 -- 172.21.15.142:0/923042854 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6dc063f70 con 0x7fc6dc062680 2020-01-16T05:43:49.759 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6d27fc700 1 -- 172.21.15.142:0/923042854 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6d8012d80 con 0x7fc6dc062680 2020-01-16T05:43:49.759 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e2759700 1 -- 172.21.15.142:0/923042854 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6dc13c580 con 0x7fc6dc062680 2020-01-16T05:43:49.760 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e1757700 1 --2- 172.21.15.142:0/923042854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6dc062680 0x7fc6dc0611d0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fc6d8002f30 tx=0x7fc6d8010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.760 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6d27fc700 1 -- 172.21.15.142:0/923042854 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7fc6d8005890 con 0x7fc6dc062680 2020-01-16T05:43:49.760 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e1757700 1 --2- 172.21.15.142:0/923042854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6dc062680 0x7fc6dc0611d0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fc6d8002f30 tx=0x7fc6d8010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.760 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6d27fc700 1 -- 172.21.15.142:0/923042854 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7fc6d800ed00 con 0x7fc6dc062680 2020-01-16T05:43:49.760 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.750+0000 7fc6e2759700 1 -- 172.21.15.142:0/923042854 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6dc0618f0 con 0x7fc6dc062680 2020-01-16T05:43:49.761 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.754+0000 7fc6e1757700 1 --2- 172.21.15.142:0/923042854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6dc062680 0x7fc6dc0611d0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fc6d8002f30 tx=0x7fc6d8010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.761 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.754+0000 7fc6d27fc700 1 -- 172.21.15.142:0/923042854 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67593 (secure 0 0 0) 0x7fc6d800d0c0 con 0x7fc6dc062680 2020-01-16T05:43:49.832 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.830+0000 7fc6e2759700 1 -- 172.21.15.142:0/923042854 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aec305a6-bbac-4e01-8ea1-6077d49e27e2", "id": 3} v 0) v1 -- 0x7fc6dc05e1c0 con 0x7fc6dc062680 2020-01-16T05:43:49.840 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.838+0000 7fc6e1757700 1 --2- 172.21.15.142:0/923042854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6dc062680 0x7fc6dc0611d0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fc6d8002f30 tx=0x7fc6d8010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.840 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.838+0000 7fc6d27fc700 1 -- 172.21.15.142:0/923042854 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aec305a6-bbac-4e01-8ea1-6077d49e27e2", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc6d8005ca0 con 0x7fc6dc062680 2020-01-16T05:43:49.840 INFO:teuthology.orchestra.run.smithi142.stdout:3 2020-01-16T05:43:49.841 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.842+0000 7fc6e2759700 1 -- 172.21.15.142:0/923042854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6dc062680 msgr2=0x7fc6dc0611d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.842 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.842+0000 7fc6e2759700 1 --2- 172.21.15.142:0/923042854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6dc062680 0x7fc6dc0611d0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fc6d8002f30 tx=0x7fc6d8010cf0).stop 2020-01-16T05:43:49.842 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.842+0000 7fc6e2759700 1 -- 172.21.15.142:0/923042854 shutdown_connections 2020-01-16T05:43:49.842 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.842+0000 7fc6e2759700 1 --2- 172.21.15.142:0/923042854 >> v2:172.21.15.84:3300/0 conn(0x7fc6dc063870 0x7fc6dc13c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:49.842 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.842+0000 7fc6e2759700 1 --2- 172.21.15.142:0/923042854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6dc062680 0x7fc6dc0611d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:49.842 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.842+0000 7fc6e2759700 1 -- 172.21.15.142:0/923042854 shutdown_connections 2020-01-16T05:43:49.842 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.842+0000 7fc6e2759700 1 -- 172.21.15.142:0/923042854 wait complete. 2020-01-16T05:43:49.842 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.842+0000 7fc6e2759700 1 -- 172.21.15.142:0/923042854 >> 172.21.15.142:0/923042854 conn(0x7fc6dc066650 msgr2=0x7fc6dc0246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:49.852 INFO:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new aaec7f3e-299a-4546-8406-207bcc4b3afd 4 2020-01-16T05:43:49.959 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.954+0000 7f00af59e700 1 Processor -- start 2020-01-16T05:43:49.960 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.954+0000 7f00af59e700 1 -- start start 2020-01-16T05:43:49.960 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.954+0000 7f00af59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f00b00a9b30 0x7f00b00abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:49.960 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00af59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f00b00a4250 0x7f00b0066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:49.960 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00af59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b0066dd0 con 0x7f00b007ff10 2020-01-16T05:43:49.960 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00af59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b00a4830 con 0x7f00b00a4250 2020-01-16T05:43:49.960 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00af59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b007f9d0 con 0x7f00b00a9b30 2020-01-16T05:43:49.961 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00aed9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f00b00a9b30 0x7f00b00abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.961 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00aed9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f00b00a9b30 0x7f00b00abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36266/0 (socket says 172.21.15.142:36266) 2020-01-16T05:43:49.961 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00aed9d700 1 -- 172.21.15.142:0/837289561 learned_addr learned my addr 172.21.15.142:0/837289561 (peer_addr_for_me v2:172.21.15.142:0/0) 2020-01-16T05:43:49.961 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00b481e700 1 --2- 172.21.15.142:0/837289561 >> v2:172.21.15.84:3300/0 conn(0x7f00b00a4250 0x7f00b0066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.961 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00aed9d700 1 -- 172.21.15.142:0/837289561 >> v2:172.21.15.84:3300/0 conn(0x7f00b00a4250 msgr2=0x7f00b0066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:49.961 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00aed9d700 1 --2- 172.21.15.142:0/837289561 >> v2:172.21.15.84:3300/0 conn(0x7f00b00a4250 0x7f00b0066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:49.961 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00aed9d700 1 -- 172.21.15.142:0/837289561 >> v1:172.21.15.84:6789/0 conn(0x7f00b007ff10 legacy=0x7f00b00a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.962 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00aed9d700 1 -- 172.21.15.142:0/837289561 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b0150ce0 con 0x7f00b00a9b30 2020-01-16T05:43:49.962 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00aed9d700 1 --2- 172.21.15.142:0/837289561 >> v2:172.21.15.142:3300/0 conn(0x7f00b00a9b30 0x7f00b00abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f00a0002f30 tx=0x7f00a000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.962 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00aed9d700 1 --2- 172.21.15.142:0/837289561 >> v2:172.21.15.142:3300/0 conn(0x7f00b00a9b30 0x7f00b00abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f00a0002f30 tx=0x7f00a000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.962 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00aed9d700 1 --2- 172.21.15.142:0/837289561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00b00a9b30 0x7f00b00abdd0 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f00a0002f30 tx=0x7f00a000feb0).ready entity=mon.1 client_cookie=98ee2cb515bbf3bb server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:49.962 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00aed9d700 1 --2- 172.21.15.142:0/837289561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00b00a9b30 0x7f00b00abdd0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f00a0002f30 tx=0x7f00a000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.963 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00ae59c700 1 -- 172.21.15.142:0/837289561 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00a00116e0 con 0x7f00b00a9b30 2020-01-16T05:43:49.963 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00aed9d700 1 --2- 172.21.15.142:0/837289561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00b00a9b30 0x7f00b00abdd0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f00a0002f30 tx=0x7f00a000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.963 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00ae59c700 1 -- 172.21.15.142:0/837289561 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a0008d30 con 0x7f00b00a9b30 2020-01-16T05:43:49.963 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00aed9d700 1 --2- 172.21.15.142:0/837289561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00b00a9b30 0x7f00b00abdd0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f00a0002f30 tx=0x7f00a000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.963 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00af59e700 1 -- 172.21.15.142:0/837289561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00b00a9b30 msgr2=0x7f00b00abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.963 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00ae59c700 1 -- 172.21.15.142:0/837289561 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00a0011cc0 con 0x7f00b00a9b30 2020-01-16T05:43:49.963 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00af59e700 1 --2- 172.21.15.142:0/837289561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00b00a9b30 0x7f00b00abdd0 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f00a0002f30 tx=0x7f00a000feb0).stop 2020-01-16T05:43:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00af59e700 1 -- 172.21.15.142:0/837289561 shutdown_connections 2020-01-16T05:43:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00af59e700 1 --2- 172.21.15.142:0/837289561 >> v2:172.21.15.84:3300/0 conn(0x7f00b00a4250 0x7f00b0066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00af59e700 1 --2- 172.21.15.142:0/837289561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00b00a9b30 0x7f00b00abdd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00af59e700 1 -- 172.21.15.142:0/837289561 shutdown_connections 2020-01-16T05:43:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00af59e700 1 -- 172.21.15.142:0/837289561 wait complete. 2020-01-16T05:43:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00af59e700 1 -- 172.21.15.142:0/837289561 >> 172.21.15.142:0/837289561 conn(0x7f00b00acfc0 msgr2=0x7f00b00a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:49.967 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00af59e700 1 Processor -- start 2020-01-16T05:43:49.968 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.958+0000 7f00af59e700 1 -- start start 2020-01-16T05:43:49.968 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00af59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f00b0128610 0x7f00b0125030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:49.968 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00af59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00b0127240 0x7f00b01233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:49.968 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00af59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b00a36a0 con 0x7f00b007ca20 2020-01-16T05:43:49.968 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00af59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b0127670 con 0x7f00b0128610 2020-01-16T05:43:49.968 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00af59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0122e70 con 0x7f00b0127240 2020-01-16T05:43:49.968 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a659c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00b0127240 0x7f00b01233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a659c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00b0127240 0x7f00b01233b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:47082/0 (socket says 172.21.15.142:47082) 2020-01-16T05:43:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a659c700 1 -- 172.21.15.142:0/3671112631 learned_addr learned my addr 172.21.15.142:0/3671112631 (peer_addr_for_me v2:172.21.15.142:0/0) 2020-01-16T05:43:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00aed9d700 1 --2- 172.21.15.142:0/3671112631 >> v2:172.21.15.84:3300/0 conn(0x7f00b0128610 0x7f00b0125030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a7fff700 1 -- 172.21.15.142:0/3671112631 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018296705 0 0) 0x7f00b00a36a0 con 0x7f00b007ca20 2020-01-16T05:43:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a7fff700 1 -- 172.21.15.142:0/3671112631 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0094003230 con 0x7f00b007ca20 2020-01-16T05:43:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a659c700 1 -- 172.21.15.142:0/3671112631 >> v2:172.21.15.84:3300/0 conn(0x7f00b0128610 msgr2=0x7f00b0125030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a659c700 1 --2- 172.21.15.142:0/3671112631 >> v2:172.21.15.84:3300/0 conn(0x7f00b0128610 0x7f00b0125030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a659c700 1 -- 172.21.15.142:0/3671112631 >> v1:172.21.15.142:6789/0 conn(0x7f00b007ca20 legacy=0x7f00b0135b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a659c700 1 -- 172.21.15.142:0/3671112631 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b00ab090 con 0x7f00b0127240 2020-01-16T05:43:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a659c700 1 --2- 172.21.15.142:0/3671112631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00b0127240 0x7f00b01233b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00b0123dc0 tx=0x7f0098010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a659c700 1 --2- 172.21.15.142:0/3671112631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00b0127240 0x7f00b01233b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00b0123dc0 tx=0x7f0098010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a659c700 1 --2- 172.21.15.142:0/3671112631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00b0127240 0x7f00b01233b0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7f00b0123dc0 tx=0x7f0098010b20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a659c700 1 --2- 172.21.15.142:0/3671112631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00b0127240 0x7f00b01233b0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f00b0123dc0 tx=0x7f0098010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a7fff700 1 -- 172.21.15.142:0/3671112631 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f009800cc20 con 0x7f00b0127240 2020-01-16T05:43:49.971 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a659c700 1 --2- 172.21.15.142:0/3671112631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00b0127240 0x7f00b01233b0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f00b0123dc0 tx=0x7f0098010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.971 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a659c700 1 --2- 172.21.15.142:0/3671112631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00b0127240 0x7f00b01233b0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f00b0123dc0 tx=0x7f0098010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.971 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a7fff700 1 -- 172.21.15.142:0/3671112631 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009800c840 con 0x7f00b0127240 2020-01-16T05:43:49.971 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00af59e700 1 -- 172.21.15.142:0/3671112631 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b01256f0 con 0x7f00b0127240 2020-01-16T05:43:49.971 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a7fff700 1 -- 172.21.15.142:0/3671112631 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0098012580 con 0x7f00b0127240 2020-01-16T05:43:49.971 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00af59e700 1 -- 172.21.15.142:0/3671112631 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b007ce50 con 0x7f00b0127240 2020-01-16T05:43:49.971 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a659c700 1 --2- 172.21.15.142:0/3671112631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00b0127240 0x7f00b01233b0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f00b0123dc0 tx=0x7f0098010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.972 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a7fff700 1 -- 172.21.15.142:0/3671112631 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7f0098012780 con 0x7f00b0127240 2020-01-16T05:43:49.972 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a659c700 1 --2- 172.21.15.142:0/3671112631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00b0127240 0x7f00b01233b0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f00b0123dc0 tx=0x7f0098010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.972 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00a7fff700 1 -- 172.21.15.142:0/3671112631 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f0098012a90 con 0x7f00b0127240 2020-01-16T05:43:49.972 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.962+0000 7f00af59e700 1 -- 172.21.15.142:0/3671112631 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b005e1c0 con 0x7f00b0127240 2020-01-16T05:43:49.972 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.966+0000 7f00a659c700 1 --2- 172.21.15.142:0/3671112631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00b0127240 0x7f00b01233b0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f00b0123dc0 tx=0x7f0098010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:49.972 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:49.966+0000 7f00a7fff700 1 -- 172.21.15.142:0/3671112631 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67593 (secure 0 0 0) 0x7f00980064e0 con 0x7f00b0127240 2020-01-16T05:43:50.046 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.046+0000 7f00af59e700 1 -- 172.21.15.142:0/3671112631 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aaec7f3e-299a-4546-8406-207bcc4b3afd", "id": 4} v 0) v1 -- 0x7f00b0122c40 con 0x7f00b0127240 2020-01-16T05:43:50.053 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.054+0000 7f00a659c700 1 --2- 172.21.15.142:0/3671112631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00b0127240 0x7f00b01233b0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f00b0123dc0 tx=0x7f0098010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.053 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.054+0000 7f00a7fff700 1 -- 172.21.15.142:0/3671112631 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aaec7f3e-299a-4546-8406-207bcc4b3afd", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0098010200 con 0x7f00b0127240 2020-01-16T05:43:50.053 INFO:teuthology.orchestra.run.smithi142.stdout:4 2020-01-16T05:43:50.054 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.054+0000 7f00af59e700 1 -- 172.21.15.142:0/3671112631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00b0127240 msgr2=0x7f00b01233b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:50.055 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.054+0000 7f00af59e700 1 --2- 172.21.15.142:0/3671112631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00b0127240 0x7f00b01233b0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7f00b0123dc0 tx=0x7f0098010b20).stop 2020-01-16T05:43:50.055 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.054+0000 7f00af59e700 1 -- 172.21.15.142:0/3671112631 shutdown_connections 2020-01-16T05:43:50.055 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.054+0000 7f00af59e700 1 --2- 172.21.15.142:0/3671112631 >> v2:172.21.15.84:3300/0 conn(0x7f00b0128610 0x7f00b0125030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:50.055 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.054+0000 7f00af59e700 1 --2- 172.21.15.142:0/3671112631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00b0127240 0x7f00b01233b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:50.055 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.054+0000 7f00af59e700 1 -- 172.21.15.142:0/3671112631 shutdown_connections 2020-01-16T05:43:50.055 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.054+0000 7f00af59e700 1 -- 172.21.15.142:0/3671112631 wait complete. 2020-01-16T05:43:50.056 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.054+0000 7f00af59e700 1 -- 172.21.15.142:0/3671112631 >> 172.21.15.142:0/3671112631 conn(0x7f00b00ab810 msgr2=0x7f00b007ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:50.066 INFO:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 5a942a47-7346-46d4-adf8-dad2bdb95aec 5 2020-01-16T05:43:50.183 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.178+0000 7f5183fff700 1 Processor -- start 2020-01-16T05:43:50.184 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.178+0000 7f5183fff700 1 -- start start 2020-01-16T05:43:50.184 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.178+0000 7f5183fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51840a9b30 0x7f51840abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:50.184 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.178+0000 7f5183fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f518407ff10 0x7f5184066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:50.184 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.178+0000 7f5183fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5184066dd0 con 0x7f51840a4250 2020-01-16T05:43:50.184 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.178+0000 7f5183fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51840a4830 con 0x7f518407ff10 2020-01-16T05:43:50.184 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.178+0000 7f5183fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518407f9d0 con 0x7f51840a9b30 2020-01-16T05:43:50.185 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.178+0000 7f5182ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f518407ff10 0x7f5184066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:50.185 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.178+0000 7f5182ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f518407ff10 0x7f5184066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36274/0 (socket says 172.21.15.142:36274) 2020-01-16T05:43:50.185 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.178+0000 7f51837fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51840a9b30 0x7f51840abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:50.185 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.178+0000 7f5182ffd700 1 -- 172.21.15.142:0/2944732904 learned_addr learned my addr 172.21.15.142:0/2944732904 (peer_addr_for_me v2:172.21.15.142:0/0) 2020-01-16T05:43:50.185 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51837fe700 1 -- 172.21.15.142:0/2944732904 >> v2:172.21.15.142:3300/0 conn(0x7f518407ff10 msgr2=0x7f5184066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:50.185 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51837fe700 1 --2- 172.21.15.142:0/2944732904 >> v2:172.21.15.142:3300/0 conn(0x7f518407ff10 0x7f5184066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:50.185 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51837fe700 1 -- 172.21.15.142:0/2944732904 >> v1:172.21.15.84:6789/0 conn(0x7f51840a4250 legacy=0x7f51840a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:50.186 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51837fe700 1 -- 172.21.15.142:0/2944732904 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5184150ce0 con 0x7f51840a9b30 2020-01-16T05:43:50.186 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f5182ffd700 1 --2- 172.21.15.142:0/2944732904 >> v2:172.21.15.142:3300/0 conn(0x7f518407ff10 0x7f5184066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:43:50.186 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51837fe700 1 --2- 172.21.15.142:0/2944732904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51840a9b30 0x7f51840abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5178008910 tx=0x7f517800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.186 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51837fe700 1 --2- 172.21.15.142:0/2944732904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51840a9b30 0x7f51840abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5178008910 tx=0x7f517800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.186 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51837fe700 1 --2- 172.21.15.142:0/2944732904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51840a9b30 0x7f51840abdd0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f5178008910 tx=0x7f517800fdf0).ready entity=mon.2 client_cookie=c77fd17a93279a09 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:50.186 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51837fe700 1 --2- 172.21.15.142:0/2944732904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51840a9b30 0x7f51840abdd0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f5178008910 tx=0x7f517800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.186 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51827fc700 1 -- 172.21.15.142:0/2944732904 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5178011660 con 0x7f51840a9b30 2020-01-16T05:43:50.187 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51837fe700 1 --2- 172.21.15.142:0/2944732904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51840a9b30 0x7f51840abdd0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f5178008910 tx=0x7f517800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.187 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51837fe700 1 --2- 172.21.15.142:0/2944732904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51840a9b30 0x7f51840abdd0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f5178008910 tx=0x7f517800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.187 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51827fc700 1 -- 172.21.15.142:0/2944732904 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5178008c50 con 0x7f51840a9b30 2020-01-16T05:43:50.187 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51827fc700 1 -- 172.21.15.142:0/2944732904 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5178011c40 con 0x7f51840a9b30 2020-01-16T05:43:50.187 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f5183fff700 1 -- 172.21.15.142:0/2944732904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51840a9b30 msgr2=0x7f51840abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:50.187 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f5183fff700 1 --2- 172.21.15.142:0/2944732904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51840a9b30 0x7f51840abdd0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f5178008910 tx=0x7f517800fdf0).stop 2020-01-16T05:43:50.187 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f5183fff700 1 -- 172.21.15.142:0/2944732904 shutdown_connections 2020-01-16T05:43:50.188 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f5183fff700 1 --2- 172.21.15.142:0/2944732904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51840a9b30 0x7f51840abdd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:50.188 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f5183fff700 1 --2- 172.21.15.142:0/2944732904 >> v2:172.21.15.142:3300/0 conn(0x7f518407ff10 0x7f5184066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:50.188 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f5183fff700 1 -- 172.21.15.142:0/2944732904 shutdown_connections 2020-01-16T05:43:50.188 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f5183fff700 1 -- 172.21.15.142:0/2944732904 wait complete. 2020-01-16T05:43:50.188 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f5183fff700 1 -- 172.21.15.142:0/2944732904 >> 172.21.15.142:0/2944732904 conn(0x7f51840acfc0 msgr2=0x7f51840a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:50.188 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f5183fff700 1 Processor -- start 2020-01-16T05:43:50.188 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f5183fff700 1 -- start start 2020-01-16T05:43:50.191 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f5183fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5184127390 0x7f51840a2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:50.192 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f5183fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f518408f710 0x7f518413fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:50.192 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f5183fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5184090360 con 0x7f51840a2890 2020-01-16T05:43:50.192 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f5183fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5184127b30 con 0x7f518408f710 2020-01-16T05:43:50.192 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f5183fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51840a3260 con 0x7f5184127390 2020-01-16T05:43:50.193 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51837fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5184127390 0x7f51840a2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:50.193 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51837fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5184127390 0x7f51840a2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36280/0 (socket says 172.21.15.142:36280) 2020-01-16T05:43:50.193 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51837fe700 1 -- 172.21.15.142:0/3040833839 learned_addr learned my addr 172.21.15.142:0/3040833839 (peer_addr_for_me v2:172.21.15.142:0/0) 2020-01-16T05:43:50.193 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f518966b700 1 --2- 172.21.15.142:0/3040833839 >> v2:172.21.15.84:3300/0 conn(0x7f518408f710 0x7f518413fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:50.193 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51837fe700 1 -- 172.21.15.142:0/3040833839 >> v2:172.21.15.84:3300/0 conn(0x7f518408f710 msgr2=0x7f518413fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:50.193 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51837fe700 1 --2- 172.21.15.142:0/3040833839 >> v2:172.21.15.84:3300/0 conn(0x7f518408f710 0x7f518413fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:50.193 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51837fe700 1 -- 172.21.15.142:0/3040833839 >> v1:172.21.15.84:6789/0 conn(0x7f51840a2890 legacy=0x7f518408ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:50.194 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.182+0000 7f51837fe700 1 -- 172.21.15.142:0/3040833839 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51840ab090 con 0x7f5184127390 2020-01-16T05:43:50.194 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.186+0000 7f51837fe700 1 --2- 172.21.15.142:0/3040833839 >> v2:172.21.15.142:3300/0 conn(0x7f5184127390 0x7f51840a2340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5178008910 tx=0x7f5178011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.194 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.186+0000 7f51837fe700 1 --2- 172.21.15.142:0/3040833839 >> v2:172.21.15.142:3300/0 conn(0x7f5184127390 0x7f51840a2340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5178008910 tx=0x7f5178011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.194 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.186+0000 7f51837fe700 1 --2- 172.21.15.142:0/3040833839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5184127390 0x7f51840a2340 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f5178008910 tx=0x7f5178011720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:50.194 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.186+0000 7f51837fe700 1 --2- 172.21.15.142:0/3040833839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5184127390 0x7f51840a2340 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f5178008910 tx=0x7f5178011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.194 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.186+0000 7f516bfff700 1 -- 172.21.15.142:0/3040833839 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f517800f760 con 0x7f5184127390 2020-01-16T05:43:50.194 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.186+0000 7f51837fe700 1 --2- 172.21.15.142:0/3040833839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5184127390 0x7f51840a2340 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f5178008910 tx=0x7f5178011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.195 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.186+0000 7f51837fe700 1 --2- 172.21.15.142:0/3040833839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5184127390 0x7f51840a2340 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f5178008910 tx=0x7f5178011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.195 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.186+0000 7f516bfff700 1 -- 172.21.15.142:0/3040833839 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5178011860 con 0x7f5184127390 2020-01-16T05:43:50.195 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.186+0000 7f5183fff700 1 -- 172.21.15.142:0/3040833839 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51840a0de0 con 0x7f5184127390 2020-01-16T05:43:50.195 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.186+0000 7f516bfff700 1 -- 172.21.15.142:0/3040833839 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51780056c0 con 0x7f5184127390 2020-01-16T05:43:50.195 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.186+0000 7f5183fff700 1 -- 172.21.15.142:0/3040833839 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51840a3660 con 0x7f5184127390 2020-01-16T05:43:50.195 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.186+0000 7f51837fe700 1 --2- 172.21.15.142:0/3040833839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5184127390 0x7f51840a2340 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f5178008910 tx=0x7f5178011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.196 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.186+0000 7f516bfff700 1 -- 172.21.15.142:0/3040833839 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7f51780059d0 con 0x7f5184127390 2020-01-16T05:43:50.196 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.186+0000 7f51837fe700 1 --2- 172.21.15.142:0/3040833839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5184127390 0x7f51840a2340 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f5178008910 tx=0x7f5178011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.196 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.186+0000 7f516bfff700 1 -- 172.21.15.142:0/3040833839 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f517800c310 con 0x7f5184127390 2020-01-16T05:43:50.196 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.186+0000 7f5183fff700 1 -- 172.21.15.142:0/3040833839 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518405e1c0 con 0x7f5184127390 2020-01-16T05:43:50.196 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.190+0000 7f51837fe700 1 --2- 172.21.15.142:0/3040833839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5184127390 0x7f51840a2340 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f5178008910 tx=0x7f5178011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.196 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.190+0000 7f516bfff700 1 -- 172.21.15.142:0/3040833839 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67593 (secure 0 0 0) 0x7f517800c550 con 0x7f5184127390 2020-01-16T05:43:50.271 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.266+0000 7f5183fff700 1 -- 172.21.15.142:0/3040833839 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5a942a47-7346-46d4-adf8-dad2bdb95aec", "id": 5} v 0) v1 -- 0x7f518409fce0 con 0x7f5184127390 2020-01-16T05:43:50.277 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.274+0000 7f51837fe700 1 --2- 172.21.15.142:0/3040833839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5184127390 0x7f51840a2340 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f5178008910 tx=0x7f5178011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.278 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.274+0000 7f516bfff700 1 -- 172.21.15.142:0/3040833839 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5a942a47-7346-46d4-adf8-dad2bdb95aec", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f517800c830 con 0x7f5184127390 2020-01-16T05:43:50.278 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.278+0000 7f5183fff700 1 -- 172.21.15.142:0/3040833839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5184127390 msgr2=0x7f51840a2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:50.278 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.278+0000 7f5183fff700 1 --2- 172.21.15.142:0/3040833839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5184127390 0x7f51840a2340 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f5178008910 tx=0x7f5178011720).stop 2020-01-16T05:43:50.278 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.278+0000 7f5183fff700 1 -- 172.21.15.142:0/3040833839 shutdown_connections 2020-01-16T05:43:50.278 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.278+0000 7f5183fff700 1 --2- 172.21.15.142:0/3040833839 >> v2:172.21.15.84:3300/0 conn(0x7f518408f710 0x7f518413fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:50.278 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.278+0000 7f5183fff700 1 --2- 172.21.15.142:0/3040833839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5184127390 0x7f51840a2340 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:50.279 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.278+0000 7f5183fff700 1 -- 172.21.15.142:0/3040833839 shutdown_connections 2020-01-16T05:43:50.286 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.278+0000 7f5183fff700 1 -- 172.21.15.142:0/3040833839 wait complete. 2020-01-16T05:43:50.286 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.278+0000 7f5183fff700 1 -- 172.21.15.142:0/3040833839 >> 172.21.15.142:0/3040833839 conn(0x7f51840a4ad0 msgr2=0x7f51840a3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:50.286 INFO:teuthology.orchestra.run.smithi142.stdout:5 2020-01-16T05:43:50.289 INFO:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new c69fca67-66e4-4c31-ab03-1419e2a83e10 6 2020-01-16T05:43:50.398 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc5a48b2700 1 Processor -- start 2020-01-16T05:43:50.399 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc5a48b2700 1 -- start start 2020-01-16T05:43:50.399 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc5a48b2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc5a00a2f60 0x7fc5a005b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:50.399 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc5a48b2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a007cd60 con 0x7fc5a008fd80 2020-01-16T05:43:50.399 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc5a48b2700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a00a9420 con 0x7fc5a00a8ff0 2020-01-16T05:43:50.399 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc5a48b2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a00a3390 con 0x7fc5a00a2f60 2020-01-16T05:43:50.399 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59e59c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc5a00a8ff0 0x7fc5a007c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56448/0 (socket says 172.21.15.142:56448) 2020-01-16T05:43:50.400 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59e59c700 1 -- 172.21.15.142:0/269979914 learned_addr learned my addr 172.21.15.142:0/269979914 (peer_addr_for_me v1:172.21.15.142:0/0) 2020-01-16T05:43:50.400 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59ed9d700 1 --2- 172.21.15.142:0/269979914 >> v2:172.21.15.84:3300/0 conn(0x7fc5a00a2f60 0x7fc5a005b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:50.400 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59dd9b700 1 -- 172.21.15.142:0/269979914 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857130251 0 0) 0x7fc5a00a9420 con 0x7fc5a00a8ff0 2020-01-16T05:43:50.400 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59dd9b700 1 -- 172.21.15.142:0/269979914 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc580003230 con 0x7fc5a00a8ff0 2020-01-16T05:43:50.400 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59dd9b700 1 -- 172.21.15.142:0/269979914 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1437187062 0 0) 0x7fc580003230 con 0x7fc5a00a8ff0 2020-01-16T05:43:50.400 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59dd9b700 1 -- 172.21.15.142:0/269979914 >> v2:172.21.15.84:3300/0 conn(0x7fc5a00a2f60 msgr2=0x7fc5a005b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:50.400 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59dd9b700 1 --2- 172.21.15.142:0/269979914 >> v2:172.21.15.84:3300/0 conn(0x7fc5a00a2f60 0x7fc5a005b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:50.401 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59dd9b700 1 -- 172.21.15.142:0/269979914 >> v1:172.21.15.84:6789/0 conn(0x7fc5a008fd80 legacy=0x7fc5a01503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:50.401 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59dd9b700 1 -- 172.21.15.142:0/269979914 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a008f570 con 0x7fc5a00a8ff0 2020-01-16T05:43:50.401 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59dd9b700 1 -- 172.21.15.142:0/269979914 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7fc590001750 con 0x7fc5a00a8ff0 2020-01-16T05:43:50.401 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59dd9b700 1 -- 172.21.15.142:0/269979914 >> v1:172.21.15.142:6789/0 conn(0x7fc5a00a8ff0 legacy=0x7fc5a007c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:50.401 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59dd9b700 1 --2- 172.21.15.142:0/269979914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc580003860 0x7fc580003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:50.401 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59dd9b700 1 --2- 172.21.15.142:0/269979914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5800045a0 0x7fc5800049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:50.402 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59dd9b700 1 --2- 172.21.15.142:0/269979914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc580004f20 0x7fc58000b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:50.402 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59dd9b700 1 -- 172.21.15.142:0/269979914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a00a3390 con 0x7fc5800045a0 2020-01-16T05:43:50.402 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59dd9b700 1 -- 172.21.15.142:0/269979914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58004fde0 con 0x7fc580004f20 2020-01-16T05:43:50.402 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59dd9b700 1 -- 172.21.15.142:0/269979914 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc580050020 con 0x7fc580003860 2020-01-16T05:43:50.402 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59f59e700 1 --2- 172.21.15.142:0/269979914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc580004f20 0x7fc58000b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:50.402 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59ed9d700 1 --2- 172.21.15.142:0/269979914 >> v2:172.21.15.84:3300/0 conn(0x7fc5a00a2f60 0x7fc5a005b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:43:50.407 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59e59c700 1 --2- 172.21.15.142:0/269979914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5800045a0 0x7fc5800049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:50.407 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59ed9d700 1 --2- 172.21.15.142:0/269979914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc580003860 0x7fc580003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:50.407 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59f59e700 1 -- 172.21.15.142:0/269979914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc580003860 msgr2=0x7fc580003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:50.409 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59f59e700 1 --2- 172.21.15.142:0/269979914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc580003860 0x7fc580003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:50.410 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59f59e700 1 -- 172.21.15.142:0/269979914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5800045a0 msgr2=0x7fc5800049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:50.410 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59f59e700 1 --2- 172.21.15.142:0/269979914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5800045a0 0x7fc5800049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:50.410 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59f59e700 1 -- 172.21.15.142:0/269979914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc580050320 con 0x7fc580004f20 2020-01-16T05:43:50.410 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59f59e700 1 --2- 172.21.15.142:0/269979914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc580004f20 0x7fc58000b7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc598001000 tx=0x7fc59800fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.410 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59f59e700 1 -- 172.21.15.142:0/269979914 reap_dead start 2020-01-16T05:43:50.410 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59f59e700 1 --2- 172.21.15.142:0/269979914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc580004f20 0x7fc58000b7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc598001000 tx=0x7fc59800fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.410 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59f59e700 1 --2- 172.21.15.142:0/269979914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc580004f20 0x7fc58000b7f0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fc598001000 tx=0x7fc59800fe20).ready entity=mon.1 client_cookie=aa95094092d36a4f server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:50.411 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59f59e700 1 --2- 172.21.15.142:0/269979914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc580004f20 0x7fc58000b7f0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fc598001000 tx=0x7fc59800fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.411 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59dd9b700 1 -- 172.21.15.142:0/269979914 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc598003540 con 0x7fc580004f20 2020-01-16T05:43:50.411 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59f59e700 1 --2- 172.21.15.142:0/269979914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc580004f20 0x7fc58000b7f0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fc598001000 tx=0x7fc59800fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.411 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59dd9b700 1 -- 172.21.15.142:0/269979914 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc598003160 con 0x7fc580004f20 2020-01-16T05:43:50.411 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59f59e700 1 --2- 172.21.15.142:0/269979914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc580004f20 0x7fc58000b7f0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fc598001000 tx=0x7fc59800fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.411 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc59dd9b700 1 -- 172.21.15.142:0/269979914 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc598003b20 con 0x7fc580004f20 2020-01-16T05:43:50.411 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc5a48b2700 1 -- 172.21.15.142:0/269979914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc580004f20 msgr2=0x7fc58000b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:50.412 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.394+0000 7fc5a48b2700 1 --2- 172.21.15.142:0/269979914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc580004f20 0x7fc58000b7f0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fc598001000 tx=0x7fc59800fe20).stop 2020-01-16T05:43:50.412 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc5a48b2700 1 -- 172.21.15.142:0/269979914 shutdown_connections 2020-01-16T05:43:50.412 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc5a48b2700 1 --2- 172.21.15.142:0/269979914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc580004f20 0x7fc58000b7f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:50.412 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc5a48b2700 1 -- 172.21.15.142:0/269979914 shutdown_connections 2020-01-16T05:43:50.412 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc5a48b2700 1 -- 172.21.15.142:0/269979914 wait complete. 2020-01-16T05:43:50.421 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc5a48b2700 1 -- 172.21.15.142:0/269979914 >> 172.21.15.142:0/269979914 conn(0x7fc5a00abc10 msgr2=0x7fc5a005a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:50.425 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc5a48b2700 1 Processor -- start 2020-01-16T05:43:50.425 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc5a48b2700 1 -- start start 2020-01-16T05:43:50.425 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc5a48b2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc5a0148600 0x7fc5a01499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:50.425 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc5a48b2700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc5a007d7b0 0x7fc5a0138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:50.425 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc5a48b2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a0148280 con 0x7fc5a01470f0 2020-01-16T05:43:50.426 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc5a48b2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a0148a30 con 0x7fc5a0148600 2020-01-16T05:43:50.426 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc5a48b2700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a007ff30 con 0x7fc5a007d7b0 2020-01-16T05:43:50.426 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc59f59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc5a007d7b0 0x7fc5a0138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:50.426 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc59f59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc5a007d7b0 0x7fc5a0138ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36302/0 (socket says 172.21.15.142:36302) 2020-01-16T05:43:50.426 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc59f59e700 1 -- 172.21.15.142:0/1272381524 learned_addr learned my addr 172.21.15.142:0/1272381524 (peer_addr_for_me v2:172.21.15.142:0/0) 2020-01-16T05:43:50.426 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc59e59c700 1 --2- 172.21.15.142:0/1272381524 >> v2:172.21.15.84:3300/0 conn(0x7fc5a0148600 0x7fc5a01499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:50.426 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc59f59e700 1 -- 172.21.15.142:0/1272381524 >> v2:172.21.15.84:3300/0 conn(0x7fc5a0148600 msgr2=0x7fc5a01499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:50.427 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc59f59e700 1 --2- 172.21.15.142:0/1272381524 >> v2:172.21.15.84:3300/0 conn(0x7fc5a0148600 0x7fc5a01499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:50.427 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc59f59e700 1 -- 172.21.15.142:0/1272381524 >> v1:172.21.15.84:6789/0 conn(0x7fc5a01470f0 legacy=0x7fc5a007cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:50.427 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc59f59e700 1 -- 172.21.15.142:0/1272381524 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a00a1870 con 0x7fc5a007d7b0 2020-01-16T05:43:50.427 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc59f59e700 1 --2- 172.21.15.142:0/1272381524 >> v2:172.21.15.142:3300/0 conn(0x7fc5a007d7b0 0x7fc5a0138ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc598001000 tx=0x7fc59800f830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.427 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc59f59e700 1 --2- 172.21.15.142:0/1272381524 >> v2:172.21.15.142:3300/0 conn(0x7fc5a007d7b0 0x7fc5a0138ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc598001000 tx=0x7fc59800f830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.427 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.398+0000 7fc59f59e700 1 --2- 172.21.15.142:0/1272381524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5a007d7b0 0x7fc5a0138ea0 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fc598001000 tx=0x7fc59800f830).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:50.427 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.402+0000 7fc59f59e700 1 --2- 172.21.15.142:0/1272381524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5a007d7b0 0x7fc5a0138ea0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fc598001000 tx=0x7fc59800f830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.428 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.402+0000 7fc5977fe700 1 -- 172.21.15.142:0/1272381524 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc598010770 con 0x7fc5a007d7b0 2020-01-16T05:43:50.428 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.402+0000 7fc59f59e700 1 --2- 172.21.15.142:0/1272381524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5a007d7b0 0x7fc5a0138ea0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fc598001000 tx=0x7fc59800f830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.428 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.402+0000 7fc59f59e700 1 --2- 172.21.15.142:0/1272381524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5a007d7b0 0x7fc5a0138ea0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fc598001000 tx=0x7fc59800f830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.428 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.402+0000 7fc5977fe700 1 -- 172.21.15.142:0/1272381524 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc598003740 con 0x7fc5a007d7b0 2020-01-16T05:43:50.428 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.402+0000 7fc5a48b2700 1 -- 172.21.15.142:0/1272381524 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a007dbe0 con 0x7fc5a007d7b0 2020-01-16T05:43:50.428 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.402+0000 7fc5977fe700 1 -- 172.21.15.142:0/1272381524 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc598010d50 con 0x7fc5a007d7b0 2020-01-16T05:43:50.428 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.402+0000 7fc5a48b2700 1 -- 172.21.15.142:0/1272381524 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a01393f0 con 0x7fc5a007d7b0 2020-01-16T05:43:50.428 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.402+0000 7fc59f59e700 1 --2- 172.21.15.142:0/1272381524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5a007d7b0 0x7fc5a0138ea0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fc598001000 tx=0x7fc59800f830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.429 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.402+0000 7fc5977fe700 1 -- 172.21.15.142:0/1272381524 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7fc59800a520 con 0x7fc5a007d7b0 2020-01-16T05:43:50.429 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.402+0000 7fc59f59e700 1 --2- 172.21.15.142:0/1272381524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5a007d7b0 0x7fc5a0138ea0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fc598001000 tx=0x7fc59800f830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.429 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.402+0000 7fc5977fe700 1 -- 172.21.15.142:0/1272381524 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7fc588008450 con 0x7fc5a007d7b0 2020-01-16T05:43:50.429 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.402+0000 7fc5a48b2700 1 -- 172.21.15.142:0/1272381524 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a0149f00 con 0x7fc5a007d7b0 2020-01-16T05:43:50.429 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.406+0000 7fc59f59e700 1 --2- 172.21.15.142:0/1272381524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5a007d7b0 0x7fc5a0138ea0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fc598001000 tx=0x7fc59800f830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.429 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.406+0000 7fc5977fe700 1 -- 172.21.15.142:0/1272381524 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67593 (secure 0 0 0) 0x7fc59800add0 con 0x7fc5a007d7b0 2020-01-16T05:43:50.466 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.466+0000 7fc59f59e700 1 --2- 172.21.15.142:0/1272381524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5a007d7b0 0x7fc5a0138ea0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fc598001000 tx=0x7fc59800f830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.467 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.466+0000 7fc5977fe700 1 -- 172.21.15.142:0/1272381524 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mgrmap(e 2) v1 ==== 23091+0+0 (secure 0 0 0) 0x7fc59800a830 con 0x7fc5a007d7b0 2020-01-16T05:43:50.486 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.486+0000 7fc5a48b2700 1 -- 172.21.15.142:0/1272381524 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c69fca67-66e4-4c31-ab03-1419e2a83e10", "id": 6} v 0) v1 -- 0x7fc5a005e1c0 con 0x7fc5a007d7b0 2020-01-16T05:43:50.493 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.494+0000 7fc59f59e700 1 --2- 172.21.15.142:0/1272381524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5a007d7b0 0x7fc5a0138ea0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fc598001000 tx=0x7fc59800f830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.493 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.494+0000 7fc5977fe700 1 -- 172.21.15.142:0/1272381524 <== mon.1 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c69fca67-66e4-4c31-ab03-1419e2a83e10", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc598015680 con 0x7fc5a007d7b0 2020-01-16T05:43:50.493 INFO:teuthology.orchestra.run.smithi142.stdout:6 2020-01-16T05:43:50.494 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.494+0000 7fc5a48b2700 1 -- 172.21.15.142:0/1272381524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5a007d7b0 msgr2=0x7fc5a0138ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:50.495 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.494+0000 7fc5a48b2700 1 --2- 172.21.15.142:0/1272381524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5a007d7b0 0x7fc5a0138ea0 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fc598001000 tx=0x7fc59800f830).stop 2020-01-16T05:43:50.495 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.494+0000 7fc5a48b2700 1 -- 172.21.15.142:0/1272381524 shutdown_connections 2020-01-16T05:43:50.495 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.494+0000 7fc5a48b2700 1 --2- 172.21.15.142:0/1272381524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5a007d7b0 0x7fc5a0138ea0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:50.495 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.494+0000 7fc5a48b2700 1 --2- 172.21.15.142:0/1272381524 >> v2:172.21.15.84:3300/0 conn(0x7fc5a0148600 0x7fc5a01499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:50.495 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.494+0000 7fc5a48b2700 1 -- 172.21.15.142:0/1272381524 shutdown_connections 2020-01-16T05:43:50.495 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.494+0000 7fc5a48b2700 1 -- 172.21.15.142:0/1272381524 wait complete. 2020-01-16T05:43:50.495 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.494+0000 7fc5a48b2700 1 -- 172.21.15.142:0/1272381524 >> 172.21.15.142:0/1272381524 conn(0x7fc5a005b290 msgr2=0x7fc5a00a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:50.505 INFO:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new c436f64e-aa1f-435b-ac7b-85633e297591 7 2020-01-16T05:43:50.607 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.602+0000 7fb5f759e700 1 Processor -- start 2020-01-16T05:43:50.607 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.602+0000 7fb5f759e700 1 -- start start 2020-01-16T05:43:50.607 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.602+0000 7fb5f759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5f80a9b30 0x7fb5f80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:50.607 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.602+0000 7fb5f759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb5f80a4250 0x7fb5f8066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:50.607 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.602+0000 7fb5f759e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f8066dd0 con 0x7fb5f807ff10 2020-01-16T05:43:50.608 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.602+0000 7fb5f759e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f80a4830 con 0x7fb5f80a4250 2020-01-16T05:43:50.608 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.602+0000 7fb5f759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f807f9d0 con 0x7fb5f80a9b30 2020-01-16T05:43:50.608 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.602+0000 7fb5f6d9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5f80a9b30 0x7fb5f80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:50.608 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.602+0000 7fb5f6d9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5f80a9b30 0x7fb5f80abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:47122/0 (socket says 172.21.15.142:47122) 2020-01-16T05:43:50.608 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.602+0000 7fb5f6d9d700 1 -- 172.21.15.142:0/649520888 learned_addr learned my addr 172.21.15.142:0/649520888 (peer_addr_for_me v2:172.21.15.142:0/0) 2020-01-16T05:43:50.608 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.602+0000 7fb5fcf8b700 1 --2- 172.21.15.142:0/649520888 >> v2:172.21.15.84:3300/0 conn(0x7fb5f80a4250 0x7fb5f8066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:50.608 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f6d9d700 1 -- 172.21.15.142:0/649520888 >> v2:172.21.15.84:3300/0 conn(0x7fb5f80a4250 msgr2=0x7fb5f8066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:50.609 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f6d9d700 1 --2- 172.21.15.142:0/649520888 >> v2:172.21.15.84:3300/0 conn(0x7fb5f80a4250 0x7fb5f8066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:50.609 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f6d9d700 1 -- 172.21.15.142:0/649520888 >> v1:172.21.15.84:6789/0 conn(0x7fb5f807ff10 legacy=0x7fb5f80a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:50.609 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f6d9d700 1 -- 172.21.15.142:0/649520888 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f8150ce0 con 0x7fb5f80a9b30 2020-01-16T05:43:50.609 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f6d9d700 1 --2- 172.21.15.142:0/649520888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5f80a9b30 0x7fb5f80abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb5e8008910 tx=0x7fb5e800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.609 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f6d9d700 1 --2- 172.21.15.142:0/649520888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5f80a9b30 0x7fb5f80abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb5e8008910 tx=0x7fb5e800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.609 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f6d9d700 1 --2- 172.21.15.142:0/649520888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5f80a9b30 0x7fb5f80abdd0 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7fb5e8008910 tx=0x7fb5e800feb0).ready entity=mon.2 client_cookie=adc270faba079755 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:50.609 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f6d9d700 1 --2- 172.21.15.142:0/649520888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5f80a9b30 0x7fb5f80abdd0 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fb5e8008910 tx=0x7fb5e800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.610 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f6d9d700 1 --2- 172.21.15.142:0/649520888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5f80a9b30 0x7fb5f80abdd0 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fb5e8008910 tx=0x7fb5e800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.610 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f5d9b700 1 -- 172.21.15.142:0/649520888 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5e8011720 con 0x7fb5f80a9b30 2020-01-16T05:43:50.610 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f6d9d700 1 --2- 172.21.15.142:0/649520888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5f80a9b30 0x7fb5f80abdd0 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fb5e8008910 tx=0x7fb5e800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.610 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f5d9b700 1 -- 172.21.15.142:0/649520888 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e8008d30 con 0x7fb5f80a9b30 2020-01-16T05:43:50.610 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f5d9b700 1 -- 172.21.15.142:0/649520888 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5e8011d00 con 0x7fb5f80a9b30 2020-01-16T05:43:50.610 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f759e700 1 -- 172.21.15.142:0/649520888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5f80a9b30 msgr2=0x7fb5f80abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:50.610 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f759e700 1 --2- 172.21.15.142:0/649520888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5f80a9b30 0x7fb5f80abdd0 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7fb5e8008910 tx=0x7fb5e800feb0).stop 2020-01-16T05:43:50.610 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f759e700 1 -- 172.21.15.142:0/649520888 shutdown_connections 2020-01-16T05:43:50.611 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f759e700 1 --2- 172.21.15.142:0/649520888 >> v2:172.21.15.84:3300/0 conn(0x7fb5f80a4250 0x7fb5f8066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:50.611 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f759e700 1 --2- 172.21.15.142:0/649520888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5f80a9b30 0x7fb5f80abdd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:50.611 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f759e700 1 -- 172.21.15.142:0/649520888 shutdown_connections 2020-01-16T05:43:50.611 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f759e700 1 -- 172.21.15.142:0/649520888 wait complete. 2020-01-16T05:43:50.611 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f759e700 1 -- 172.21.15.142:0/649520888 >> 172.21.15.142:0/649520888 conn(0x7fb5f80acfc0 msgr2=0x7fb5f80a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:50.614 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f759e700 1 Processor -- start 2020-01-16T05:43:50.614 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f759e700 1 -- start start 2020-01-16T05:43:50.615 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb5f805bef0 0x7fb5f81369f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:50.615 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f759e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f8126020 con 0x7fb5f81329b0 2020-01-16T05:43:50.615 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f759e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f812cd60 con 0x7fb5f8125bf0 2020-01-16T05:43:50.615 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.606+0000 7fb5f759e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f80ab090 con 0x7fb5f805bef0 2020-01-16T05:43:50.615 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5f6d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb5f805bef0 0x7fb5f81369f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:50.615 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5f6d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb5f805bef0 0x7fb5f81369f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36312/0 (socket says 172.21.15.142:36312) 2020-01-16T05:43:50.616 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5f659c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb5f8125bf0 0x7fb5f812c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56476/0 (socket says 172.21.15.142:56476) 2020-01-16T05:43:50.616 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5f6d9d700 1 -- 172.21.15.142:0/2729815889 learned_addr learned my addr 172.21.15.142:0/2729815889 (peer_addr_for_me v2:172.21.15.142:0/0) 2020-01-16T05:43:50.616 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5f6d9d700 1 -- 172.21.15.142:0/2729815889 >> v1:172.21.15.142:6789/0 conn(0x7fb5f8125bf0 legacy=0x7fb5f812c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:50.616 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5e77fe700 1 -- 172.21.15.142:0/2729815889 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704830850 0 0) 0x7fb5f812cd60 con 0x7fb5f8125bf0 2020-01-16T05:43:50.616 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5f6d9d700 1 -- 172.21.15.142:0/2729815889 >> v1:172.21.15.84:6789/0 conn(0x7fb5f81329b0 legacy=0x7fb5f813d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:50.616 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5f6d9d700 1 -- 172.21.15.142:0/2729815889 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f8132de0 con 0x7fb5f805bef0 2020-01-16T05:43:50.616 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5f6d9d700 1 --2- 172.21.15.142:0/2729815889 >> v2:172.21.15.142:3300/0 conn(0x7fb5f805bef0 0x7fb5f81369f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb5e8008910 tx=0x7fb5e800f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.617 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5f6d9d700 1 --2- 172.21.15.142:0/2729815889 >> v2:172.21.15.142:3300/0 conn(0x7fb5f805bef0 0x7fb5f81369f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb5e8008910 tx=0x7fb5e800f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.617 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5f6d9d700 1 --2- 172.21.15.142:0/2729815889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5f805bef0 0x7fb5f81369f0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7fb5e8008910 tx=0x7fb5e800f4b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:50.617 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5f6d9d700 1 --2- 172.21.15.142:0/2729815889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5f805bef0 0x7fb5f81369f0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fb5e8008910 tx=0x7fb5e800f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.617 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5e77fe700 1 -- 172.21.15.142:0/2729815889 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5e8007340 con 0x7fb5f805bef0 2020-01-16T05:43:50.617 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5f6d9d700 1 --2- 172.21.15.142:0/2729815889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5f805bef0 0x7fb5f81369f0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fb5e8008910 tx=0x7fb5e800f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.617 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5f6d9d700 1 --2- 172.21.15.142:0/2729815889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5f805bef0 0x7fb5f81369f0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fb5e8008910 tx=0x7fb5e800f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.617 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5e77fe700 1 -- 172.21.15.142:0/2729815889 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e8011920 con 0x7fb5f805bef0 2020-01-16T05:43:50.618 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5f759e700 1 -- 172.21.15.142:0/2729815889 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f813ebd0 con 0x7fb5f805bef0 2020-01-16T05:43:50.618 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5e77fe700 1 -- 172.21.15.142:0/2729815889 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5e8005aa0 con 0x7fb5f805bef0 2020-01-16T05:43:50.618 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5f759e700 1 -- 172.21.15.142:0/2729815889 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f813f100 con 0x7fb5f805bef0 2020-01-16T05:43:50.618 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5f6d9d700 1 --2- 172.21.15.142:0/2729815889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5f805bef0 0x7fb5f81369f0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fb5e8008910 tx=0x7fb5e800f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.618 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5e77fe700 1 -- 172.21.15.142:0/2729815889 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 2) v1 ==== 23091+0+0 (secure 0 0 0) 0x7fb5e800d400 con 0x7fb5f805bef0 2020-01-16T05:43:50.618 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5f6d9d700 1 --2- 172.21.15.142:0/2729815889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5f805bef0 0x7fb5f81369f0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fb5e8008910 tx=0x7fb5e800f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.618 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5e77fe700 1 -- 172.21.15.142:0/2729815889 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7fb5e802aa70 con 0x7fb5f805bef0 2020-01-16T05:43:50.619 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.610+0000 7fb5f759e700 1 -- 172.21.15.142:0/2729815889 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f805e1c0 con 0x7fb5f805bef0 2020-01-16T05:43:50.619 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.614+0000 7fb5f6d9d700 1 --2- 172.21.15.142:0/2729815889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5f805bef0 0x7fb5f81369f0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fb5e8008910 tx=0x7fb5e800f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.619 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.614+0000 7fb5e77fe700 1 -- 172.21.15.142:0/2729815889 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67593 (secure 0 0 0) 0x7fb5e800cd30 con 0x7fb5f805bef0 2020-01-16T05:43:50.691 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.690+0000 7fb5f759e700 1 -- 172.21.15.142:0/2729815889 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c436f64e-aa1f-435b-ac7b-85633e297591", "id": 7} v 0) v1 -- 0x7fb5f809fce0 con 0x7fb5f805bef0 2020-01-16T05:43:50.699 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.698+0000 7fb5f6d9d700 1 --2- 172.21.15.142:0/2729815889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5f805bef0 0x7fb5f81369f0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fb5e8008910 tx=0x7fb5e800f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:50.699 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.698+0000 7fb5e77fe700 1 -- 172.21.15.142:0/2729815889 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c436f64e-aa1f-435b-ac7b-85633e297591", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb5e80090c0 con 0x7fb5f805bef0 2020-01-16T05:43:50.699 INFO:teuthology.orchestra.run.smithi142.stdout:7 2020-01-16T05:43:50.700 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.698+0000 7fb5f759e700 1 -- 172.21.15.142:0/2729815889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5f805bef0 msgr2=0x7fb5f81369f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:50.700 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.698+0000 7fb5f759e700 1 --2- 172.21.15.142:0/2729815889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5f805bef0 0x7fb5f81369f0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7fb5e8008910 tx=0x7fb5e800f4b0).stop 2020-01-16T05:43:50.701 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.698+0000 7fb5f759e700 1 -- 172.21.15.142:0/2729815889 shutdown_connections 2020-01-16T05:43:50.701 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.698+0000 7fb5f759e700 1 --2- 172.21.15.142:0/2729815889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5f805bef0 0x7fb5f81369f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:50.701 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.698+0000 7fb5f759e700 1 -- 172.21.15.142:0/2729815889 shutdown_connections 2020-01-16T05:43:50.701 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.698+0000 7fb5f759e700 1 -- 172.21.15.142:0/2729815889 wait complete. 2020-01-16T05:43:50.701 INFO:teuthology.orchestra.run.smithi142.stderr:2020-01-16T05:43:50.698+0000 7fb5f759e700 1 -- 172.21.15.142:0/2729815889 >> 172.21.15.142:0/2729815889 conn(0x7fb5f80668f0 msgr2=0x7fb5f807eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:50.712 INFO:tasks.ceph.osd.0:Restarting daemon 2020-01-16T05:43:50.712 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-01-16T05:43:50.715 INFO:tasks.ceph.osd.0:Started 2020-01-16T05:43:50.715 INFO:tasks.ceph.osd.1:Restarting daemon 2020-01-16T05:43:50.715 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-01-16T05:43:50.717 INFO:tasks.ceph.osd.1:Started 2020-01-16T05:43:50.718 INFO:tasks.ceph.osd.2:Restarting daemon 2020-01-16T05:43:50.718 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-01-16T05:43:50.720 INFO:tasks.ceph.osd.2:Started 2020-01-16T05:43:50.720 INFO:tasks.ceph.osd.3:Restarting daemon 2020-01-16T05:43:50.720 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-01-16T05:43:50.722 INFO:tasks.ceph.osd.3:Started 2020-01-16T05:43:50.722 INFO:tasks.ceph.osd.4:Restarting daemon 2020-01-16T05:43:50.722 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-01-16T05:43:50.725 INFO:tasks.ceph.osd.4:Started 2020-01-16T05:43:50.725 INFO:tasks.ceph.osd.5:Restarting daemon 2020-01-16T05:43:50.725 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-01-16T05:43:50.727 INFO:tasks.ceph.osd.5:Started 2020-01-16T05:43:50.728 INFO:tasks.ceph.osd.6:Restarting daemon 2020-01-16T05:43:50.728 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-01-16T05:43:50.730 INFO:tasks.ceph.osd.6:Started 2020-01-16T05:43:50.730 INFO:tasks.ceph.osd.7:Restarting daemon 2020-01-16T05:43:50.730 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-01-16T05:43:50.733 INFO:tasks.ceph.osd.7:Started 2020-01-16T05:43:50.733 INFO:tasks.ceph:Waiting for OSDs to come up 2020-01-16T05:43:51.319 INFO:tasks.ceph.osd.4.smithi142.stderr:2020-01-16T05:43:51.318+0000 7f48404b6d80 -1 Falling back to public interface 2020-01-16T05:43:51.326 INFO:tasks.ceph.osd.5.smithi142.stderr:2020-01-16T05:43:51.326+0000 7f53fe9fed80 -1 Falling back to public interface 2020-01-16T05:43:51.336 INFO:tasks.ceph.osd.1.smithi084.stderr:2020-01-16T05:43:51.335+0000 7f48ba3f3d80 -1 Falling back to public interface 2020-01-16T05:43:51.338 INFO:tasks.ceph.osd.6.smithi142.stderr:2020-01-16T05:43:51.338+0000 7f7a8fe0bd80 -1 Falling back to public interface 2020-01-16T05:43:51.338 INFO:tasks.ceph.osd.7.smithi142.stderr:2020-01-16T05:43:51.338+0000 7f4355203d80 -1 Falling back to public interface 2020-01-16T05:43:51.357 INFO:tasks.ceph.osd.0.smithi084.stderr:2020-01-16T05:43:51.351+0000 7f7d862e9d80 -1 Falling back to public interface 2020-01-16T05:43:51.358 INFO:tasks.ceph.osd.2.smithi084.stderr:2020-01-16T05:43:51.351+0000 7fb369ce9d80 -1 Falling back to public interface 2020-01-16T05:43:51.367 INFO:tasks.ceph.osd.3.smithi084.stderr:2020-01-16T05:43:51.367+0000 7f54301eed80 -1 Falling back to public interface 2020-01-16T05:43:51.542 INFO:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-01-16T05:43:51.643 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f0060ead700 1 Processor -- start 2020-01-16T05:43:51.643 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f0060ead700 1 -- start start 2020-01-16T05:43:51.643 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f0060ead700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f005c0a2f60 0x7f005c05b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:51.643 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f0060ead700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f005c0a8ff0 0x7f005c08fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:51.643 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f0060ead700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f005c0902d0 con 0x7f005c07c560 2020-01-16T05:43:51.644 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f0060ead700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005c0a3390 con 0x7f005c0a2f60 2020-01-16T05:43:51.644 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f0060ead700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005c0905b0 con 0x7f005c0a8ff0 2020-01-16T05:43:51.644 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f005ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f005c0a2f60 0x7f005c05b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:51.644 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f005ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f005c0a2f60 0x7f005c05b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33546/0 (socket says 172.21.15.84:33546) 2020-01-16T05:43:51.644 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f005ad9d700 1 -- 172.21.15.84:0/3445529815 learned_addr learned my addr 172.21.15.84:0/3445529815 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:43:51.645 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f005a59c700 1 --2- 172.21.15.84:0/3445529815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f005c0a8ff0 0x7f005c08fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:51.645 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f005ad9d700 1 -- 172.21.15.84:0/3445529815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f005c0a8ff0 msgr2=0x7f005c08fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:51.645 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f005ad9d700 1 --2- 172.21.15.84:0/3445529815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f005c0a8ff0 0x7f005c08fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:51.645 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f005ad9d700 1 -- 172.21.15.84:0/3445529815 >> v1:172.21.15.142:6789/0 conn(0x7f005c07c560 legacy=0x7f005c149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:51.645 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f005ad9d700 1 -- 172.21.15.84:0/3445529815 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c0a9420 con 0x7f005c0a2f60 2020-01-16T05:43:51.645 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f005a59c700 1 --2- 172.21.15.84:0/3445529815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f005c0a8ff0 0x7f005c08fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:43:51.645 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f005ad9d700 1 --2- 172.21.15.84:0/3445529815 >> v2:172.21.15.84:3300/0 conn(0x7f005c0a2f60 0x7f005c05b0f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f005c090770 tx=0x7f004c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:51.646 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f005ad9d700 1 --2- 172.21.15.84:0/3445529815 >> v2:172.21.15.84:3300/0 conn(0x7f005c0a2f60 0x7f005c05b0f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f005c090770 tx=0x7f004c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:51.646 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f005ad9d700 1 --2- 172.21.15.84:0/3445529815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c0a2f60 0x7f005c05b0f0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f005c090770 tx=0x7f004c00feb0).ready entity=mon.0 client_cookie=fd9d2269b80c06ec server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:51.646 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f005ad9d700 1 --2- 172.21.15.84:0/3445529815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c0a2f60 0x7f005c05b0f0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f005c090770 tx=0x7f004c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:51.651 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f0059d9b700 1 -- 172.21.15.84:0/3445529815 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f004c011720 con 0x7f005c0a2f60 2020-01-16T05:43:51.651 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f005ad9d700 1 --2- 172.21.15.84:0/3445529815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c0a2f60 0x7f005c05b0f0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f005c090770 tx=0x7f004c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:51.652 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f005ad9d700 1 --2- 172.21.15.84:0/3445529815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c0a2f60 0x7f005c05b0f0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f005c090770 tx=0x7f004c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:51.652 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f0059d9b700 1 -- 172.21.15.84:0/3445529815 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c008d30 con 0x7f005c0a2f60 2020-01-16T05:43:51.652 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f0059d9b700 1 -- 172.21.15.84:0/3445529815 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f004c011d00 con 0x7f005c0a2f60 2020-01-16T05:43:51.652 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f0060ead700 1 -- 172.21.15.84:0/3445529815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c0a2f60 msgr2=0x7f005c05b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:51.652 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f0060ead700 1 --2- 172.21.15.84:0/3445529815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c0a2f60 0x7f005c05b0f0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f005c090770 tx=0x7f004c00feb0).stop 2020-01-16T05:43:51.652 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f0060ead700 1 -- 172.21.15.84:0/3445529815 shutdown_connections 2020-01-16T05:43:51.652 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f0060ead700 1 --2- 172.21.15.84:0/3445529815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c0a2f60 0x7f005c05b0f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:51.653 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f0060ead700 1 --2- 172.21.15.84:0/3445529815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f005c0a8ff0 0x7f005c08fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:51.653 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f0060ead700 1 -- 172.21.15.84:0/3445529815 shutdown_connections 2020-01-16T05:43:51.653 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f0060ead700 1 -- 172.21.15.84:0/3445529815 wait complete. 2020-01-16T05:43:51.653 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.639+0000 7f0060ead700 1 -- 172.21.15.84:0/3445529815 >> 172.21.15.84:0/3445529815 conn(0x7f005c0abc10 msgr2=0x7f005c05a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:51.653 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f0060ead700 1 Processor -- start 2020-01-16T05:43:51.653 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f0060ead700 1 -- start start 2020-01-16T05:43:51.653 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f0060ead700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f005c069e80 0x7f005c0792b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:51.654 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f0060ead700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f005c078a30 0x7f005c09bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:51.654 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f0060ead700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f005c09c250 con 0x7f005c09f9d0 2020-01-16T05:43:51.654 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f0060ead700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005c078e60 con 0x7f005c069e80 2020-01-16T05:43:51.654 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f0060ead700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005c079020 con 0x7f005c078a30 2020-01-16T05:43:51.654 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f005ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f005c069e80 0x7f005c0792b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:51.654 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f005ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f005c069e80 0x7f005c0792b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33556/0 (socket says 172.21.15.84:33556) 2020-01-16T05:43:51.655 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f005ad9d700 1 -- 172.21.15.84:0/2090031895 learned_addr learned my addr 172.21.15.84:0/2090031895 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:43:51.655 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f005a59c700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f005c078a30 0x7f005c09bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:51.655 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f005ad9d700 1 -- 172.21.15.84:0/2090031895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f005c078a30 msgr2=0x7f005c09bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:51.655 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f005ad9d700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f005c078a30 0x7f005c09bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:51.655 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f005ad9d700 1 -- 172.21.15.84:0/2090031895 >> v1:172.21.15.142:6789/0 conn(0x7f005c09f9d0 legacy=0x7f005c12be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:51.655 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f005ad9d700 1 -- 172.21.15.84:0/2090031895 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c09fe00 con 0x7f005c069e80 2020-01-16T05:43:51.656 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f005a59c700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f005c078a30 0x7f005c09bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-01-16T05:43:51.656 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f005ad9d700 1 --2- 172.21.15.84:0/2090031895 >> v2:172.21.15.84:3300/0 conn(0x7f005c069e80 0x7f005c0792b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f005c090770 tx=0x7f004c0117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:51.656 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f005ad9d700 1 --2- 172.21.15.84:0/2090031895 >> v2:172.21.15.84:3300/0 conn(0x7f005c069e80 0x7f005c0792b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f005c090770 tx=0x7f004c0117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:51.656 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f005ad9d700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c069e80 0x7f005c0792b0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f005c090770 tx=0x7f004c0117e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:51.656 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f005ad9d700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c069e80 0x7f005c0792b0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f005c090770 tx=0x7f004c0117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:51.656 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f005ad9d700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c069e80 0x7f005c0792b0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f005c090770 tx=0x7f004c0117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:51.656 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f004b7fe700 1 -- 172.21.15.84:0/2090031895 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f004c00f780 con 0x7f005c069e80 2020-01-16T05:43:51.656 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f005ad9d700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c069e80 0x7f005c0792b0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f005c090770 tx=0x7f004c0117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:51.657 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f004b7fe700 1 -- 172.21.15.84:0/2090031895 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c011920 con 0x7f005c069e80 2020-01-16T05:43:51.657 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f004b7fe700 1 -- 172.21.15.84:0/2090031895 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f004c0056c0 con 0x7f005c069e80 2020-01-16T05:43:51.657 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f0060ead700 1 -- 172.21.15.84:0/2090031895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005c0a0070 con 0x7f005c069e80 2020-01-16T05:43:51.657 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f0060ead700 1 -- 172.21.15.84:0/2090031895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005c12c600 con 0x7f005c069e80 2020-01-16T05:43:51.657 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f005ad9d700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c069e80 0x7f005c0792b0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f005c090770 tx=0x7f004c0117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:51.658 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f004b7fe700 1 -- 172.21.15.84:0/2090031895 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 3) v1 ==== 46317+0+0 (secure 0 0 0) 0x7f004c0059d0 con 0x7f005c069e80 2020-01-16T05:43:51.658 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f005ad9d700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c069e80 0x7f005c0792b0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f005c090770 tx=0x7f004c0117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:51.658 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.643+0000 7f0060ead700 1 -- 172.21.15.84:0/2090031895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005c05e1c0 con 0x7f005c069e80 2020-01-16T05:43:51.658 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.647+0000 7f004b7fe700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f004003c210 0x7f004003e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:51.659 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.647+0000 7f004b7fe700 1 -- 172.21.15.84:0/2090031895 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f004c04ce70 con 0x7f005c069e80 2020-01-16T05:43:51.659 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.647+0000 7f005a59c700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f004003c210 0x7f004003e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:51.659 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.647+0000 7f005a59c700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f004003c210 0x7f004003e720 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:51.659 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.651+0000 7f005ad9d700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c069e80 0x7f005c0792b0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f005c090770 tx=0x7f004c0117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:51.659 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.651+0000 7f004b7fe700 1 -- 172.21.15.84:0/2090031895 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f004c0334e0 con 0x7f005c069e80 2020-01-16T05:43:51.782 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.771+0000 7f0060ead700 1 -- 172.21.15.84:0/2090031895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f005c08f350 con 0x7f005c069e80 2020-01-16T05:43:51.782 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.771+0000 7f005ad9d700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c069e80 0x7f005c0792b0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f005c090770 tx=0x7f004c0117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:51.782 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.771+0000 7f004b7fe700 1 -- 172.21.15.84:0/2090031895 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6849 (secure 0 0 0) 0x7f004c005ce0 con 0x7f005c069e80 2020-01-16T05:43:51.782 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.771+0000 7f0060ead700 1 -- 172.21.15.84:0/2090031895 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f004003c210 msgr2=0x7f004003e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:51.783 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.771+0000 7f0060ead700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f004003c210 0x7f004003e720 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:51.783 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.771+0000 7f0060ead700 1 -- 172.21.15.84:0/2090031895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c069e80 msgr2=0x7f005c0792b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:51.783 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.771+0000 7f0060ead700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c069e80 0x7f005c0792b0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f005c090770 tx=0x7f004c0117e0).stop 2020-01-16T05:43:51.784 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.771+0000 7f0060ead700 1 -- 172.21.15.84:0/2090031895 shutdown_connections 2020-01-16T05:43:51.784 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.771+0000 7f0060ead700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f004003c210 0x7f004003e720 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:51.784 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.771+0000 7f0060ead700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c069e80 0x7f005c0792b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:51.784 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.771+0000 7f0060ead700 1 --2- 172.21.15.84:0/2090031895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f005c078a30 0x7f005c09bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:51.784 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.771+0000 7f0060ead700 1 -- 172.21.15.84:0/2090031895 shutdown_connections 2020-01-16T05:43:51.784 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.771+0000 7f0060ead700 1 -- 172.21.15.84:0/2090031895 wait complete. 2020-01-16T05:43:51.784 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:51.771+0000 7f0060ead700 1 -- 172.21.15.84:0/2090031895 >> 172.21.15.84:0/2090031895 conn(0x7f005c0a9760 msgr2=0x7f005c0a5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:51.785 INFO:teuthology.misc.health.smithi084.stdout: 2020-01-16T05:43:51.785 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":10,"fsid":"cbc67508-4d2a-4483-a1fc-95d371063ac4","created":"2020-01-16T05:43:46.771497+0000","modified":"2020-01-16T05:43:50.694423+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"15da60bb-4d16-44cc-80c6-cd2c7fa77364","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0800533c-1d5b-4f9f-99bb-34b8133c8b18","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"519cc27f-5cf9-4ecf-ad66-f722c37339df","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"aec305a6-bbac-4e01-8ea1-6077d49e27e2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"aaec7f3e-299a-4546-8406-207bcc4b3afd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5a942a47-7346-46d4-adf8-dad2bdb95aec","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c69fca67-66e4-4c31-ab03-1419e2a83e10","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c436f64e-aa1f-435b-ac7b-85633e297591","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-16T05:43:51.787 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-01-16T05:43:52.262 INFO:tasks.ceph.osd.6.smithi142.stderr:2020-01-16T05:43:52.262+0000 7f7a8fe0bd80 -1 osd.6 0 log_to_monitors {default=true} 2020-01-16T05:43:52.291 INFO:tasks.ceph.osd.3.smithi084.stderr:2020-01-16T05:43:52.287+0000 7f54301eed80 -1 osd.3 0 log_to_monitors {default=true} 2020-01-16T05:43:52.459 INFO:tasks.ceph.osd.4.smithi142.stderr:2020-01-16T05:43:52.458+0000 7f48404b6d80 -1 osd.4 0 log_to_monitors {default=true} 2020-01-16T05:43:52.510 INFO:tasks.ceph.osd.1.smithi084.stderr:2020-01-16T05:43:52.507+0000 7f48ba3f3d80 -1 osd.1 0 log_to_monitors {default=true} 2020-01-16T05:43:52.510 INFO:tasks.ceph.osd.2.smithi084.stderr:2020-01-16T05:43:52.507+0000 7fb369ce9d80 -1 osd.2 0 log_to_monitors {default=true} 2020-01-16T05:43:52.517 INFO:tasks.ceph.osd.0.smithi084.stderr:2020-01-16T05:43:52.515+0000 7f7d862e9d80 -1 osd.0 0 log_to_monitors {default=true} 2020-01-16T05:43:52.529 INFO:tasks.ceph.osd.7.smithi142.stderr:2020-01-16T05:43:52.530+0000 7f4355203d80 -1 osd.7 0 log_to_monitors {default=true} 2020-01-16T05:43:52.536 INFO:tasks.ceph.osd.5.smithi142.stderr:2020-01-16T05:43:52.534+0000 7f53fe9fed80 -1 osd.5 0 log_to_monitors {default=true} 2020-01-16T05:43:53.524 INFO:tasks.ceph.osd.3.smithi084.stderr:2020-01-16T05:43:53.523+0000 7f541943a700 -1 osd.3 0 waiting for initial osdmap 2020-01-16T05:43:53.534 INFO:tasks.ceph.osd.4.smithi142.stderr:2020-01-16T05:43:53.530+0000 7f4829702700 -1 osd.4 0 waiting for initial osdmap 2020-01-16T05:43:53.534 INFO:tasks.ceph.osd.6.smithi142.stderr:2020-01-16T05:43:53.530+0000 7f7a79057700 -1 osd.6 0 waiting for initial osdmap 2020-01-16T05:43:54.530 INFO:tasks.ceph.osd.1.smithi084.stderr:2020-01-16T05:43:54.527+0000 7f48a363f700 -1 osd.1 0 waiting for initial osdmap 2020-01-16T05:43:54.531 INFO:tasks.ceph.osd.7.smithi142.stderr:2020-01-16T05:43:54.526+0000 7f433e44f700 -1 osd.7 0 waiting for initial osdmap 2020-01-16T05:43:54.531 INFO:tasks.ceph.osd.5.smithi142.stderr:2020-01-16T05:43:54.530+0000 7f53e7c4a700 -1 osd.5 0 waiting for initial osdmap 2020-01-16T05:43:54.532 INFO:tasks.ceph.osd.0.smithi084.stderr:2020-01-16T05:43:54.531+0000 7f7d6f535700 -1 osd.0 0 waiting for initial osdmap 2020-01-16T05:43:54.532 INFO:tasks.ceph.osd.2.smithi084.stderr:2020-01-16T05:43:54.531+0000 7fb352f35700 -1 osd.2 0 waiting for initial osdmap 2020-01-16T05:43:58.593 INFO:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-01-16T05:43:58.708 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.695+0000 7fbe60dcf700 1 Processor -- start 2020-01-16T05:43:58.709 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.695+0000 7fbe60dcf700 1 -- start start 2020-01-16T05:43:58.709 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.695+0000 7fbe60dcf700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbe5c05b0f0 0x7fbe5c0a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:58.709 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.695+0000 7fbe60dcf700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c08fd80 0x7fbe5c1503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:58.709 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.695+0000 7fbe60dcf700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c07cd60 con 0x7fbe5c0a2f60 2020-01-16T05:43:58.709 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.695+0000 7fbe60dcf700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5c0a3390 con 0x7fbe5c05b0f0 2020-01-16T05:43:58.711 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.695+0000 7fbe60dcf700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c0905b0 con 0x7fbe5c08fd80 2020-01-16T05:43:58.711 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.695+0000 7fbe5a59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbe5c05b0f0 0x7fbe5c0a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:58.711 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.695+0000 7fbe5a59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbe5c05b0f0 0x7fbe5c0a8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.84:43770/0 (socket says 172.21.15.84:43770) 2020-01-16T05:43:58.712 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.695+0000 7fbe5a59c700 1 -- 172.21.15.84:0/1886884199 learned_addr learned my addr 172.21.15.84:0/1886884199 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:43:58.712 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.695+0000 7fbe5b59e700 1 --2- 172.21.15.84:0/1886884199 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c08fd80 0x7fbe5c1503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:58.712 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.695+0000 7fbe5a59c700 1 -- 172.21.15.84:0/1886884199 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c08fd80 msgr2=0x7fbe5c1503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:58.712 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.695+0000 7fbe5a59c700 1 --2- 172.21.15.84:0/1886884199 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c08fd80 0x7fbe5c1503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:58.712 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.695+0000 7fbe5a59c700 1 -- 172.21.15.84:0/1886884199 >> v1:172.21.15.142:6789/0 conn(0x7fbe5c0a2f60 legacy=0x7fbe5c07c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:58.712 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.695+0000 7fbe5a59c700 1 -- 172.21.15.84:0/1886884199 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c05b520 con 0x7fbe5c05b0f0 2020-01-16T05:43:58.712 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.695+0000 7fbe5a59c700 1 --2- 172.21.15.84:0/1886884199 >> v2:172.21.15.142:3300/0 conn(0x7fbe5c05b0f0 0x7fbe5c0a8ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbe5c090770 tx=0x7fbe4400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.713 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.695+0000 7fbe5a59c700 1 --2- 172.21.15.84:0/1886884199 >> v2:172.21.15.142:3300/0 conn(0x7fbe5c05b0f0 0x7fbe5c0a8ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbe5c090770 tx=0x7fbe4400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.713 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.695+0000 7fbe5a59c700 1 --2- 172.21.15.84:0/1886884199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe5c05b0f0 0x7fbe5c0a8ff0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fbe5c090770 tx=0x7fbe4400feb0).ready entity=mon.1 client_cookie=f94ba16743787045 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:58.713 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.699+0000 7fbe5a59c700 1 --2- 172.21.15.84:0/1886884199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe5c05b0f0 0x7fbe5c0a8ff0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fbe5c090770 tx=0x7fbe4400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.713 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.699+0000 7fbe59d9b700 1 -- 172.21.15.84:0/1886884199 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe44011720 con 0x7fbe5c05b0f0 2020-01-16T05:43:58.713 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.699+0000 7fbe5a59c700 1 --2- 172.21.15.84:0/1886884199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe5c05b0f0 0x7fbe5c0a8ff0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fbe5c090770 tx=0x7fbe4400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.713 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.699+0000 7fbe5a59c700 1 --2- 172.21.15.84:0/1886884199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe5c05b0f0 0x7fbe5c0a8ff0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fbe5c090770 tx=0x7fbe4400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.713 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.699+0000 7fbe59d9b700 1 -- 172.21.15.84:0/1886884199 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe44008d30 con 0x7fbe5c05b0f0 2020-01-16T05:43:58.714 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.699+0000 7fbe59d9b700 1 -- 172.21.15.84:0/1886884199 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe44011d00 con 0x7fbe5c05b0f0 2020-01-16T05:43:58.714 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.699+0000 7fbe60dcf700 1 -- 172.21.15.84:0/1886884199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe5c05b0f0 msgr2=0x7fbe5c0a8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:58.714 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.699+0000 7fbe60dcf700 1 --2- 172.21.15.84:0/1886884199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe5c05b0f0 0x7fbe5c0a8ff0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fbe5c090770 tx=0x7fbe4400feb0).stop 2020-01-16T05:43:58.714 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.699+0000 7fbe60dcf700 1 -- 172.21.15.84:0/1886884199 shutdown_connections 2020-01-16T05:43:58.714 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.699+0000 7fbe60dcf700 1 --2- 172.21.15.84:0/1886884199 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c08fd80 0x7fbe5c1503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:58.714 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.699+0000 7fbe60dcf700 1 --2- 172.21.15.84:0/1886884199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe5c05b0f0 0x7fbe5c0a8ff0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:58.714 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.699+0000 7fbe60dcf700 1 -- 172.21.15.84:0/1886884199 shutdown_connections 2020-01-16T05:43:58.714 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.699+0000 7fbe60dcf700 1 -- 172.21.15.84:0/1886884199 wait complete. 2020-01-16T05:43:58.715 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.699+0000 7fbe60dcf700 1 -- 172.21.15.84:0/1886884199 >> 172.21.15.84:0/1886884199 conn(0x7fbe5c0abc10 msgr2=0x7fbe5c05a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:58.715 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.699+0000 7fbe60dcf700 1 Processor -- start 2020-01-16T05:43:58.715 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.699+0000 7fbe60dcf700 1 -- start start 2020-01-16T05:43:58.715 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe60dcf700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c12f680 0x7fbe5c13b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:58.715 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe60dcf700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c099720 con 0x7fbe5c130370 2020-01-16T05:43:58.716 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe60dcf700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c12fab0 con 0x7fbe5c132f80 2020-01-16T05:43:58.716 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe60dcf700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c07fd40 con 0x7fbe5c12f680 2020-01-16T05:43:58.716 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe5ad9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbe5c130370 0x7fbe5c07bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50990/0 (socket says 172.21.15.84:50990) 2020-01-16T05:43:58.716 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe5ad9d700 1 -- 172.21.15.84:0/4001398190 learned_addr learned my addr 172.21.15.84:0/4001398190 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:43:58.716 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe5b59e700 1 --2- 172.21.15.84:0/4001398190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c12f680 0x7fbe5c13b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:58.716 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe537fe700 1 -- 172.21.15.84:0/4001398190 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699535050 0 0) 0x7fbe5c099720 con 0x7fbe5c130370 2020-01-16T05:43:58.716 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe537fe700 1 -- 172.21.15.84:0/4001398190 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe40003230 con 0x7fbe5c130370 2020-01-16T05:43:58.716 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe537fe700 1 -- 172.21.15.84:0/4001398190 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319674426 0 0) 0x7fbe5c12fab0 con 0x7fbe5c132f80 2020-01-16T05:43:58.717 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe537fe700 1 -- 172.21.15.84:0/4001398190 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe5c099720 con 0x7fbe5c132f80 2020-01-16T05:43:58.717 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe537fe700 1 -- 172.21.15.84:0/4001398190 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2432772453 0 0) 0x7fbe40003230 con 0x7fbe5c130370 2020-01-16T05:43:58.717 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe5b59e700 1 -- 172.21.15.84:0/4001398190 >> v1:172.21.15.142:6789/0 conn(0x7fbe5c132f80 legacy=0x7fbe5c07cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:58.717 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe5b59e700 1 -- 172.21.15.84:0/4001398190 >> v1:172.21.15.84:6789/0 conn(0x7fbe5c130370 legacy=0x7fbe5c07bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:58.717 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe5b59e700 1 -- 172.21.15.84:0/4001398190 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c1338e0 con 0x7fbe5c12f680 2020-01-16T05:43:58.717 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe5b59e700 1 --2- 172.21.15.84:0/4001398190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c12f680 0x7fbe5c13b0a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbe4c001830 tx=0x7fbe4c001c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.717 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe5b59e700 1 --2- 172.21.15.84:0/4001398190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c12f680 0x7fbe5c13b0a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbe4c001830 tx=0x7fbe4c001c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.718 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe5b59e700 1 --2- 172.21.15.84:0/4001398190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c12f680 0x7fbe5c13b0a0 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7fbe4c001830 tx=0x7fbe4c001c60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:58.718 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe5b59e700 1 --2- 172.21.15.84:0/4001398190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c12f680 0x7fbe5c13b0a0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fbe4c001830 tx=0x7fbe4c001c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.718 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe537fe700 1 -- 172.21.15.84:0/4001398190 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe4c001a60 con 0x7fbe5c12f680 2020-01-16T05:43:58.718 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe5b59e700 1 --2- 172.21.15.84:0/4001398190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c12f680 0x7fbe5c13b0a0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fbe4c001830 tx=0x7fbe4c001c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.718 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe5b59e700 1 --2- 172.21.15.84:0/4001398190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c12f680 0x7fbe5c13b0a0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fbe4c001830 tx=0x7fbe4c001c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.718 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe537fe700 1 -- 172.21.15.84:0/4001398190 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4c001870 con 0x7fbe5c12f680 2020-01-16T05:43:58.718 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe60dcf700 1 -- 172.21.15.84:0/4001398190 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5c13b5f0 con 0x7fbe5c12f680 2020-01-16T05:43:58.718 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe537fe700 1 -- 172.21.15.84:0/4001398190 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe5400ecc0 con 0x7fbe5c12f680 2020-01-16T05:43:58.719 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.703+0000 7fbe60dcf700 1 -- 172.21.15.84:0/4001398190 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c13bb40 con 0x7fbe5c12f680 2020-01-16T05:43:58.719 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.707+0000 7fbe5b59e700 1 --2- 172.21.15.84:0/4001398190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c12f680 0x7fbe5c13b0a0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fbe4c001830 tx=0x7fbe4c001c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.719 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.707+0000 7fbe537fe700 1 -- 172.21.15.84:0/4001398190 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fbe54010140 con 0x7fbe5c12f680 2020-01-16T05:43:58.719 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.707+0000 7fbe5b59e700 1 --2- 172.21.15.84:0/4001398190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c12f680 0x7fbe5c13b0a0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fbe4c001830 tx=0x7fbe4c001c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.719 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.707+0000 7fbe60dcf700 1 -- 172.21.15.84:0/4001398190 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5c05e1c0 con 0x7fbe5c12f680 2020-01-16T05:43:58.719 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.707+0000 7fbe537fe700 1 --2- 172.21.15.84:0/4001398190 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fbe4003c9d0 0x7fbe4003eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:58.719 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.707+0000 7fbe537fe700 1 -- 172.21.15.84:0/4001398190 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4500+0+0 (secure 0 0 0) 0x7fbe5404c800 con 0x7fbe5c12f680 2020-01-16T05:43:58.720 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.707+0000 7fbe5ad9d700 1 --2- 172.21.15.84:0/4001398190 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fbe4003c9d0 0x7fbe4003eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:58.720 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.707+0000 7fbe5ad9d700 1 --2- 172.21.15.84:0/4001398190 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fbe4003c9d0 0x7fbe4003eee0 crc :-1 s=READY pgs=29 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:58.720 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.715+0000 7fbe5b59e700 1 --2- 172.21.15.84:0/4001398190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c12f680 0x7fbe5c13b0a0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fbe4c001830 tx=0x7fbe4c001c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.720 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.715+0000 7fbe537fe700 1 -- 172.21.15.84:0/4001398190 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fbe54033060 con 0x7fbe5c12f680 2020-01-16T05:43:58.839 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.839+0000 7fbe60dcf700 1 -- 172.21.15.84:0/4001398190 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe5c08f350 con 0x7fbe5c12f680 2020-01-16T05:43:58.841 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.839+0000 7fbe5b59e700 1 --2- 172.21.15.84:0/4001398190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c12f680 0x7fbe5c13b0a0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fbe4c001830 tx=0x7fbe4c001c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.842 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.839+0000 7fbe537fe700 1 -- 172.21.15.84:0/4001398190 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+10439 (secure 0 0 0) 0x7fbe54005d60 con 0x7fbe5c12f680 2020-01-16T05:43:58.842 INFO:teuthology.misc.health.smithi084.stdout: 2020-01-16T05:43:58.842 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":16,"fsid":"cbc67508-4d2a-4483-a1fc-95d371063ac4","created":"2020-01-16T05:43:46.771497+0000","modified":"2020-01-16T05:43:57.551102+0000","last_up_change":"2020-01-16T05:43:55.529492+0000","last_in_change":"2020-01-16T05:43:55.529492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"15da60bb-4d16-44cc-80c6-cd2c7fa77364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":12644},{"type":"v1","addr":"172.21.15.84:6812","nonce":12644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":12644},{"type":"v1","addr":"172.21.15.84:6816","nonce":12644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":12644},{"type":"v1","addr":"172.21.15.84:6824","nonce":12644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":12644},{"type":"v1","addr":"172.21.15.84:6820","nonce":12644}]},"public_addr":"172.21.15.84:6812/12644","cluster_addr":"172.21.15.84:6816/12644","heartbeat_back_addr":"172.21.15.84:6824/12644","heartbeat_front_addr":"172.21.15.84:6820/12644","state":["exists","up"]},{"osd":1,"uuid":"0800533c-1d5b-4f9f-99bb-34b8133c8b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":12645},{"type":"v1","addr":"172.21.15.84:6803","nonce":12645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":12645},{"type":"v1","addr":"172.21.15.84:6805","nonce":12645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":12645},{"type":"v1","addr":"172.21.15.84:6809","nonce":12645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":12645},{"type":"v1","addr":"172.21.15.84:6807","nonce":12645}]},"public_addr":"172.21.15.84:6803/12645","cluster_addr":"172.21.15.84:6805/12645","heartbeat_back_addr":"172.21.15.84:6809/12645","heartbeat_front_addr":"172.21.15.84:6807/12645","state":["exists","up"]},{"osd":2,"uuid":"519cc27f-5cf9-4ecf-ad66-f722c37339df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":12646},{"type":"v1","addr":"172.21.15.84:6813","nonce":12646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6815","nonce":12646},{"type":"v1","addr":"172.21.15.84:6817","nonce":12646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":12646},{"type":"v1","addr":"172.21.15.84:6825","nonce":12646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":12646},{"type":"v1","addr":"172.21.15.84:6821","nonce":12646}]},"public_addr":"172.21.15.84:6813/12646","cluster_addr":"172.21.15.84:6817/12646","heartbeat_back_addr":"172.21.15.84:6825/12646","heartbeat_front_addr":"172.21.15.84:6821/12646","state":["exists","up"]},{"osd":3,"uuid":"aec305a6-bbac-4e01-8ea1-6077d49e27e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":12647},{"type":"v1","addr":"172.21.15.84:6827","nonce":12647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":12647},{"type":"v1","addr":"172.21.15.84:6829","nonce":12647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":12647},{"type":"v1","addr":"172.21.15.84:6833","nonce":12647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":12647},{"type":"v1","addr":"172.21.15.84:6831","nonce":12647}]},"public_addr":"172.21.15.84:6827/12647","cluster_addr":"172.21.15.84:6829/12647","heartbeat_back_addr":"172.21.15.84:6833/12647","heartbeat_front_addr":"172.21.15.84:6831/12647","state":["exists","up"]},{"osd":4,"uuid":"aaec7f3e-299a-4546-8406-207bcc4b3afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":12842},{"type":"v1","addr":"172.21.15.142:6801","nonce":12842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12842},{"type":"v1","addr":"172.21.15.142:6803","nonce":12842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12842},{"type":"v1","addr":"172.21.15.142:6807","nonce":12842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12842},{"type":"v1","addr":"172.21.15.142:6805","nonce":12842}]},"public_addr":"172.21.15.142:6801/12842","cluster_addr":"172.21.15.142:6803/12842","heartbeat_back_addr":"172.21.15.142:6807/12842","heartbeat_front_addr":"172.21.15.142:6805/12842","state":["exists","up"]},{"osd":5,"uuid":"5a942a47-7346-46d4-adf8-dad2bdb95aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12843},{"type":"v1","addr":"172.21.15.142:6809","nonce":12843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12843},{"type":"v1","addr":"172.21.15.142:6811","nonce":12843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12843},{"type":"v1","addr":"172.21.15.142:6815","nonce":12843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12843},{"type":"v1","addr":"172.21.15.142:6813","nonce":12843}]},"public_addr":"172.21.15.142:6809/12843","cluster_addr":"172.21.15.142:6811/12843","heartbeat_back_addr":"172.21.15.142:6815/12843","heartbeat_front_addr":"172.21.15.142:6813/12843","state":["exists","up"]},{"osd":6,"uuid":"c69fca67-66e4-4c31-ab03-1419e2a83e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12844},{"type":"v1","addr":"172.21.15.142:6818","nonce":12844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":12844},{"type":"v1","addr":"172.21.15.142:6823","nonce":12844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":12844},{"type":"v1","addr":"172.21.15.142:6831","nonce":12844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":12844},{"type":"v1","addr":"172.21.15.142:6827","nonce":12844}]},"public_addr":"172.21.15.142:6818/12844","cluster_addr":"172.21.15.142:6823/12844","heartbeat_back_addr":"172.21.15.142:6831/12844","heartbeat_front_addr":"172.21.15.142:6827/12844","state":["exists","up"]},{"osd":7,"uuid":"c436f64e-aa1f-435b-ac7b-85633e297591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":12845},{"type":"v1","addr":"172.21.15.142:6819","nonce":12845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12845},{"type":"v1","addr":"172.21.15.142:6822","nonce":12845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12845},{"type":"v1","addr":"172.21.15.142:6830","nonce":12845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12845},{"type":"v1","addr":"172.21.15.142:6826","nonce":12845}]},"public_addr":"172.21.15.142:6819/12845","cluster_addr":"172.21.15.142:6822/12845","heartbeat_back_addr":"172.21.15.142:6830/12845","heartbeat_front_addr":"172.21.15.142:6826/12845","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.534744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.505453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.485516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.333028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.483323+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.567824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.273268+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.559741+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-16T05:43:58.844 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.839+0000 7fbe60dcf700 1 -- 172.21.15.84:0/4001398190 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fbe4003c9d0 msgr2=0x7fbe4003eee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:58.844 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.839+0000 7fbe60dcf700 1 --2- 172.21.15.84:0/4001398190 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fbe4003c9d0 0x7fbe4003eee0 crc :-1 s=READY pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:58.844 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.839+0000 7fbe60dcf700 1 -- 172.21.15.84:0/4001398190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c12f680 msgr2=0x7fbe5c13b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:58.845 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.839+0000 7fbe60dcf700 1 --2- 172.21.15.84:0/4001398190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c12f680 0x7fbe5c13b0a0 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7fbe4c001830 tx=0x7fbe4c001c60).stop 2020-01-16T05:43:58.845 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.843+0000 7fbe60dcf700 1 -- 172.21.15.84:0/4001398190 shutdown_connections 2020-01-16T05:43:58.845 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.843+0000 7fbe60dcf700 1 --2- 172.21.15.84:0/4001398190 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fbe4003c9d0 0x7fbe4003eee0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:58.845 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.843+0000 7fbe60dcf700 1 --2- 172.21.15.84:0/4001398190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe5c12f680 0x7fbe5c13b0a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:58.845 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.843+0000 7fbe60dcf700 1 -- 172.21.15.84:0/4001398190 shutdown_connections 2020-01-16T05:43:58.846 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.843+0000 7fbe60dcf700 1 -- 172.21.15.84:0/4001398190 wait complete. 2020-01-16T05:43:58.846 INFO:teuthology.misc.health.smithi084.stderr:2020-01-16T05:43:58.843+0000 7fbe60dcf700 1 -- 172.21.15.84:0/4001398190 >> 172.21.15.84:0/4001398190 conn(0x7fbe5c0abc10 msgr2=0x7fbe5c08fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:58.854 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-01-16T05:43:58.854 INFO:tasks.ceph:Creating RBD pool 2020-01-16T05:43:58.855 INFO:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd pool create rbd 8 2020-01-16T05:43:58.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.979+0000 7fa08aac9700 1 Processor -- start 2020-01-16T05:43:58.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa08aac9700 1 -- start start 2020-01-16T05:43:58.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa08aac9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa0840a2f60 0x7fa08405b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:58.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa08aac9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0840a8ff0 0x7fa08408fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:58.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa08aac9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0840902d0 con 0x7fa08407c560 2020-01-16T05:43:58.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa08aac9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0840a3390 con 0x7fa0840a2f60 2020-01-16T05:43:58.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa08aac9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0840905b0 con 0x7fa0840a8ff0 2020-01-16T05:43:58.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa089066700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa0840a2f60 0x7fa08405b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:58.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa089066700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa0840a2f60 0x7fa08405b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33798/0 (socket says 172.21.15.84:33798) 2020-01-16T05:43:58.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa089066700 1 -- 172.21.15.84:0/2644170536 learned_addr learned my addr 172.21.15.84:0/2644170536 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:43:58.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa088865700 1 --2- 172.21.15.84:0/2644170536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0840a8ff0 0x7fa08408fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:58.990 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa089066700 1 -- 172.21.15.84:0/2644170536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0840a8ff0 msgr2=0x7fa08408fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:58.990 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa089066700 1 --2- 172.21.15.84:0/2644170536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0840a8ff0 0x7fa08408fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:58.990 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa089066700 1 -- 172.21.15.84:0/2644170536 >> v1:172.21.15.142:6789/0 conn(0x7fa08407c560 legacy=0x7fa084149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:58.990 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa089066700 1 -- 172.21.15.84:0/2644170536 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0840a9420 con 0x7fa0840a2f60 2020-01-16T05:43:58.990 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa089066700 1 --2- 172.21.15.84:0/2644170536 >> v2:172.21.15.84:3300/0 conn(0x7fa0840a2f60 0x7fa08405b0f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa084090770 tx=0x7fa080010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.990 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa089066700 1 --2- 172.21.15.84:0/2644170536 >> v2:172.21.15.84:3300/0 conn(0x7fa0840a2f60 0x7fa08405b0f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa084090770 tx=0x7fa080010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa089066700 1 --2- 172.21.15.84:0/2644170536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0840a2f60 0x7fa08405b0f0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7fa084090770 tx=0x7fa080010230).ready entity=mon.0 client_cookie=7f42fb4f0ff81e44 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:58.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa089066700 1 --2- 172.21.15.84:0/2644170536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0840a2f60 0x7fa08405b0f0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fa084090770 tx=0x7fa080010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa07bfff700 1 -- 172.21.15.84:0/2644170536 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa08000a160 con 0x7fa0840a2f60 2020-01-16T05:43:58.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa089066700 1 --2- 172.21.15.84:0/2644170536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0840a2f60 0x7fa08405b0f0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fa084090770 tx=0x7fa080010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa07bfff700 1 -- 172.21.15.84:0/2644170536 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa080011bb0 con 0x7fa0840a2f60 2020-01-16T05:43:58.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa089066700 1 --2- 172.21.15.84:0/2644170536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0840a2f60 0x7fa08405b0f0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fa084090770 tx=0x7fa080010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:58.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa07bfff700 1 -- 172.21.15.84:0/2644170536 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa08000a740 con 0x7fa0840a2f60 2020-01-16T05:43:58.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa08aac9700 1 -- 172.21.15.84:0/2644170536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0840a2f60 msgr2=0x7fa08405b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:58.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa08aac9700 1 --2- 172.21.15.84:0/2644170536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0840a2f60 0x7fa08405b0f0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7fa084090770 tx=0x7fa080010230).stop 2020-01-16T05:43:58.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa08aac9700 1 -- 172.21.15.84:0/2644170536 shutdown_connections 2020-01-16T05:43:58.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa08aac9700 1 --2- 172.21.15.84:0/2644170536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0840a2f60 0x7fa08405b0f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:58.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa08aac9700 1 --2- 172.21.15.84:0/2644170536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0840a8ff0 0x7fa08408fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:58.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa08aac9700 1 -- 172.21.15.84:0/2644170536 shutdown_connections 2020-01-16T05:43:58.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa08aac9700 1 -- 172.21.15.84:0/2644170536 wait complete. 2020-01-16T05:43:58.993 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.983+0000 7fa08aac9700 1 -- 172.21.15.84:0/2644170536 >> 172.21.15.84:0/2644170536 conn(0x7fa0840abc10 msgr2=0x7fa08405a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:58.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa08aac9700 1 Processor -- start 2020-01-16T05:43:58.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa08aac9700 1 -- start start 2020-01-16T05:43:58.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa08aac9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0840a6340 0x7fa0840a6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:58.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa08aac9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa084138b20 0x7fa084138f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:58.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa08aac9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0840a6cc0 con 0x7fa08409e0d0 2020-01-16T05:43:58.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa08aac9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08407b360 con 0x7fa084138b20 2020-01-16T05:43:58.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa08aac9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa084066bc0 con 0x7fa0840a6340 2020-01-16T05:43:58.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa089066700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa08409e0d0 0x7fa08407ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51004/0 (socket says 172.21.15.84:51004) 2020-01-16T05:43:58.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa089066700 1 -- 172.21.15.84:0/3277227002 learned_addr learned my addr 172.21.15.84:0/3277227002 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:43:58.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa089867700 1 --2- 172.21.15.84:0/3277227002 >> v2:172.21.15.142:3300/0 conn(0x7fa084138b20 0x7fa084138f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:58.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa088865700 1 --2- 172.21.15.84:0/3277227002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0840a6340 0x7fa0840a6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:58.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa079ffb700 1 -- 172.21.15.84:0/3277227002 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833408361 0 0) 0x7fa0840a6cc0 con 0x7fa08409e0d0 2020-01-16T05:43:58.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa079ffb700 1 -- 172.21.15.84:0/3277227002 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa064003230 con 0x7fa08409e0d0 2020-01-16T05:43:58.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa079ffb700 1 -- 172.21.15.84:0/3277227002 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 616366322 0 0) 0x7fa064003230 con 0x7fa08409e0d0 2020-01-16T05:43:58.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa079ffb700 1 -- 172.21.15.84:0/3277227002 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa0840a6cc0 con 0x7fa08409e0d0 2020-01-16T05:43:58.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa079ffb700 1 -- 172.21.15.84:0/3277227002 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7fa08000a160 con 0x7fa08409e0d0 2020-01-16T05:43:58.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa089867700 1 -- 172.21.15.84:0/3277227002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0840a6340 msgr2=0x7fa0840a6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:58.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa089867700 1 --2- 172.21.15.84:0/3277227002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0840a6340 0x7fa0840a6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:58.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa089867700 1 -- 172.21.15.84:0/3277227002 >> v1:172.21.15.84:6789/0 conn(0x7fa08409e0d0 legacy=0x7fa08407ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:59.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa089867700 1 -- 172.21.15.84:0/3277227002 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0840a6fc0 con 0x7fa084138b20 2020-01-16T05:43:59.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.987+0000 7fa089867700 1 --2- 172.21.15.84:0/3277227002 >> v2:172.21.15.142:3300/0 conn(0x7fa084138b20 0x7fa084138f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa07c000e90 tx=0x7fa0800087d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.991+0000 7fa089867700 1 --2- 172.21.15.84:0/3277227002 >> v2:172.21.15.142:3300/0 conn(0x7fa084138b20 0x7fa084138f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa07c000e90 tx=0x7fa0800087d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.991+0000 7fa089867700 1 --2- 172.21.15.84:0/3277227002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa084138b20 0x7fa084138f50 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7fa07c000e90 tx=0x7fa0800087d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:59.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.991+0000 7fa089867700 1 --2- 172.21.15.84:0/3277227002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa084138b20 0x7fa084138f50 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fa07c000e90 tx=0x7fa0800087d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.991+0000 7fa079ffb700 1 -- 172.21.15.84:0/3277227002 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa07c0069b0 con 0x7fa084138b20 2020-01-16T05:43:59.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.991+0000 7fa089867700 1 --2- 172.21.15.84:0/3277227002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa084138b20 0x7fa084138f50 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fa07c000e90 tx=0x7fa0800087d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.991+0000 7fa089867700 1 --2- 172.21.15.84:0/3277227002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa084138b20 0x7fa084138f50 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fa07c000e90 tx=0x7fa0800087d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.991+0000 7fa079ffb700 1 -- 172.21.15.84:0/3277227002 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c0065d0 con 0x7fa084138b20 2020-01-16T05:43:59.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.991+0000 7fa079ffb700 1 -- 172.21.15.84:0/3277227002 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa07c010f10 con 0x7fa084138b20 2020-01-16T05:43:59.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.991+0000 7fa08aac9700 1 -- 172.21.15.84:0/3277227002 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa084079a10 con 0x7fa084138b20 2020-01-16T05:43:59.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.991+0000 7fa08aac9700 1 -- 172.21.15.84:0/3277227002 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa084139640 con 0x7fa084138b20 2020-01-16T05:43:59.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.991+0000 7fa089867700 1 --2- 172.21.15.84:0/3277227002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa084138b20 0x7fa084138f50 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fa07c000e90 tx=0x7fa0800087d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.991+0000 7fa08aac9700 1 -- 172.21.15.84:0/3277227002 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08405e1c0 con 0x7fa084138b20 2020-01-16T05:43:59.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.991+0000 7fa079ffb700 1 -- 172.21.15.84:0/3277227002 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fa07c011270 con 0x7fa084138b20 2020-01-16T05:43:59.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.991+0000 7fa089867700 1 --2- 172.21.15.84:0/3277227002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa084138b20 0x7fa084138f50 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fa07c000e90 tx=0x7fa0800087d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.991+0000 7fa079ffb700 1 --2- 172.21.15.84:0/3277227002 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa06403cbd0 0x7fa06403f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:59.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.991+0000 7fa079ffb700 1 -- 172.21.15.84:0/3277227002 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4500+0+0 (secure 0 0 0) 0x7fa0840902d0 con 0x7fa084138b20 2020-01-16T05:43:59.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.991+0000 7fa089066700 1 --2- 172.21.15.84:0/3277227002 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa06403cbd0 0x7fa06403f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:59.003 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.991+0000 7fa089066700 1 --2- 172.21.15.84:0/3277227002 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa06403cbd0 0x7fa06403f0e0 crc :-1 s=READY pgs=30 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:59.003 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.999+0000 7fa089867700 1 --2- 172.21.15.84:0/3277227002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa084138b20 0x7fa084138f50 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fa07c000e90 tx=0x7fa0800087d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.003 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:58.999+0000 7fa079ffb700 1 -- 172.21.15.84:0/3277227002 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fa07c032b40 con 0x7fa084138b20 2020-01-16T05:43:59.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.119+0000 7fa08aac9700 1 -- 172.21.15.84:0/3277227002 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fa08408f350 con 0x7fa084138b20 2020-01-16T05:43:59.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.583+0000 7fa089867700 1 --2- 172.21.15.84:0/3277227002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa084138b20 0x7fa084138f50 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fa07c000e90 tx=0x7fa0800087d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.583+0000 7fa079ffb700 1 -- 172.21.15.84:0/3277227002 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7fa07c032da0 con 0x7fa084138b20 2020-01-16T05:43:59.590 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.587+0000 7fa08aac9700 1 -- 172.21.15.84:0/3277227002 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa06403cbd0 msgr2=0x7fa06403f0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:59.590 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.587+0000 7fa08aac9700 1 --2- 172.21.15.84:0/3277227002 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa06403cbd0 0x7fa06403f0e0 crc :-1 s=READY pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:59.590 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.587+0000 7fa08aac9700 1 -- 172.21.15.84:0/3277227002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa084138b20 msgr2=0x7fa084138f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:59.590 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.587+0000 7fa08aac9700 1 --2- 172.21.15.84:0/3277227002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa084138b20 0x7fa084138f50 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7fa07c000e90 tx=0x7fa0800087d0).stop 2020-01-16T05:43:59.590 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.587+0000 7fa08aac9700 1 -- 172.21.15.84:0/3277227002 shutdown_connections 2020-01-16T05:43:59.591 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.587+0000 7fa08aac9700 1 --2- 172.21.15.84:0/3277227002 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa06403cbd0 0x7fa06403f0e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:59.591 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.587+0000 7fa08aac9700 1 --2- 172.21.15.84:0/3277227002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa084138b20 0x7fa084138f50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:59.591 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.587+0000 7fa08aac9700 1 --2- 172.21.15.84:0/3277227002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0840a6340 0x7fa0840a6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:59.591 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.587+0000 7fa08aac9700 1 -- 172.21.15.84:0/3277227002 shutdown_connections 2020-01-16T05:43:59.591 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.587+0000 7fa08aac9700 1 -- 172.21.15.84:0/3277227002 wait complete. 2020-01-16T05:43:59.591 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.587+0000 7fa08aac9700 1 -- 172.21.15.84:0/3277227002 >> 172.21.15.84:0/3277227002 conn(0x7fa0840a9760 msgr2=0x7fa0840a3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:59.592 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'rbd' created 2020-01-16T05:43:59.603 INFO:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-01-16T05:43:59.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d1bf1700 1 Processor -- start 2020-01-16T05:43:59.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d1bf1700 1 -- start start 2020-01-16T05:43:59.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d1bf1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc9cc0abe80 0x7fc9cc0a8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:59.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d1bf1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9cc0246e0 0x7fc9cc024b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:43:59.721 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d1bf1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9cc0aa5b0 con 0x7fc9cc05e3f0 2020-01-16T05:43:59.721 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d1bf1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9cc0aa8c0 con 0x7fc9cc0abe80 2020-01-16T05:43:59.721 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d1bf1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc0aab60 con 0x7fc9cc0246e0 2020-01-16T05:43:59.721 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d13f0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc9cc0abe80 0x7fc9cc0a8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:59.721 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d2e53700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc9cc05e3f0 0x7fc9cc05e820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51016/0 (socket says 172.21.15.84:51016) 2020-01-16T05:43:59.721 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d13f0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc9cc0abe80 0x7fc9cc0a8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33812/0 (socket says 172.21.15.84:33812) 2020-01-16T05:43:59.722 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d2e53700 1 -- 172.21.15.84:0/2476563389 learned_addr learned my addr 172.21.15.84:0/2476563389 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:43:59.722 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d0bef700 1 --2- 172.21.15.84:0/2476563389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9cc0246e0 0x7fc9cc024b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:59.722 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d13f0700 1 -- 172.21.15.84:0/2476563389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9cc0246e0 msgr2=0x7fc9cc024b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:43:59.722 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d13f0700 1 --2- 172.21.15.84:0/2476563389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9cc0246e0 0x7fc9cc024b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:59.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d13f0700 1 -- 172.21.15.84:0/2476563389 >> v1:172.21.15.84:6789/0 conn(0x7fc9cc05e3f0 legacy=0x7fc9cc05e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:59.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9cbfff700 1 -- 172.21.15.84:0/2476563389 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307059956 0 0) 0x7fc9cc0aa5b0 con 0x7fc9cc05e3f0 2020-01-16T05:43:59.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d13f0700 1 -- 172.21.15.84:0/2476563389 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc0ab0a0 con 0x7fc9cc0abe80 2020-01-16T05:43:59.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d0bef700 1 --2- 172.21.15.84:0/2476563389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9cc0246e0 0x7fc9cc024b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:43:59.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d13f0700 1 --2- 172.21.15.84:0/2476563389 >> v2:172.21.15.84:3300/0 conn(0x7fc9cc0abe80 0x7fc9cc0a8f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc9cc0ab960 tx=0x7fc9bc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d13f0700 1 --2- 172.21.15.84:0/2476563389 >> v2:172.21.15.84:3300/0 conn(0x7fc9cc0abe80 0x7fc9cc0a8f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc9cc0ab960 tx=0x7fc9bc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d13f0700 1 --2- 172.21.15.84:0/2476563389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc0abe80 0x7fc9cc0a8f40 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fc9cc0ab960 tx=0x7fc9bc010170).ready entity=mon.0 client_cookie=71171b1a038ddfc3 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:59.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d13f0700 1 --2- 172.21.15.84:0/2476563389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc0abe80 0x7fc9cc0a8f40 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fc9cc0ab960 tx=0x7fc9bc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9cbfff700 1 -- 172.21.15.84:0/2476563389 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9bc00a160 con 0x7fc9cc0abe80 2020-01-16T05:43:59.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d13f0700 1 --2- 172.21.15.84:0/2476563389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc0abe80 0x7fc9cc0a8f40 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fc9cc0ab960 tx=0x7fc9bc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9cbfff700 1 -- 172.21.15.84:0/2476563389 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9bc011af0 con 0x7fc9cc0abe80 2020-01-16T05:43:59.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d13f0700 1 --2- 172.21.15.84:0/2476563389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc0abe80 0x7fc9cc0a8f40 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fc9cc0ab960 tx=0x7fc9bc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9cbfff700 1 -- 172.21.15.84:0/2476563389 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9bc00a740 con 0x7fc9cc0abe80 2020-01-16T05:43:59.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d1bf1700 1 -- 172.21.15.84:0/2476563389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc0abe80 msgr2=0x7fc9cc0a8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:59.725 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.715+0000 7fc9d1bf1700 1 --2- 172.21.15.84:0/2476563389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc0abe80 0x7fc9cc0a8f40 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fc9cc0ab960 tx=0x7fc9bc010170).stop 2020-01-16T05:43:59.725 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.719+0000 7fc9d1bf1700 1 -- 172.21.15.84:0/2476563389 shutdown_connections 2020-01-16T05:43:59.725 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.719+0000 7fc9d1bf1700 1 --2- 172.21.15.84:0/2476563389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc0abe80 0x7fc9cc0a8f40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:59.725 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.719+0000 7fc9d1bf1700 1 --2- 172.21.15.84:0/2476563389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9cc0246e0 0x7fc9cc024b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:43:59.725 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.719+0000 7fc9d1bf1700 1 -- 172.21.15.84:0/2476563389 shutdown_connections 2020-01-16T05:43:59.725 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.719+0000 7fc9d1bf1700 1 -- 172.21.15.84:0/2476563389 wait complete. 2020-01-16T05:43:59.726 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.719+0000 7fc9d1bf1700 1 -- 172.21.15.84:0/2476563389 >> 172.21.15.84:0/2476563389 conn(0x7fc9cc05fa20 msgr2=0x7fc9cc05fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:43:59.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.719+0000 7fc9d1bf1700 1 Processor -- start 2020-01-16T05:43:59.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.719+0000 7fc9d1bf1700 1 -- start start 2020-01-16T05:43:59.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.719+0000 7fc9d1bf1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc9cc0a5920 0x7fc9cc0a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:59.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.719+0000 7fc9d1bf1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9cc07e910 0x7fc9cc07ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:59.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.719+0000 7fc9d1bf1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9cc0a22e0 con 0x7fc9cc121710 2020-01-16T05:43:59.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.719+0000 7fc9d1bf1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9cc120f30 con 0x7fc9cc0a5920 2020-01-16T05:43:59.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.719+0000 7fc9d1bf1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc1211d0 con 0x7fc9cc07e910 2020-01-16T05:43:59.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.719+0000 7fc9d13f0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc9cc0a5920 0x7fc9cc0a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:59.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.719+0000 7fc9d13f0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc9cc0a5920 0x7fc9cc0a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33818/0 (socket says 172.21.15.84:33818) 2020-01-16T05:43:59.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.719+0000 7fc9d13f0700 1 -- 172.21.15.84:0/4135441879 learned_addr learned my addr 172.21.15.84:0/4135441879 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:43:59.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9d2e53700 1 --2- 172.21.15.84:0/4135441879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9cc07e910 0x7fc9cc07ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:59.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9d13f0700 1 -- 172.21.15.84:0/4135441879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9cc07e910 msgr2=0x7fc9cc07ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:59.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9d13f0700 1 --2- 172.21.15.84:0/4135441879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9cc07e910 0x7fc9cc07ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:43:59.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9d13f0700 1 -- 172.21.15.84:0/4135441879 >> v1:172.21.15.142:6789/0 conn(0x7fc9cc121710 legacy=0x7fc9cc121b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:43:59.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9d13f0700 1 -- 172.21.15.84:0/4135441879 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc07f290 con 0x7fc9cc0a5920 2020-01-16T05:43:59.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9d13f0700 1 --2- 172.21.15.84:0/4135441879 >> v2:172.21.15.84:3300/0 conn(0x7fc9cc0a5920 0x7fc9cc0a1d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9cc1210f0 tx=0x7fc9bc007f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9d13f0700 1 --2- 172.21.15.84:0/4135441879 >> v2:172.21.15.84:3300/0 conn(0x7fc9cc0a5920 0x7fc9cc0a1d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9cc1210f0 tx=0x7fc9bc007f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9d13f0700 1 --2- 172.21.15.84:0/4135441879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc0a5920 0x7fc9cc0a1d90 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7fc9cc1210f0 tx=0x7fc9bc007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:59.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9d13f0700 1 --2- 172.21.15.84:0/4135441879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc0a5920 0x7fc9cc0a1d90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7fc9cc1210f0 tx=0x7fc9bc007f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9d13f0700 1 --2- 172.21.15.84:0/4135441879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc0a5920 0x7fc9cc0a1d90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7fc9cc1210f0 tx=0x7fc9bc007f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9c9ffb700 1 -- 172.21.15.84:0/4135441879 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9bc005a40 con 0x7fc9cc0a5920 2020-01-16T05:43:59.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9d13f0700 1 --2- 172.21.15.84:0/4135441879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc0a5920 0x7fc9cc0a1d90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7fc9cc1210f0 tx=0x7fc9bc007f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9c9ffb700 1 -- 172.21.15.84:0/4135441879 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9bc00a360 con 0x7fc9cc0a5920 2020-01-16T05:43:59.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9d1bf1700 1 -- 172.21.15.84:0/4135441879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9cc07f500 con 0x7fc9cc0a5920 2020-01-16T05:43:59.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9c9ffb700 1 -- 172.21.15.84:0/4135441879 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9bc007340 con 0x7fc9cc0a5920 2020-01-16T05:43:59.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9d1bf1700 1 -- 172.21.15.84:0/4135441879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9cc13f540 con 0x7fc9cc0a5920 2020-01-16T05:43:59.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9d1bf1700 1 -- 172.21.15.84:0/4135441879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9cc05e1c0 con 0x7fc9cc0a5920 2020-01-16T05:43:59.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9d13f0700 1 --2- 172.21.15.84:0/4135441879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc0a5920 0x7fc9cc0a1d90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7fc9cc1210f0 tx=0x7fc9bc007f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9c9ffb700 1 -- 172.21.15.84:0/4135441879 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fc9bc007540 con 0x7fc9cc0a5920 2020-01-16T05:43:59.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9d13f0700 1 --2- 172.21.15.84:0/4135441879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc0a5920 0x7fc9cc0a1d90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7fc9cc1210f0 tx=0x7fc9bc007f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9c9ffb700 1 --2- 172.21.15.84:0/4135441879 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc9ac03c3c0 0x7fc9ac03e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:43:59.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9c9ffb700 1 -- 172.21.15.84:0/4135441879 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4842+0+0 (secure 0 0 0) 0x7fc9bc04d780 con 0x7fc9cc0a5920 2020-01-16T05:43:59.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9d0bef700 1 --2- 172.21.15.84:0/4135441879 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc9ac03c3c0 0x7fc9ac03e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:43:59.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.723+0000 7fc9d0bef700 1 --2- 172.21.15.84:0/4135441879 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc9ac03c3c0 0x7fc9ac03e8d0 crc :-1 s=READY pgs=31 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:43:59.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.735+0000 7fc9d13f0700 1 --2- 172.21.15.84:0/4135441879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc0a5920 0x7fc9cc0a1d90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7fc9cc1210f0 tx=0x7fc9bc007f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:43:59.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.735+0000 7fc9c9ffb700 1 -- 172.21.15.84:0/4135441879 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fc9bc033da0 con 0x7fc9cc0a5920 2020-01-16T05:43:59.853 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:43:59.851+0000 7fc9d1bf1700 1 -- 172.21.15.84:0/4135441879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc9cc120d10 con 0x7fc9cc0a5920 2020-01-16T05:44:00.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.587+0000 7fc9d13f0700 1 --2- 172.21.15.84:0/4135441879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc0a5920 0x7fc9cc0a1d90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7fc9cc1210f0 tx=0x7fc9bc007f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.587+0000 7fc9c9ffb700 1 -- 172.21.15.84:0/4135441879 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc9bc034000 con 0x7fc9cc0a5920 2020-01-16T05:44:00.592 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.591+0000 7fc9d1bf1700 1 -- 172.21.15.84:0/4135441879 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc9ac03c3c0 msgr2=0x7fc9ac03e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:00.592 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.591+0000 7fc9d1bf1700 1 --2- 172.21.15.84:0/4135441879 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc9ac03c3c0 0x7fc9ac03e8d0 crc :-1 s=READY pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.591+0000 7fc9d1bf1700 1 -- 172.21.15.84:0/4135441879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc0a5920 msgr2=0x7fc9cc0a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.591+0000 7fc9d1bf1700 1 --2- 172.21.15.84:0/4135441879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc0a5920 0x7fc9cc0a1d90 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7fc9cc1210f0 tx=0x7fc9bc007f90).stop 2020-01-16T05:44:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.591+0000 7fc9d1bf1700 1 -- 172.21.15.84:0/4135441879 shutdown_connections 2020-01-16T05:44:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.591+0000 7fc9d1bf1700 1 --2- 172.21.15.84:0/4135441879 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc9ac03c3c0 0x7fc9ac03e8d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.591+0000 7fc9d1bf1700 1 --2- 172.21.15.84:0/4135441879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9cc07e910 0x7fc9cc07ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.591+0000 7fc9d1bf1700 1 --2- 172.21.15.84:0/4135441879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc0a5920 0x7fc9cc0a1d90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:00.594 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.591+0000 7fc9d1bf1700 1 -- 172.21.15.84:0/4135441879 shutdown_connections 2020-01-16T05:44:00.594 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.591+0000 7fc9d1bf1700 1 -- 172.21.15.84:0/4135441879 wait complete. 2020-01-16T05:44:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.591+0000 7fc9d1bf1700 1 -- 172.21.15.84:0/4135441879 >> 172.21.15.84:0/4135441879 conn(0x7fc9cc0a7220 msgr2=0x7fc9cc127870 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:enabled application 'rbd' on pool 'rbd' 2020-01-16T05:44:00.608 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-01-16T05:44:00.608 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-16T05:44:00.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f0522451700 1 Processor -- start 2020-01-16T05:44:00.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f0522451700 1 -- start start 2020-01-16T05:44:00.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f0522451700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f051c07ff10 0x7f051c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:00.721 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f0522451700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f051c0a4250 0x7f051c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:00.721 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f0522451700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f051c066dd0 con 0x7f051c0a9b30 2020-01-16T05:44:00.722 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f0522451700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f051c0a4830 con 0x7f051c0a4250 2020-01-16T05:44:00.722 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f0522451700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f051c07f9d0 con 0x7f051c07ff10 2020-01-16T05:44:00.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f05236b3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f051c0a4250 0x7f051c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:00.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f05236b3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f051c0a4250 0x7f051c066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33826/0 (socket says 172.21.15.84:33826) 2020-01-16T05:44:00.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f05236b3700 1 -- 172.21.15.84:0/4291397335 learned_addr learned my addr 172.21.15.84:0/4291397335 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:00.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f052144f700 1 --2- 172.21.15.84:0/4291397335 >> v2:172.21.15.142:3300/0 conn(0x7f051c07ff10 0x7f051c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:00.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f05236b3700 1 -- 172.21.15.84:0/4291397335 >> v2:172.21.15.142:3300/0 conn(0x7f051c07ff10 msgr2=0x7f051c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:00.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f05236b3700 1 --2- 172.21.15.84:0/4291397335 >> v2:172.21.15.142:3300/0 conn(0x7f051c07ff10 0x7f051c0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:00.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f05236b3700 1 -- 172.21.15.84:0/4291397335 >> v1:172.21.15.142:6789/0 conn(0x7f051c0a9b30 legacy=0x7f051c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:00.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f05236b3700 1 -- 172.21.15.84:0/4291397335 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051c150ce0 con 0x7f051c0a4250 2020-01-16T05:44:00.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f05236b3700 1 --2- 172.21.15.84:0/4291397335 >> v2:172.21.15.84:3300/0 conn(0x7f051c0a4250 0x7f051c066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f051c0a49f0 tx=0x7f0514010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.725 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f05236b3700 1 --2- 172.21.15.84:0/4291397335 >> v2:172.21.15.84:3300/0 conn(0x7f051c0a4250 0x7f051c066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f051c0a49f0 tx=0x7f0514010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.725 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f05236b3700 1 --2- 172.21.15.84:0/4291397335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f051c0a4250 0x7f051c066880 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f051c0a49f0 tx=0x7f0514010230).ready entity=mon.0 client_cookie=e93cf1411b15c12b server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:00.725 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f05236b3700 1 --2- 172.21.15.84:0/4291397335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f051c0a4250 0x7f051c066880 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f051c0a49f0 tx=0x7f0514010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.725 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f0520c4e700 1 -- 172.21.15.84:0/4291397335 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f051400a160 con 0x7f051c0a4250 2020-01-16T05:44:00.726 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f05236b3700 1 --2- 172.21.15.84:0/4291397335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f051c0a4250 0x7f051c066880 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f051c0a49f0 tx=0x7f0514010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.726 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f05236b3700 1 --2- 172.21.15.84:0/4291397335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f051c0a4250 0x7f051c066880 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f051c0a49f0 tx=0x7f0514010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.726 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f0520c4e700 1 -- 172.21.15.84:0/4291397335 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0514011b70 con 0x7f051c0a4250 2020-01-16T05:44:00.726 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f0520c4e700 1 -- 172.21.15.84:0/4291397335 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f051400a740 con 0x7f051c0a4250 2020-01-16T05:44:00.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f0522451700 1 -- 172.21.15.84:0/4291397335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f051c0a4250 msgr2=0x7f051c066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:00.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.715+0000 7f0522451700 1 --2- 172.21.15.84:0/4291397335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f051c0a4250 0x7f051c066880 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f051c0a49f0 tx=0x7f0514010230).stop 2020-01-16T05:44:00.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f0522451700 1 -- 172.21.15.84:0/4291397335 shutdown_connections 2020-01-16T05:44:00.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f0522451700 1 --2- 172.21.15.84:0/4291397335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f051c0a4250 0x7f051c066880 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:00.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f0522451700 1 --2- 172.21.15.84:0/4291397335 >> v2:172.21.15.142:3300/0 conn(0x7f051c07ff10 0x7f051c0abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:00.728 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f0522451700 1 -- 172.21.15.84:0/4291397335 shutdown_connections 2020-01-16T05:44:00.728 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f0522451700 1 -- 172.21.15.84:0/4291397335 wait complete. 2020-01-16T05:44:00.728 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f0522451700 1 -- 172.21.15.84:0/4291397335 >> 172.21.15.84:0/4291397335 conn(0x7f051c0acfc0 msgr2=0x7f051c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:00.728 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f0522451700 1 Processor -- start 2020-01-16T05:44:00.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f0522451700 1 -- start start 2020-01-16T05:44:00.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f0522451700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f051c0a86a0 0x7f051c0a8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:00.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f0522451700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f051c141730 0x7f051c143b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:00.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f0522451700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f051c0a3530 con 0x7f051c0251f0 2020-01-16T05:44:00.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f0522451700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f051c0a7100 con 0x7f051c0a86a0 2020-01-16T05:44:00.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f0522451700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f051c0a73a0 con 0x7f051c141730 2020-01-16T05:44:00.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f052144f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f051c0a86a0 0x7f051c0a8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:00.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f0521c50700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f051c0251f0 0x7f051c135d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51030/0 (socket says 172.21.15.84:51030) 2020-01-16T05:44:00.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f0521c50700 1 -- 172.21.15.84:0/3581838232 learned_addr learned my addr 172.21.15.84:0/3581838232 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:00.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f05236b3700 1 --2- 172.21.15.84:0/3581838232 >> v2:172.21.15.142:3300/0 conn(0x7f051c141730 0x7f051c143b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:00.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f052144f700 1 -- 172.21.15.84:0/3581838232 >> v2:172.21.15.142:3300/0 conn(0x7f051c141730 msgr2=0x7f051c143b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:00.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f052144f700 1 --2- 172.21.15.84:0/3581838232 >> v2:172.21.15.142:3300/0 conn(0x7f051c141730 0x7f051c143b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:00.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f052144f700 1 -- 172.21.15.84:0/3581838232 >> v1:172.21.15.84:6789/0 conn(0x7f051c0251f0 legacy=0x7f051c135d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:00.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f052144f700 1 -- 172.21.15.84:0/3581838232 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051c07c490 con 0x7f051c0a86a0 2020-01-16T05:44:00.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f052144f700 1 --2- 172.21.15.84:0/3581838232 >> v2:172.21.15.84:3300/0 conn(0x7f051c0a86a0 0x7f051c0a8ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f051c0a5810 tx=0x7f050c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f052144f700 1 --2- 172.21.15.84:0/3581838232 >> v2:172.21.15.84:3300/0 conn(0x7f051c0a86a0 0x7f051c0a8ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f051c0a5810 tx=0x7f050c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f052144f700 1 --2- 172.21.15.84:0/3581838232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f051c0a86a0 0x7f051c0a8ad0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f051c0a5810 tx=0x7f050c010cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:00.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f052144f700 1 --2- 172.21.15.84:0/3581838232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f051c0a86a0 0x7f051c0a8ad0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f051c0a5810 tx=0x7f050c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f05127fc700 1 -- 172.21.15.84:0/3581838232 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f050c0129e0 con 0x7f051c0a86a0 2020-01-16T05:44:00.739 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f052144f700 1 --2- 172.21.15.84:0/3581838232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f051c0a86a0 0x7f051c0a8ad0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f051c0a5810 tx=0x7f050c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.739 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f052144f700 1 --2- 172.21.15.84:0/3581838232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f051c0a86a0 0x7f051c0a8ad0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f051c0a5810 tx=0x7f050c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.739 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f05127fc700 1 -- 172.21.15.84:0/3581838232 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050c012600 con 0x7f051c0a86a0 2020-01-16T05:44:00.739 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f0522451700 1 -- 172.21.15.84:0/3581838232 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f051c0a9020 con 0x7f051c0a86a0 2020-01-16T05:44:00.739 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f05127fc700 1 -- 172.21.15.84:0/3581838232 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f050c00e640 con 0x7f051c0a86a0 2020-01-16T05:44:00.740 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.719+0000 7f0522451700 1 -- 172.21.15.84:0/3581838232 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051c136520 con 0x7f051c0a86a0 2020-01-16T05:44:00.740 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.723+0000 7f052144f700 1 --2- 172.21.15.84:0/3581838232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f051c0a86a0 0x7f051c0a8ad0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f051c0a5810 tx=0x7f050c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.740 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.723+0000 7f0522451700 1 -- 172.21.15.84:0/3581838232 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051c05e1c0 con 0x7f051c0a86a0 2020-01-16T05:44:00.740 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.723+0000 7f05127fc700 1 -- 172.21.15.84:0/3581838232 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f050c007170 con 0x7f051c0a86a0 2020-01-16T05:44:00.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.723+0000 7f052144f700 1 --2- 172.21.15.84:0/3581838232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f051c0a86a0 0x7f051c0a8ad0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f051c0a5810 tx=0x7f050c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.723+0000 7f05127fc700 1 --2- 172.21.15.84:0/3581838232 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f050403c300 0x7f050403e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:00.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.723+0000 7f05127fc700 1 -- 172.21.15.84:0/3581838232 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f050c04cf40 con 0x7f051c0a86a0 2020-01-16T05:44:00.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.723+0000 7f0521c50700 1 --2- 172.21.15.84:0/3581838232 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f050403c300 0x7f050403e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.723+0000 7f0521c50700 1 --2- 172.21.15.84:0/3581838232 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f050403c300 0x7f050403e810 crc :-1 s=READY pgs=32 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.731+0000 7f052144f700 1 --2- 172.21.15.84:0/3581838232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f051c0a86a0 0x7f051c0a8ad0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f051c0a5810 tx=0x7f050c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.731+0000 7f05127fc700 1 -- 172.21.15.84:0/3581838232 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f050c00d0b0 con 0x7f051c0a86a0 2020-01-16T05:44:00.849 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.847+0000 7f0522451700 1 -- 172.21.15.84:0/3581838232 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f051c0a50b0 con 0x7f051c0a86a0 2020-01-16T05:44:00.850 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.847+0000 7f052144f700 1 --2- 172.21.15.84:0/3581838232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f051c0a86a0 0x7f051c0a8ad0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f051c0a5810 tx=0x7f050c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.850 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.847+0000 7f05127fc700 1 -- 172.21.15.84:0/3581838232 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11826 (secure 0 0 0) 0x7f050c033500 con 0x7f051c0a86a0 2020-01-16T05:44:00.850 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:00.851 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"fsid":"cbc67508-4d2a-4483-a1fc-95d371063ac4","created":"2020-01-16T05:43:46.771497+0000","modified":"2020-01-16T05:44:00.582034+0000","last_up_change":"2020-01-16T05:43:55.529492+0000","last_in_change":"2020-01-16T05:43:55.529492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-16T05:43:59.152708+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"15da60bb-4d16-44cc-80c6-cd2c7fa77364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":12644},{"type":"v1","addr":"172.21.15.84:6812","nonce":12644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":12644},{"type":"v1","addr":"172.21.15.84:6816","nonce":12644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":12644},{"type":"v1","addr":"172.21.15.84:6824","nonce":12644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":12644},{"type":"v1","addr":"172.21.15.84:6820","nonce":12644}]},"public_addr":"172.21.15.84:6812/12644","cluster_addr":"172.21.15.84:6816/12644","heartbeat_back_addr":"172.21.15.84:6824/12644","heartbeat_front_addr":"172.21.15.84:6820/12644","state":["exists","up"]},{"osd":1,"uuid":"0800533c-1d5b-4f9f-99bb-34b8133c8b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":12645},{"type":"v1","addr":"172.21.15.84:6803","nonce":12645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":12645},{"type":"v1","addr":"172.21.15.84:6805","nonce":12645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":12645},{"type":"v1","addr":"172.21.15.84:6809","nonce":12645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":12645},{"type":"v1","addr":"172.21.15.84:6807","nonce":12645}]},"public_addr":"172.21.15.84:6803/12645","cluster_addr":"172.21.15.84:6805/12645","heartbeat_back_addr":"172.21.15.84:6809/12645","heartbeat_front_addr":"172.21.15.84:6807/12645","state":["exists","up"]},{"osd":2,"uuid":"519cc27f-5cf9-4ecf-ad66-f722c37339df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":12646},{"type":"v1","addr":"172.21.15.84:6813","nonce":12646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6815","nonce":12646},{"type":"v1","addr":"172.21.15.84:6817","nonce":12646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":12646},{"type":"v1","addr":"172.21.15.84:6825","nonce":12646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":12646},{"type":"v1","addr":"172.21.15.84:6821","nonce":12646}]},"public_addr":"172.21.15.84:6813/12646","cluster_addr":"172.21.15.84:6817/12646","heartbeat_back_addr":"172.21.15.84:6825/12646","heartbeat_front_addr":"172.21.15.84:6821/12646","state":["exists","up"]},{"osd":3,"uuid":"aec305a6-bbac-4e01-8ea1-6077d49e27e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":12647},{"type":"v1","addr":"172.21.15.84:6827","nonce":12647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":12647},{"type":"v1","addr":"172.21.15.84:6829","nonce":12647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":12647},{"type":"v1","addr":"172.21.15.84:6833","nonce":12647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":12647},{"type":"v1","addr":"172.21.15.84:6831","nonce":12647}]},"public_addr":"172.21.15.84:6827/12647","cluster_addr":"172.21.15.84:6829/12647","heartbeat_back_addr":"172.21.15.84:6833/12647","heartbeat_front_addr":"172.21.15.84:6831/12647","state":["exists","up"]},{"osd":4,"uuid":"aaec7f3e-299a-4546-8406-207bcc4b3afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":12842},{"type":"v1","addr":"172.21.15.142:6801","nonce":12842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12842},{"type":"v1","addr":"172.21.15.142:6803","nonce":12842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12842},{"type":"v1","addr":"172.21.15.142:6807","nonce":12842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12842},{"type":"v1","addr":"172.21.15.142:6805","nonce":12842}]},"public_addr":"172.21.15.142:6801/12842","cluster_addr":"172.21.15.142:6803/12842","heartbeat_back_addr":"172.21.15.142:6807/12842","heartbeat_front_addr":"172.21.15.142:6805/12842","state":["exists","up"]},{"osd":5,"uuid":"5a942a47-7346-46d4-adf8-dad2bdb95aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12843},{"type":"v1","addr":"172.21.15.142:6809","nonce":12843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12843},{"type":"v1","addr":"172.21.15.142:6811","nonce":12843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12843},{"type":"v1","addr":"172.21.15.142:6815","nonce":12843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12843},{"type":"v1","addr":"172.21.15.142:6813","nonce":12843}]},"public_addr":"172.21.15.142:6809/12843","cluster_addr":"172.21.15.142:6811/12843","heartbeat_back_addr":"172.21.15.142:6815/12843","heartbeat_front_addr":"172.21.15.142:6813/12843","state":["exists","up"]},{"osd":6,"uuid":"c69fca67-66e4-4c31-ab03-1419e2a83e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12844},{"type":"v1","addr":"172.21.15.142:6818","nonce":12844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":12844},{"type":"v1","addr":"172.21.15.142:6823","nonce":12844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":12844},{"type":"v1","addr":"172.21.15.142:6831","nonce":12844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":12844},{"type":"v1","addr":"172.21.15.142:6827","nonce":12844}]},"public_addr":"172.21.15.142:6818/12844","cluster_addr":"172.21.15.142:6823/12844","heartbeat_back_addr":"172.21.15.142:6831/12844","heartbeat_front_addr":"172.21.15.142:6827/12844","state":["exists","up"]},{"osd":7,"uuid":"c436f64e-aa1f-435b-ac7b-85633e297591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":12845},{"type":"v1","addr":"172.21.15.142:6819","nonce":12845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12845},{"type":"v1","addr":"172.21.15.142:6822","nonce":12845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12845},{"type":"v1","addr":"172.21.15.142:6830","nonce":12845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12845},{"type":"v1","addr":"172.21.15.142:6826","nonce":12845}]},"public_addr":"172.21.15.142:6819/12845","cluster_addr":"172.21.15.142:6822/12845","heartbeat_back_addr":"172.21.15.142:6830/12845","heartbeat_front_addr":"172.21.15.142:6826/12845","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.534744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.505453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.485516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.333028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.483323+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.567824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.273268+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.559741+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-16T05:44:00.852 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.851+0000 7f0522451700 1 -- 172.21.15.84:0/3581838232 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f050403c300 msgr2=0x7f050403e810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:00.853 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.851+0000 7f0522451700 1 --2- 172.21.15.84:0/3581838232 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f050403c300 0x7f050403e810 crc :-1 s=READY pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:00.853 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.851+0000 7f0522451700 1 -- 172.21.15.84:0/3581838232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f051c0a86a0 msgr2=0x7f051c0a8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:00.853 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.851+0000 7f0522451700 1 --2- 172.21.15.84:0/3581838232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f051c0a86a0 0x7f051c0a8ad0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f051c0a5810 tx=0x7f050c010cf0).stop 2020-01-16T05:44:00.853 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.851+0000 7f0522451700 1 -- 172.21.15.84:0/3581838232 shutdown_connections 2020-01-16T05:44:00.854 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.851+0000 7f0522451700 1 --2- 172.21.15.84:0/3581838232 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f050403c300 0x7f050403e810 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:00.854 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.851+0000 7f0522451700 1 --2- 172.21.15.84:0/3581838232 >> v2:172.21.15.142:3300/0 conn(0x7f051c141730 0x7f051c143b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:00.854 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.851+0000 7f0522451700 1 --2- 172.21.15.84:0/3581838232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f051c0a86a0 0x7f051c0a8ad0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:00.854 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.851+0000 7f0522451700 1 -- 172.21.15.84:0/3581838232 shutdown_connections 2020-01-16T05:44:00.855 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.851+0000 7f0522451700 1 -- 172.21.15.84:0/3581838232 wait complete. 2020-01-16T05:44:00.855 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.851+0000 7f0522451700 1 -- 172.21.15.84:0/3581838232 >> 172.21.15.84:0/3581838232 conn(0x7f051c0a4c20 msgr2=0x7f051c127280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:00.872 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:43:59.152708+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-16T05:44:00.872 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-16T05:44:00.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.983+0000 7f584759e700 1 Processor -- start 2020-01-16T05:44:00.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.983+0000 7f584759e700 1 -- start start 2020-01-16T05:44:00.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.983+0000 7f584759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58480a9b30 0x7f58480abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:00.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f584759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f58480a4250 0x7f5848066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:00.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f584759e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5848066dd0 con 0x7f584807ff10 2020-01-16T05:44:00.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f584759e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58480a4830 con 0x7f58480a4250 2020-01-16T05:44:00.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f584759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584807f9d0 con 0x7f58480a9b30 2020-01-16T05:44:00.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f584cce3700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f58480a4250 0x7f5848066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:00.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f5846d9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58480a9b30 0x7f58480abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:00.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f584cce3700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f58480a4250 0x7f5848066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.84:43826/0 (socket says 172.21.15.84:43826) 2020-01-16T05:44:00.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f584cce3700 1 -- 172.21.15.84:0/2154072794 learned_addr learned my addr 172.21.15.84:0/2154072794 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:00.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f5846d9d700 1 -- 172.21.15.84:0/2154072794 >> v2:172.21.15.142:3300/0 conn(0x7f58480a4250 msgr2=0x7f5848066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:00.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f5846d9d700 1 --2- 172.21.15.84:0/2154072794 >> v2:172.21.15.142:3300/0 conn(0x7f58480a4250 0x7f5848066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:00.993 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f5846d9d700 1 -- 172.21.15.84:0/2154072794 >> v1:172.21.15.142:6789/0 conn(0x7f584807ff10 legacy=0x7f58480a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:00.993 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f5846d9d700 1 -- 172.21.15.84:0/2154072794 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5848150ce0 con 0x7f58480a9b30 2020-01-16T05:44:00.993 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f5846d9d700 1 --2- 172.21.15.84:0/2154072794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58480a9b30 0x7f58480abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5840008c90 tx=0x7f5840010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.993 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f5846d9d700 1 --2- 172.21.15.84:0/2154072794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58480a9b30 0x7f58480abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5840008c90 tx=0x7f5840010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.993 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f5846d9d700 1 --2- 172.21.15.84:0/2154072794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58480a9b30 0x7f58480abdd0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f5840008c90 tx=0x7f5840010170).ready entity=mon.2 client_cookie=c5ffc9c520337d88 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:00.993 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f5846d9d700 1 --2- 172.21.15.84:0/2154072794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58480a9b30 0x7f58480abdd0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f5840008c90 tx=0x7f5840010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.993 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f5845d9b700 1 -- 172.21.15.84:0/2154072794 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f584000a160 con 0x7f58480a9b30 2020-01-16T05:44:00.994 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f5846d9d700 1 --2- 172.21.15.84:0/2154072794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58480a9b30 0x7f58480abdd0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f5840008c90 tx=0x7f5840010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.995 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f5846d9d700 1 --2- 172.21.15.84:0/2154072794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58480a9b30 0x7f58480abdd0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f5840008c90 tx=0x7f5840010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:00.995 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f5845d9b700 1 -- 172.21.15.84:0/2154072794 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5840011af0 con 0x7f58480a9b30 2020-01-16T05:44:00.995 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f5845d9b700 1 -- 172.21.15.84:0/2154072794 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f584000a740 con 0x7f58480a9b30 2020-01-16T05:44:00.995 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f584759e700 1 -- 172.21.15.84:0/2154072794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58480a9b30 msgr2=0x7f58480abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:00.995 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f584759e700 1 --2- 172.21.15.84:0/2154072794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58480a9b30 0x7f58480abdd0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f5840008c90 tx=0x7f5840010170).stop 2020-01-16T05:44:00.995 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f584759e700 1 -- 172.21.15.84:0/2154072794 shutdown_connections 2020-01-16T05:44:00.995 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f584759e700 1 --2- 172.21.15.84:0/2154072794 >> v2:172.21.15.142:3300/0 conn(0x7f58480a4250 0x7f5848066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:00.995 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f584759e700 1 --2- 172.21.15.84:0/2154072794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58480a9b30 0x7f58480abdd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:00.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f584759e700 1 -- 172.21.15.84:0/2154072794 shutdown_connections 2020-01-16T05:44:00.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f584759e700 1 -- 172.21.15.84:0/2154072794 wait complete. 2020-01-16T05:44:00.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.987+0000 7f584759e700 1 -- 172.21.15.84:0/2154072794 >> 172.21.15.84:0/2154072794 conn(0x7f58480acfc0 msgr2=0x7f58480a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.991+0000 7f584759e700 1 Processor -- start 2020-01-16T05:44:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.991+0000 7f584759e700 1 -- start start 2020-01-16T05:44:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.991+0000 7f584759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58480a40f0 0x7f5848091960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.991+0000 7f584759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5848065820 0x7f5848065c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.991+0000 7f584759e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5848134bc0 con 0x7f5848134790 2020-01-16T05:44:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.991+0000 7f584759e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5848091180 con 0x7f5848065820 2020-01-16T05:44:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.991+0000 7f584759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5848091420 con 0x7f58480a40f0 2020-01-16T05:44:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.991+0000 7f584cce3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5848065820 0x7f5848065c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.991+0000 7f584659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5848134790 0x7f58481254e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51048/0 (socket says 172.21.15.84:51048) 2020-01-16T05:44:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.991+0000 7f584cce3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5848065820 0x7f5848065c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33846/0 (socket says 172.21.15.84:33846) 2020-01-16T05:44:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.991+0000 7f584659c700 1 -- 172.21.15.84:0/4216478758 learned_addr learned my addr 172.21.15.84:0/4216478758 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.991+0000 7f5846d9d700 1 --2- 172.21.15.84:0/4216478758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58480a40f0 0x7f5848091960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.991+0000 7f583f7fe700 1 -- 172.21.15.84:0/4216478758 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279647932 0 0) 0x7f5848134bc0 con 0x7f5848134790 2020-01-16T05:44:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.991+0000 7f584cce3700 1 -- 172.21.15.84:0/4216478758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58480a40f0 msgr2=0x7f5848091960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.991+0000 7f584cce3700 1 --2- 172.21.15.84:0/4216478758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58480a40f0 0x7f5848091960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.991+0000 7f584cce3700 1 -- 172.21.15.84:0/4216478758 >> v1:172.21.15.84:6789/0 conn(0x7f5848134790 legacy=0x7f58481254e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.991+0000 7f584cce3700 1 -- 172.21.15.84:0/4216478758 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58481401b0 con 0x7f5848065820 2020-01-16T05:44:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f584cce3700 1 --2- 172.21.15.84:0/4216478758 >> v2:172.21.15.84:3300/0 conn(0x7f5848065820 0x7f5848065c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5848091340 tx=0x7f5838010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f584cce3700 1 --2- 172.21.15.84:0/4216478758 >> v2:172.21.15.84:3300/0 conn(0x7f5848065820 0x7f5848065c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5848091340 tx=0x7f5838010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f584cce3700 1 --2- 172.21.15.84:0/4216478758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5848065820 0x7f5848065c50 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f5848091340 tx=0x7f5838010be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f584cce3700 1 --2- 172.21.15.84:0/4216478758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5848065820 0x7f5848065c50 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f5848091340 tx=0x7f5838010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f583f7fe700 1 -- 172.21.15.84:0/4216478758 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5838008a30 con 0x7f5848065820 2020-01-16T05:44:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f584cce3700 1 --2- 172.21.15.84:0/4216478758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5848065820 0x7f5848065c50 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f5848091340 tx=0x7f5838010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f584759e700 1 -- 172.21.15.84:0/4216478758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584813f1a0 con 0x7f5848065820 2020-01-16T05:44:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f583f7fe700 1 -- 172.21.15.84:0/4216478758 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5838005ab0 con 0x7f5848065820 2020-01-16T05:44:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f584cce3700 1 --2- 172.21.15.84:0/4216478758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5848065820 0x7f5848065c50 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f5848091340 tx=0x7f5838010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f583f7fe700 1 -- 172.21.15.84:0/4216478758 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5838007350 con 0x7f5848065820 2020-01-16T05:44:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f584759e700 1 -- 172.21.15.84:0/4216478758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584813f5b0 con 0x7f5848065820 2020-01-16T05:44:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f584cce3700 1 --2- 172.21.15.84:0/4216478758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5848065820 0x7f5848065c50 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f5848091340 tx=0x7f5838010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f584759e700 1 -- 172.21.15.84:0/4216478758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f584805e1c0 con 0x7f5848065820 2020-01-16T05:44:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f583f7fe700 1 -- 172.21.15.84:0/4216478758 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f5838012260 con 0x7f5848065820 2020-01-16T05:44:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f584cce3700 1 --2- 172.21.15.84:0/4216478758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5848065820 0x7f5848065c50 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f5848091340 tx=0x7f5838010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f583f7fe700 1 --2- 172.21.15.84:0/4216478758 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f582c03c1b0 0x7f582c03e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:01.004 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f583f7fe700 1 -- 172.21.15.84:0/4216478758 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f583804ca20 con 0x7f5848065820 2020-01-16T05:44:01.004 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f5846d9d700 1 --2- 172.21.15.84:0/4216478758 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f582c03c1b0 0x7f582c03e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:01.004 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:00.995+0000 7f5846d9d700 1 --2- 172.21.15.84:0/4216478758 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f582c03c1b0 0x7f582c03e6c0 crc :-1 s=READY pgs=33 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:01.005 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.003+0000 7f584cce3700 1 --2- 172.21.15.84:0/4216478758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5848065820 0x7f5848065c50 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f5848091340 tx=0x7f5838010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.005 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.003+0000 7f583f7fe700 1 -- 172.21.15.84:0/4216478758 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f583806f350 con 0x7f5848065820 2020-01-16T05:44:01.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.123+0000 7f584759e700 1 -- 172.21.15.84:0/4216478758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f584805cbc0 con 0x7f5848065820 2020-01-16T05:44:01.124 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.123+0000 7f584cce3700 1 --2- 172.21.15.84:0/4216478758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5848065820 0x7f5848065c50 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f5848091340 tx=0x7f5838010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.124 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.123+0000 7f583f7fe700 1 -- 172.21.15.84:0/4216478758 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5838033020 con 0x7f5848065820 2020-01-16T05:44:01.124 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:01.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.123+0000 7f584759e700 1 -- 172.21.15.84:0/4216478758 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f582c03c1b0 msgr2=0x7f582c03e6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:01.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.123+0000 7f584759e700 1 --2- 172.21.15.84:0/4216478758 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f582c03c1b0 0x7f582c03e6c0 crc :-1 s=READY pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:01.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.123+0000 7f584759e700 1 -- 172.21.15.84:0/4216478758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5848065820 msgr2=0x7f5848065c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:01.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.123+0000 7f584759e700 1 --2- 172.21.15.84:0/4216478758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5848065820 0x7f5848065c50 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f5848091340 tx=0x7f5838010be0).stop 2020-01-16T05:44:01.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.123+0000 7f584759e700 1 -- 172.21.15.84:0/4216478758 shutdown_connections 2020-01-16T05:44:01.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.123+0000 7f584759e700 1 --2- 172.21.15.84:0/4216478758 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f582c03c1b0 0x7f582c03e6c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:01.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.123+0000 7f584759e700 1 --2- 172.21.15.84:0/4216478758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5848065820 0x7f5848065c50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:01.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.123+0000 7f584759e700 1 --2- 172.21.15.84:0/4216478758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58480a40f0 0x7f5848091960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:01.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.123+0000 7f584759e700 1 -- 172.21.15.84:0/4216478758 shutdown_connections 2020-01-16T05:44:01.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.123+0000 7f584759e700 1 -- 172.21.15.84:0/4216478758 wait complete. 2020-01-16T05:44:01.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.123+0000 7f584759e700 1 -- 172.21.15.84:0/4216478758 >> 172.21.15.84:0/4216478758 conn(0x7f58480a4ce0 msgr2=0x7f58480a52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:01.137 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2020-01-16T05:44:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa824ce7700 1 Processor -- start 2020-01-16T05:44:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa824ce7700 1 -- start start 2020-01-16T05:44:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa824ce7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8200a9b30 0x7fa8200abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa824ce7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8200a4250 0x7fa820066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa824ce7700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa820066dd0 con 0x7fa82007ff10 2020-01-16T05:44:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa824ce7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8200a4830 con 0x7fa8200a9b30 2020-01-16T05:44:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa824ce7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82007f9d0 con 0x7fa8200a4250 2020-01-16T05:44:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa81ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8200a9b30 0x7fa8200abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa81ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8200a9b30 0x7fa8200abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33852/0 (socket says 172.21.15.84:33852) 2020-01-16T05:44:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa81ffff700 1 -- 172.21.15.84:0/1432561968 learned_addr learned my addr 172.21.15.84:0/1432561968 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa825f49700 1 --2- 172.21.15.84:0/1432561968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8200a4250 0x7fa820066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa81ffff700 1 -- 172.21.15.84:0/1432561968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8200a4250 msgr2=0x7fa820066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa81ffff700 1 --2- 172.21.15.84:0/1432561968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8200a4250 0x7fa820066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa81ffff700 1 -- 172.21.15.84:0/1432561968 >> v1:172.21.15.142:6789/0 conn(0x7fa82007ff10 legacy=0x7fa8200a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa81ffff700 1 -- 172.21.15.84:0/1432561968 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa820150ce0 con 0x7fa8200a9b30 2020-01-16T05:44:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa81ffff700 1 --2- 172.21.15.84:0/1432561968 >> v2:172.21.15.84:3300/0 conn(0x7fa8200a9b30 0x7fa8200abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa8200a49f0 tx=0x7fa81000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa81ffff700 1 --2- 172.21.15.84:0/1432561968 >> v2:172.21.15.84:3300/0 conn(0x7fa8200a9b30 0x7fa8200abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa8200a49f0 tx=0x7fa81000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa81ffff700 1 --2- 172.21.15.84:0/1432561968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200a9b30 0x7fa8200abdd0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fa8200a49f0 tx=0x7fa81000feb0).ready entity=mon.0 client_cookie=eeef4e568646afba server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa81ffff700 1 --2- 172.21.15.84:0/1432561968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200a9b30 0x7fa8200abdd0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fa8200a49f0 tx=0x7fa81000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa81effd700 1 -- 172.21.15.84:0/1432561968 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa810011720 con 0x7fa8200a9b30 2020-01-16T05:44:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa81ffff700 1 --2- 172.21.15.84:0/1432561968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200a9b30 0x7fa8200abdd0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fa8200a49f0 tx=0x7fa81000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa81effd700 1 -- 172.21.15.84:0/1432561968 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa810008d30 con 0x7fa8200a9b30 2020-01-16T05:44:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa81ffff700 1 --2- 172.21.15.84:0/1432561968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200a9b30 0x7fa8200abdd0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fa8200a49f0 tx=0x7fa81000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa81effd700 1 -- 172.21.15.84:0/1432561968 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa810011d00 con 0x7fa8200a9b30 2020-01-16T05:44:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa824ce7700 1 -- 172.21.15.84:0/1432561968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200a9b30 msgr2=0x7fa8200abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.247+0000 7fa824ce7700 1 --2- 172.21.15.84:0/1432561968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200a9b30 0x7fa8200abdd0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fa8200a49f0 tx=0x7fa81000feb0).stop 2020-01-16T05:44:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.251+0000 7fa824ce7700 1 -- 172.21.15.84:0/1432561968 shutdown_connections 2020-01-16T05:44:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.251+0000 7fa824ce7700 1 --2- 172.21.15.84:0/1432561968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8200a4250 0x7fa820066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.251+0000 7fa824ce7700 1 --2- 172.21.15.84:0/1432561968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200a9b30 0x7fa8200abdd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.251+0000 7fa824ce7700 1 -- 172.21.15.84:0/1432561968 shutdown_connections 2020-01-16T05:44:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.251+0000 7fa824ce7700 1 -- 172.21.15.84:0/1432561968 wait complete. 2020-01-16T05:44:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.251+0000 7fa824ce7700 1 -- 172.21.15.84:0/1432561968 >> 172.21.15.84:0/1432561968 conn(0x7fa8200acfc0 msgr2=0x7fa8200a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.251+0000 7fa824ce7700 1 Processor -- start 2020-01-16T05:44:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.251+0000 7fa824ce7700 1 -- start start 2020-01-16T05:44:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.251+0000 7fa824ce7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8200a7a20 0x7fa820125080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.251+0000 7fa824ce7700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa8201255d0 0x7fa82013be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.251+0000 7fa824ce7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8200a3610 con 0x7fa820126b70 2020-01-16T05:44:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.251+0000 7fa824ce7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8200a81c0 con 0x7fa8200a7a20 2020-01-16T05:44:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.251+0000 7fa824ce7700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8200a8460 con 0x7fa8201255d0 2020-01-16T05:44:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.251+0000 7fa81ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa820126b70 0x7fa82009f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51058/0 (socket says 172.21.15.84:51058) 2020-01-16T05:44:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.251+0000 7fa81ffff700 1 -- 172.21.15.84:0/2753846516 learned_addr learned my addr 172.21.15.84:0/2753846516 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.251+0000 7fa81f7fe700 1 --2- 172.21.15.84:0/2753846516 >> v2:172.21.15.84:3300/0 conn(0x7fa8200a7a20 0x7fa820125080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.251+0000 7fa825f49700 1 --2- 172.21.15.84:0/2753846516 >> v2:172.21.15.142:3300/0 conn(0x7fa8201255d0 0x7fa82013be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81f7fe700 1 -- 172.21.15.84:0/2753846516 >> v2:172.21.15.142:3300/0 conn(0x7fa8201255d0 msgr2=0x7fa82013be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81f7fe700 1 --2- 172.21.15.84:0/2753846516 >> v2:172.21.15.142:3300/0 conn(0x7fa8201255d0 0x7fa82013be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81f7fe700 1 -- 172.21.15.84:0/2753846516 >> v1:172.21.15.84:6789/0 conn(0x7fa820126b70 legacy=0x7fa82009f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81f7fe700 1 -- 172.21.15.84:0/2753846516 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8200a7e50 con 0x7fa8200a7a20 2020-01-16T05:44:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa825f49700 1 --2- 172.21.15.84:0/2753846516 >> v2:172.21.15.142:3300/0 conn(0x7fa8201255d0 0x7fa82013be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81f7fe700 1 --2- 172.21.15.84:0/2753846516 >> v2:172.21.15.84:3300/0 conn(0x7fa8200a7a20 0x7fa820125080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa814000e90 tx=0x7fa814010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81f7fe700 1 --2- 172.21.15.84:0/2753846516 >> v2:172.21.15.84:3300/0 conn(0x7fa8200a7a20 0x7fa820125080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa814000e90 tx=0x7fa814010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81f7fe700 1 --2- 172.21.15.84:0/2753846516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200a7a20 0x7fa820125080 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fa814000e90 tx=0x7fa814010a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81f7fe700 1 --2- 172.21.15.84:0/2753846516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200a7a20 0x7fa820125080 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fa814000e90 tx=0x7fa814010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81cff9700 1 -- 172.21.15.84:0/2753846516 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8140124c0 con 0x7fa8200a7a20 2020-01-16T05:44:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81f7fe700 1 --2- 172.21.15.84:0/2753846516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200a7a20 0x7fa820125080 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fa814000e90 tx=0x7fa814010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81f7fe700 1 --2- 172.21.15.84:0/2753846516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200a7a20 0x7fa820125080 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fa814000e90 tx=0x7fa814010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81cff9700 1 -- 172.21.15.84:0/2753846516 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8140120e0 con 0x7fa8200a7a20 2020-01-16T05:44:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa824ce7700 1 -- 172.21.15.84:0/2753846516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8200a8c00 con 0x7fa8200a7a20 2020-01-16T05:44:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81cff9700 1 -- 172.21.15.84:0/2753846516 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa814012ae0 con 0x7fa8200a7a20 2020-01-16T05:44:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa824ce7700 1 -- 172.21.15.84:0/2753846516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8201265e0 con 0x7fa8200a7a20 2020-01-16T05:44:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81f7fe700 1 --2- 172.21.15.84:0/2753846516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200a7a20 0x7fa820125080 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fa814000e90 tx=0x7fa814010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81cff9700 1 -- 172.21.15.84:0/2753846516 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fa8140064e0 con 0x7fa8200a7a20 2020-01-16T05:44:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81f7fe700 1 --2- 172.21.15.84:0/2753846516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200a7a20 0x7fa820125080 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fa814000e90 tx=0x7fa814010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa824ce7700 1 -- 172.21.15.84:0/2753846516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82005e1c0 con 0x7fa8200a7a20 2020-01-16T05:44:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81cff9700 1 --2- 172.21.15.84:0/2753846516 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa80003c260 0x7fa80003e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81cff9700 1 -- 172.21.15.84:0/2753846516 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa81404c570 con 0x7fa8200a7a20 2020-01-16T05:44:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81ffff700 1 --2- 172.21.15.84:0/2753846516 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa80003c260 0x7fa80003e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.255+0000 7fa81ffff700 1 --2- 172.21.15.84:0/2753846516 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa80003c260 0x7fa80003e770 crc :-1 s=READY pgs=34 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:01.265 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.259+0000 7fa81f7fe700 1 --2- 172.21.15.84:0/2753846516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200a7a20 0x7fa820125080 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fa814000e90 tx=0x7fa814010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.265 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.259+0000 7fa81cff9700 1 -- 172.21.15.84:0/2753846516 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fa814032b90 con 0x7fa8200a7a20 2020-01-16T05:44:01.379 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.379+0000 7fa824ce7700 1 -- 172.21.15.84:0/2753846516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa82005cbc0 con 0x7fa8200a7a20 2020-01-16T05:44:01.380 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.379+0000 7fa81f7fe700 1 --2- 172.21.15.84:0/2753846516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200a7a20 0x7fa820125080 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fa814000e90 tx=0x7fa814010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.380 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.379+0000 7fa81cff9700 1 -- 172.21.15.84:0/2753846516 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+64 (secure 0 0 0) 0x7fa814032df0 con 0x7fa8200a7a20 2020-01-16T05:44:01.380 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:01.381 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2020-01-16T05:44:01.381 INFO:teuthology.orchestra.run.smithi084.stdout: { 2020-01-16T05:44:01.381 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2020-01-16T05:44:01.381 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2020-01-16T05:44:01.381 INFO:teuthology.orchestra.run.smithi084.stdout: } 2020-01-16T05:44:01.381 INFO:teuthology.orchestra.run.smithi084.stdout:] 2020-01-16T05:44:01.382 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.379+0000 7fa824ce7700 1 -- 172.21.15.84:0/2753846516 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa80003c260 msgr2=0x7fa80003e770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:01.382 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.379+0000 7fa824ce7700 1 --2- 172.21.15.84:0/2753846516 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa80003c260 0x7fa80003e770 crc :-1 s=READY pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:01.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.379+0000 7fa824ce7700 1 -- 172.21.15.84:0/2753846516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200a7a20 msgr2=0x7fa820125080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:01.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.379+0000 7fa824ce7700 1 --2- 172.21.15.84:0/2753846516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200a7a20 0x7fa820125080 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fa814000e90 tx=0x7fa814010a70).stop 2020-01-16T05:44:01.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.379+0000 7fa824ce7700 1 -- 172.21.15.84:0/2753846516 shutdown_connections 2020-01-16T05:44:01.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.379+0000 7fa824ce7700 1 --2- 172.21.15.84:0/2753846516 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa80003c260 0x7fa80003e770 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:01.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.379+0000 7fa824ce7700 1 --2- 172.21.15.84:0/2753846516 >> v2:172.21.15.142:3300/0 conn(0x7fa8201255d0 0x7fa82013be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:01.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.379+0000 7fa824ce7700 1 --2- 172.21.15.84:0/2753846516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200a7a20 0x7fa820125080 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:01.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.379+0000 7fa824ce7700 1 -- 172.21.15.84:0/2753846516 shutdown_connections 2020-01-16T05:44:01.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.379+0000 7fa824ce7700 1 -- 172.21.15.84:0/2753846516 wait complete. 2020-01-16T05:44:01.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.379+0000 7fa824ce7700 1 -- 172.21.15.84:0/2753846516 >> 172.21.15.84:0/2753846516 conn(0x7fa8200a9b30 msgr2=0x7fa82007e790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:01.393 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-01-16T05:44:01.393 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2020-01-16T05:44:01.512 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.503+0000 7f6d2ec37700 1 Processor -- start 2020-01-16T05:44:01.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.503+0000 7f6d2ec37700 1 -- start start 2020-01-16T05:44:01.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2ec37700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d280a2f60 0x7f6d2805b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:01.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2ec37700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d2807cd60 con 0x7f6d280a8ff0 2020-01-16T05:44:01.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2ec37700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d280a9420 con 0x7f6d2808fd80 2020-01-16T05:44:01.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2ec37700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280a3390 con 0x7f6d280a2f60 2020-01-16T05:44:01.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2c9d3700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6d280a8ff0 0x7f6d2807c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51066/0 (socket says 172.21.15.84:51066) 2020-01-16T05:44:01.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2c9d3700 1 -- 172.21.15.84:0/1312076296 learned_addr learned my addr 172.21.15.84:0/1312076296 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:01.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2d1d4700 1 --2- 172.21.15.84:0/1312076296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d280a2f60 0x7f6d2805b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:01.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d1ffff700 1 -- 172.21.15.84:0/1312076296 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499540485 0 0) 0x7f6d2807cd60 con 0x7f6d280a8ff0 2020-01-16T05:44:01.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d1ffff700 1 -- 172.21.15.84:0/1312076296 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d14003230 con 0x7f6d280a8ff0 2020-01-16T05:44:01.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d1ffff700 1 -- 172.21.15.84:0/1312076296 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 56019715 0 0) 0x7f6d14003230 con 0x7f6d280a8ff0 2020-01-16T05:44:01.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d1ffff700 1 -- 172.21.15.84:0/1312076296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d280a2f60 msgr2=0x7f6d2805b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:01.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d1ffff700 1 --2- 172.21.15.84:0/1312076296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d280a2f60 0x7f6d2805b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:01.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d1ffff700 1 -- 172.21.15.84:0/1312076296 >> v1:172.21.15.142:6789/0 conn(0x7f6d2808fd80 legacy=0x7f6d281503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:01.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d1ffff700 1 -- 172.21.15.84:0/1312076296 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2808f570 con 0x7f6d280a8ff0 2020-01-16T05:44:01.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d1ffff700 1 -- 172.21.15.84:0/1312076296 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f6d18001750 con 0x7f6d280a8ff0 2020-01-16T05:44:01.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d1ffff700 1 -- 172.21.15.84:0/1312076296 >> v1:172.21.15.84:6789/0 conn(0x7f6d280a8ff0 legacy=0x7f6d2807c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:01.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d1ffff700 1 --2- 172.21.15.84:0/1312076296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d14003890 0x7f6d14003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:01.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d1ffff700 1 --2- 172.21.15.84:0/1312076296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d140045a0 0x7f6d140049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:01.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d1ffff700 1 --2- 172.21.15.84:0/1312076296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d14004f20 0x7f6d1400b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:01.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d1ffff700 1 -- 172.21.15.84:0/1312076296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280a3390 con 0x7f6d14003890 2020-01-16T05:44:01.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d1ffff700 1 -- 172.21.15.84:0/1312076296 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d14005350 con 0x7f6d140045a0 2020-01-16T05:44:01.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d1ffff700 1 -- 172.21.15.84:0/1312076296 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1404fd50 con 0x7f6d14004f20 2020-01-16T05:44:01.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2d1d4700 1 --2- 172.21.15.84:0/1312076296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d14003890 0x7f6d14003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:01.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2c9d3700 1 --2- 172.21.15.84:0/1312076296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d140045a0 0x7f6d140049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:01.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2d9d5700 1 --2- 172.21.15.84:0/1312076296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d14004f20 0x7f6d1400b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:01.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2d1d4700 1 -- 172.21.15.84:0/1312076296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d14004f20 msgr2=0x7f6d1400b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:01.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2d1d4700 1 --2- 172.21.15.84:0/1312076296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d14004f20 0x7f6d1400b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:01.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2d1d4700 1 -- 172.21.15.84:0/1312076296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d140045a0 msgr2=0x7f6d140049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:01.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2d1d4700 1 --2- 172.21.15.84:0/1312076296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d140045a0 0x7f6d140049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:01.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2d1d4700 1 -- 172.21.15.84:0/1312076296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d14050050 con 0x7f6d14003890 2020-01-16T05:44:01.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2d1d4700 1 --2- 172.21.15.84:0/1312076296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d14003890 0x7f6d14003d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6d240032b0 tx=0x7f6d240104e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2d1d4700 1 --2- 172.21.15.84:0/1312076296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d14003890 0x7f6d14003d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6d240032b0 tx=0x7f6d240104e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2d1d4700 1 --2- 172.21.15.84:0/1312076296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d14003890 0x7f6d14003d00 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f6d240032b0 tx=0x7f6d240104e0).ready entity=mon.0 client_cookie=4959c36322ef7574 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:01.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2d1d4700 1 --2- 172.21.15.84:0/1312076296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d14003890 0x7f6d14003d00 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f6d240032b0 tx=0x7f6d240104e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d1ffff700 1 -- 172.21.15.84:0/1312076296 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d240110c0 con 0x7f6d14003890 2020-01-16T05:44:01.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2d1d4700 1 --2- 172.21.15.84:0/1312076296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d14003890 0x7f6d14003d00 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f6d240032b0 tx=0x7f6d240104e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d1ffff700 1 -- 172.21.15.84:0/1312076296 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d24005a40 con 0x7f6d14003890 2020-01-16T05:44:01.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2d1d4700 1 --2- 172.21.15.84:0/1312076296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d14003890 0x7f6d14003d00 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f6d240032b0 tx=0x7f6d240104e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d1ffff700 1 -- 172.21.15.84:0/1312076296 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d240116a0 con 0x7f6d14003890 2020-01-16T05:44:01.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2ec37700 1 -- 172.21.15.84:0/1312076296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d14003890 msgr2=0x7f6d14003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:01.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2ec37700 1 --2- 172.21.15.84:0/1312076296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d14003890 0x7f6d14003d00 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f6d240032b0 tx=0x7f6d240104e0).stop 2020-01-16T05:44:01.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.507+0000 7f6d2d9d5700 1 -- 172.21.15.84:0/1312076296 reap_dead start 2020-01-16T05:44:01.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.511+0000 7f6d2ec37700 1 -- 172.21.15.84:0/1312076296 shutdown_connections 2020-01-16T05:44:01.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.511+0000 7f6d2ec37700 1 -- 172.21.15.84:0/1312076296 shutdown_connections 2020-01-16T05:44:01.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.511+0000 7f6d2ec37700 1 -- 172.21.15.84:0/1312076296 wait complete. 2020-01-16T05:44:01.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.511+0000 7f6d2ec37700 1 -- 172.21.15.84:0/1312076296 >> 172.21.15.84:0/1312076296 conn(0x7f6d280abc10 msgr2=0x7f6d2805a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:01.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.511+0000 7f6d2ec37700 1 Processor -- start 2020-01-16T05:44:01.520 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.511+0000 7f6d2ec37700 1 -- start start 2020-01-16T05:44:01.522 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.511+0000 7f6d2ec37700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2807f320 0x7f6d2809d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:01.523 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.511+0000 7f6d2ec37700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d2807f750 con 0x7f6d2809daa0 2020-01-16T05:44:01.523 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.511+0000 7f6d2ec37700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d28123710 con 0x7f6d280a5be0 2020-01-16T05:44:01.523 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.511+0000 7f6d2ec37700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d28122f70 con 0x7f6d2807f320 2020-01-16T05:44:01.523 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.511+0000 7f6d2d9d5700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6d2809daa0 0x7f6d2813a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51080/0 (socket says 172.21.15.84:51080) 2020-01-16T05:44:01.523 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.511+0000 7f6d2d9d5700 1 -- 172.21.15.84:0/202526034 learned_addr learned my addr 172.21.15.84:0/202526034 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:01.523 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.511+0000 7f6d2c9d3700 1 --2- 172.21.15.84:0/202526034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2807f320 0x7f6d2809d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:01.523 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.511+0000 7f6d2c9d3700 1 -- 172.21.15.84:0/202526034 >> v1:172.21.15.142:6789/0 conn(0x7f6d280a5be0 legacy=0x7f6d28121880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:01.524 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.511+0000 7f6d2c9d3700 1 -- 172.21.15.84:0/202526034 >> v1:172.21.15.84:6789/0 conn(0x7f6d2809daa0 legacy=0x7f6d2813a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:01.524 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.511+0000 7f6d2c9d3700 1 -- 172.21.15.84:0/202526034 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2807fe40 con 0x7f6d2807f320 2020-01-16T05:44:01.524 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.515+0000 7f6d2c9d3700 1 --2- 172.21.15.84:0/202526034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2807f320 0x7f6d2809d550 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d18001950 tx=0x7f6d18001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.524 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.515+0000 7f6d2c9d3700 1 --2- 172.21.15.84:0/202526034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2807f320 0x7f6d2809d550 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d18001950 tx=0x7f6d18001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.524 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.515+0000 7f6d2c9d3700 1 --2- 172.21.15.84:0/202526034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2807f320 0x7f6d2809d550 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f6d18001950 tx=0x7f6d18001880).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:01.524 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.515+0000 7f6d2c9d3700 1 --2- 172.21.15.84:0/202526034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2807f320 0x7f6d2809d550 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f6d18001950 tx=0x7f6d18001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.524 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.515+0000 7f6d2c9d3700 1 --2- 172.21.15.84:0/202526034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2807f320 0x7f6d2809d550 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f6d18001950 tx=0x7f6d18001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.525 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.515+0000 7f6d1dffb700 1 -- 172.21.15.84:0/202526034 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d1800de00 con 0x7f6d2807f320 2020-01-16T05:44:01.525 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.515+0000 7f6d2c9d3700 1 --2- 172.21.15.84:0/202526034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2807f320 0x7f6d2809d550 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f6d18001950 tx=0x7f6d18001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.525 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.515+0000 7f6d1dffb700 1 -- 172.21.15.84:0/202526034 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1800da20 con 0x7f6d2807f320 2020-01-16T05:44:01.525 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.515+0000 7f6d2ec37700 1 -- 172.21.15.84:0/202526034 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2809ded0 con 0x7f6d2807f320 2020-01-16T05:44:01.525 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.515+0000 7f6d1dffb700 1 -- 172.21.15.84:0/202526034 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d18012b50 con 0x7f6d2807f320 2020-01-16T05:44:01.525 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.515+0000 7f6d2ec37700 1 -- 172.21.15.84:0/202526034 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d2813b920 con 0x7f6d2807f320 2020-01-16T05:44:01.525 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.515+0000 7f6d2c9d3700 1 --2- 172.21.15.84:0/202526034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2807f320 0x7f6d2809d550 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f6d18001950 tx=0x7f6d18001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.525 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.515+0000 7f6d2ec37700 1 -- 172.21.15.84:0/202526034 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2805e1c0 con 0x7f6d2807f320 2020-01-16T05:44:01.526 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.515+0000 7f6d1dffb700 1 -- 172.21.15.84:0/202526034 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f6d1800e070 con 0x7f6d2807f320 2020-01-16T05:44:01.526 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.515+0000 7f6d2c9d3700 1 --2- 172.21.15.84:0/202526034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2807f320 0x7f6d2809d550 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f6d18001950 tx=0x7f6d18001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.526 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.515+0000 7f6d1dffb700 1 --2- 172.21.15.84:0/202526034 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6d0803c240 0x7f6d0803e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:01.526 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.515+0000 7f6d1dffb700 1 -- 172.21.15.84:0/202526034 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6d1804ca70 con 0x7f6d2807f320 2020-01-16T05:44:01.526 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.515+0000 7f6d2d1d4700 1 --2- 172.21.15.84:0/202526034 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6d0803c240 0x7f6d0803e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:01.526 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.519+0000 7f6d2d1d4700 1 --2- 172.21.15.84:0/202526034 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6d0803c240 0x7f6d0803e750 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:01.527 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.523+0000 7f6d2c9d3700 1 --2- 172.21.15.84:0/202526034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2807f320 0x7f6d2809d550 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f6d18001950 tx=0x7f6d18001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:01.527 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.523+0000 7f6d1dffb700 1 -- 172.21.15.84:0/202526034 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f6d180332f0 con 0x7f6d2807f320 2020-01-16T05:44:01.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:01.643+0000 7f6d2ec37700 1 -- 172.21.15.84:0/202526034 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f6d2808f350 con 0x7f6d2807f320 2020-01-16T05:44:02.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.619+0000 7f6d2c9d3700 1 --2- 172.21.15.84:0/202526034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2807f320 0x7f6d2809d550 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f6d18001950 tx=0x7f6d18001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:02.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.619+0000 7f6d1dffb700 1 -- 172.21.15.84:0/202526034 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v20) v1 ==== 133+0+0 (secure 0 0 0) 0x7f6d18012d50 con 0x7f6d2807f320 2020-01-16T05:44:02.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.623+0000 7f6d2ec37700 1 -- 172.21.15.84:0/202526034 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6d0803c240 msgr2=0x7f6d0803e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:02.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.623+0000 7f6d2ec37700 1 --2- 172.21.15.84:0/202526034 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6d0803c240 0x7f6d0803e750 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:02.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.623+0000 7f6d2ec37700 1 -- 172.21.15.84:0/202526034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2807f320 msgr2=0x7f6d2809d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:02.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.623+0000 7f6d2ec37700 1 --2- 172.21.15.84:0/202526034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2807f320 0x7f6d2809d550 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f6d18001950 tx=0x7f6d18001880).stop 2020-01-16T05:44:02.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.623+0000 7f6d2ec37700 1 -- 172.21.15.84:0/202526034 shutdown_connections 2020-01-16T05:44:02.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.623+0000 7f6d2ec37700 1 --2- 172.21.15.84:0/202526034 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6d0803c240 0x7f6d0803e750 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:02.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.623+0000 7f6d2ec37700 1 --2- 172.21.15.84:0/202526034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d2807f320 0x7f6d2809d550 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:02.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.623+0000 7f6d2ec37700 1 -- 172.21.15.84:0/202526034 shutdown_connections 2020-01-16T05:44:02.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.623+0000 7f6d2ec37700 1 -- 172.21.15.84:0/202526034 wait complete. 2020-01-16T05:44:02.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.623+0000 7f6d2ec37700 1 -- 172.21.15.84:0/202526034 >> 172.21.15.84:0/202526034 conn(0x7f6d2808f940 msgr2=0x7f6d280a6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:02.628 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2020-01-16T05:44:02.638 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2020-01-16T05:44:02.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.747+0000 7f2551979700 1 Processor -- start 2020-01-16T05:44:02.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.747+0000 7f2551979700 1 -- start start 2020-01-16T05:44:02.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2551979700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f254c0a9b30 0x7f254c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:02.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2551979700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f254c07ff10 0x7f254c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:02.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2551979700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254c066dd0 con 0x7f254c0a4250 2020-01-16T05:44:02.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2551979700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f254c0a4830 con 0x7f254c07ff10 2020-01-16T05:44:02.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2551979700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f254c07f9d0 con 0x7f254c0a9b30 2020-01-16T05:44:02.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2550977700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f254c07ff10 0x7f254c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:02.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2550977700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f254c07ff10 0x7f254c066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33886/0 (socket says 172.21.15.84:33886) 2020-01-16T05:44:02.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2550977700 1 -- 172.21.15.84:0/474179771 learned_addr learned my addr 172.21.15.84:0/474179771 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:02.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2551178700 1 --2- 172.21.15.84:0/474179771 >> v2:172.21.15.142:3300/0 conn(0x7f254c0a9b30 0x7f254c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:02.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2550977700 1 -- 172.21.15.84:0/474179771 >> v2:172.21.15.142:3300/0 conn(0x7f254c0a9b30 msgr2=0x7f254c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:02.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2550977700 1 --2- 172.21.15.84:0/474179771 >> v2:172.21.15.142:3300/0 conn(0x7f254c0a9b30 0x7f254c0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:02.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2550977700 1 -- 172.21.15.84:0/474179771 >> v1:172.21.15.142:6789/0 conn(0x7f254c0a4250 legacy=0x7f254c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:02.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2550977700 1 -- 172.21.15.84:0/474179771 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c150ce0 con 0x7f254c07ff10 2020-01-16T05:44:02.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2550977700 1 --2- 172.21.15.84:0/474179771 >> v2:172.21.15.84:3300/0 conn(0x7f254c07ff10 0x7f254c066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f254c0a49f0 tx=0x7f253c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:02.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2550977700 1 --2- 172.21.15.84:0/474179771 >> v2:172.21.15.84:3300/0 conn(0x7f254c07ff10 0x7f254c066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f254c0a49f0 tx=0x7f253c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:02.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2550977700 1 --2- 172.21.15.84:0/474179771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f254c07ff10 0x7f254c066880 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f254c0a49f0 tx=0x7f253c00feb0).ready entity=mon.0 client_cookie=754b1d4357b1c092 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:02.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2550977700 1 --2- 172.21.15.84:0/474179771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f254c07ff10 0x7f254c066880 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f254c0a49f0 tx=0x7f253c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:02.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2550977700 1 --2- 172.21.15.84:0/474179771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f254c07ff10 0x7f254c066880 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f254c0a49f0 tx=0x7f253c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:02.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2543fff700 1 -- 172.21.15.84:0/474179771 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f253c0116e0 con 0x7f254c07ff10 2020-01-16T05:44:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2550977700 1 --2- 172.21.15.84:0/474179771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f254c07ff10 0x7f254c066880 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f254c0a49f0 tx=0x7f253c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2543fff700 1 -- 172.21.15.84:0/474179771 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253c008d30 con 0x7f254c07ff10 2020-01-16T05:44:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2543fff700 1 -- 172.21.15.84:0/474179771 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f253c011cc0 con 0x7f254c07ff10 2020-01-16T05:44:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2551979700 1 -- 172.21.15.84:0/474179771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f254c07ff10 msgr2=0x7f254c066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2551979700 1 --2- 172.21.15.84:0/474179771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f254c07ff10 0x7f254c066880 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f254c0a49f0 tx=0x7f253c00feb0).stop 2020-01-16T05:44:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2551979700 1 -- 172.21.15.84:0/474179771 shutdown_connections 2020-01-16T05:44:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2551979700 1 --2- 172.21.15.84:0/474179771 >> v2:172.21.15.142:3300/0 conn(0x7f254c0a9b30 0x7f254c0abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:02.760 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2551979700 1 --2- 172.21.15.84:0/474179771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f254c07ff10 0x7f254c066880 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:02.760 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2551979700 1 -- 172.21.15.84:0/474179771 shutdown_connections 2020-01-16T05:44:02.760 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2551979700 1 -- 172.21.15.84:0/474179771 wait complete. 2020-01-16T05:44:02.760 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.751+0000 7f2551979700 1 -- 172.21.15.84:0/474179771 >> 172.21.15.84:0/474179771 conn(0x7f254c0acfc0 msgr2=0x7f254c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:02.764 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.755+0000 7f2551979700 1 Processor -- start 2020-01-16T05:44:02.764 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.755+0000 7f2551979700 1 -- start start 2020-01-16T05:44:02.764 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.755+0000 7f2551979700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f254c08f250 0x7f254c09f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:02.764 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.755+0000 7f2551979700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254c0254f0 con 0x7f254c09f920 2020-01-16T05:44:02.765 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.755+0000 7f2551979700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254c132b50 con 0x7f254c135400 2020-01-16T05:44:02.765 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.755+0000 7f2551979700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254c0a3510 con 0x7f254c08f250 2020-01-16T05:44:02.765 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.755+0000 7f2550977700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f254c09f920 0x7f254c134c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51094/0 (socket says 172.21.15.84:51094) 2020-01-16T05:44:02.765 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.755+0000 7f2550977700 1 -- 172.21.15.84:0/2289963955 learned_addr learned my addr 172.21.15.84:0/2289963955 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:02.765 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.755+0000 7f2551178700 1 --2- 172.21.15.84:0/2289963955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f254c08f250 0x7f254c09f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:02.766 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2541ffb700 1 -- 172.21.15.84:0/2289963955 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894276115 0 0) 0x7f254c0254f0 con 0x7f254c09f920 2020-01-16T05:44:02.766 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2541ffb700 1 -- 172.21.15.84:0/2289963955 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f252c003230 con 0x7f254c09f920 2020-01-16T05:44:02.766 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2541ffb700 1 -- 172.21.15.84:0/2289963955 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742827324 0 0) 0x7f254c132b50 con 0x7f254c135400 2020-01-16T05:44:02.766 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2541ffb700 1 -- 172.21.15.84:0/2289963955 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f254c0254f0 con 0x7f254c135400 2020-01-16T05:44:02.767 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2551178700 1 -- 172.21.15.84:0/2289963955 >> v1:172.21.15.142:6789/0 conn(0x7f254c135400 legacy=0x7f254c13c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:02.767 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2551178700 1 -- 172.21.15.84:0/2289963955 >> v1:172.21.15.84:6789/0 conn(0x7f254c09f920 legacy=0x7f254c134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:02.767 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2551178700 1 -- 172.21.15.84:0/2289963955 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c024bf0 con 0x7f254c08f250 2020-01-16T05:44:02.767 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2551178700 1 --2- 172.21.15.84:0/2289963955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f254c08f250 0x7f254c09f3d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f2548010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:02.767 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2551178700 1 --2- 172.21.15.84:0/2289963955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f254c08f250 0x7f254c09f3d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f2548010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:02.768 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2551178700 1 --2- 172.21.15.84:0/2289963955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f254c08f250 0x7f254c09f3d0 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f2548010b90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:02.768 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2551178700 1 --2- 172.21.15.84:0/2289963955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f254c08f250 0x7f254c09f3d0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f2548010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:02.768 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2541ffb700 1 -- 172.21.15.84:0/2289963955 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2548007160 con 0x7f254c08f250 2020-01-16T05:44:02.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2551178700 1 --2- 172.21.15.84:0/2289963955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f254c08f250 0x7f254c09f3d0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f2548010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:02.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2551178700 1 --2- 172.21.15.84:0/2289963955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f254c08f250 0x7f254c09f3d0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f2548010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:02.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2541ffb700 1 -- 172.21.15.84:0/2289963955 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2548005ab0 con 0x7f254c08f250 2020-01-16T05:44:02.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2551979700 1 -- 172.21.15.84:0/2289963955 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254c135830 con 0x7f254c08f250 2020-01-16T05:44:02.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2541ffb700 1 -- 172.21.15.84:0/2289963955 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2548012250 con 0x7f254c08f250 2020-01-16T05:44:02.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2551979700 1 -- 172.21.15.84:0/2289963955 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254c13d860 con 0x7f254c08f250 2020-01-16T05:44:02.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2551178700 1 --2- 172.21.15.84:0/2289963955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f254c08f250 0x7f254c09f3d0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f2548010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:02.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2551979700 1 -- 172.21.15.84:0/2289963955 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f254c05e1c0 con 0x7f254c08f250 2020-01-16T05:44:02.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2541ffb700 1 -- 172.21.15.84:0/2289963955 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f2548012570 con 0x7f254c08f250 2020-01-16T05:44:02.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2551178700 1 --2- 172.21.15.84:0/2289963955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f254c08f250 0x7f254c09f3d0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f2548010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:02.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2541ffb700 1 --2- 172.21.15.84:0/2289963955 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f252c03c980 0x7f252c03ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:02.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2541ffb700 1 -- 172.21.15.84:0/2289963955 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5207+0+0 (secure 0 0 0) 0x7f254804cc10 con 0x7f254c08f250 2020-01-16T05:44:02.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2550977700 1 --2- 172.21.15.84:0/2289963955 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f252c03c980 0x7f252c03ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:02.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.759+0000 7f2550977700 1 --2- 172.21.15.84:0/2289963955 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f252c03c980 0x7f252c03ee90 crc :-1 s=READY pgs=36 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:02.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.771+0000 7f2551178700 1 --2- 172.21.15.84:0/2289963955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f254c08f250 0x7f254c09f3d0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f2548010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:02.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.771+0000 7f2541ffb700 1 -- 172.21.15.84:0/2289963955 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f254800d0a0 con 0x7f254c08f250 2020-01-16T05:44:02.892 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:02.891+0000 7f2551979700 1 -- 172.21.15.84:0/2289963955 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f254c0917e0 con 0x7f254c08f250 2020-01-16T05:44:03.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.623+0000 7f2551178700 1 --2- 172.21.15.84:0/2289963955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f254c08f250 0x7f254c09f3d0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f2548010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:03.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.623+0000 7f2541ffb700 1 -- 172.21.15.84:0/2289963955 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v21) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2548033210 con 0x7f254c08f250 2020-01-16T05:44:03.632 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.631+0000 7f2551979700 1 -- 172.21.15.84:0/2289963955 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f252c03c980 msgr2=0x7f252c03ee90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:03.632 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.631+0000 7f2551979700 1 --2- 172.21.15.84:0/2289963955 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f252c03c980 0x7f252c03ee90 crc :-1 s=READY pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:03.632 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.631+0000 7f2551979700 1 -- 172.21.15.84:0/2289963955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f254c08f250 msgr2=0x7f254c09f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:03.632 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.631+0000 7f2551979700 1 --2- 172.21.15.84:0/2289963955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f254c08f250 0x7f254c09f3d0 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f2548002f30 tx=0x7f2548010b90).stop 2020-01-16T05:44:03.633 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.631+0000 7f2551979700 1 -- 172.21.15.84:0/2289963955 shutdown_connections 2020-01-16T05:44:03.633 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.631+0000 7f2551979700 1 --2- 172.21.15.84:0/2289963955 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f252c03c980 0x7f252c03ee90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:03.633 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.631+0000 7f2551979700 1 --2- 172.21.15.84:0/2289963955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f254c08f250 0x7f254c09f3d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:03.633 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.631+0000 7f2551979700 1 -- 172.21.15.84:0/2289963955 shutdown_connections 2020-01-16T05:44:03.634 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.631+0000 7f2551979700 1 -- 172.21.15.84:0/2289963955 wait complete. 2020-01-16T05:44:03.634 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.631+0000 7f2551979700 1 -- 172.21.15.84:0/2289963955 >> 172.21.15.84:0/2289963955 conn(0x7f254c0ab810 msgr2=0x7f254c07e790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:03.634 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2020-01-16T05:44:03.645 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2020-01-16T05:44:03.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.751+0000 7f048ded5700 1 Processor -- start 2020-01-16T05:44:03.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.751+0000 7f048ded5700 1 -- start start 2020-01-16T05:44:03.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048ded5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880246e0 0x7f0488024b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:03.761 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048ded5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f048814d310 0x7f048814f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:03.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048ded5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04880aa5b0 con 0x7f04880abe80 2020-01-16T05:44:03.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048ded5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04880aa8c0 con 0x7f048814d310 2020-01-16T05:44:03.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048ded5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04880aab60 con 0x7f04880246e0 2020-01-16T05:44:03.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048f137700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f048814d310 0x7f048814f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:03.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048f137700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f048814d310 0x7f048814f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33904/0 (socket says 172.21.15.84:33904) 2020-01-16T05:44:03.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048f137700 1 -- 172.21.15.84:0/2449695828 learned_addr learned my addr 172.21.15.84:0/2449695828 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:03.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048ced3700 1 --2- 172.21.15.84:0/2449695828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880246e0 0x7f0488024b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:03.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048f137700 1 -- 172.21.15.84:0/2449695828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880246e0 msgr2=0x7f0488024b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:03.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048f137700 1 --2- 172.21.15.84:0/2449695828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880246e0 0x7f0488024b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:03.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048f137700 1 -- 172.21.15.84:0/2449695828 >> v1:172.21.15.142:6789/0 conn(0x7f04880abe80 legacy=0x7f04880a8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:03.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048f137700 1 -- 172.21.15.84:0/2449695828 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04880ab0a0 con 0x7f048814d310 2020-01-16T05:44:03.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048f137700 1 --2- 172.21.15.84:0/2449695828 >> v2:172.21.15.84:3300/0 conn(0x7f048814d310 0x7f048814f750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f04880aa7e0 tx=0x7f048000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:03.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048f137700 1 --2- 172.21.15.84:0/2449695828 >> v2:172.21.15.84:3300/0 conn(0x7f048814d310 0x7f048814f750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f04880aa7e0 tx=0x7f048000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:03.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048f137700 1 --2- 172.21.15.84:0/2449695828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f048814d310 0x7f048814f750 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f04880aa7e0 tx=0x7f048000feb0).ready entity=mon.0 client_cookie=1e132ebb0275938e server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:03.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048f137700 1 --2- 172.21.15.84:0/2449695828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f048814d310 0x7f048814f750 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f04880aa7e0 tx=0x7f048000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:03.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f047ffff700 1 -- 172.21.15.84:0/2449695828 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04800107c0 con 0x7f048814d310 2020-01-16T05:44:03.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048f137700 1 --2- 172.21.15.84:0/2449695828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f048814d310 0x7f048814f750 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f04880aa7e0 tx=0x7f048000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:03.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f047ffff700 1 -- 172.21.15.84:0/2449695828 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0480008a30 con 0x7f048814d310 2020-01-16T05:44:03.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048f137700 1 --2- 172.21.15.84:0/2449695828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f048814d310 0x7f048814f750 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f04880aa7e0 tx=0x7f048000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:03.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048ded5700 1 -- 172.21.15.84:0/2449695828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f048814d310 msgr2=0x7f048814f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:03.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f047ffff700 1 -- 172.21.15.84:0/2449695828 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0480010bb0 con 0x7f048814d310 2020-01-16T05:44:03.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048ded5700 1 --2- 172.21.15.84:0/2449695828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f048814d310 0x7f048814f750 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f04880aa7e0 tx=0x7f048000feb0).stop 2020-01-16T05:44:03.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048ded5700 1 -- 172.21.15.84:0/2449695828 shutdown_connections 2020-01-16T05:44:03.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048ded5700 1 --2- 172.21.15.84:0/2449695828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f048814d310 0x7f048814f750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:03.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048ded5700 1 --2- 172.21.15.84:0/2449695828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880246e0 0x7f0488024b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:03.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048ded5700 1 -- 172.21.15.84:0/2449695828 shutdown_connections 2020-01-16T05:44:03.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048ded5700 1 -- 172.21.15.84:0/2449695828 wait complete. 2020-01-16T05:44:03.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.755+0000 7f048ded5700 1 -- 172.21.15.84:0/2449695828 >> 172.21.15.84:0/2449695828 conn(0x7f048805fa20 msgr2=0x7f048805fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:03.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048ded5700 1 Processor -- start 2020-01-16T05:44:03.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048ded5700 1 -- start start 2020-01-16T05:44:03.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048ded5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880a45a0 0x7f04880a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:03.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048ded5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04880a3ab0 con 0x7f0488135be0 2020-01-16T05:44:03.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048ded5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0488136010 con 0x7f0488127940 2020-01-16T05:44:03.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048ded5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04880a4c40 con 0x7f04880a45a0 2020-01-16T05:44:03.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048f137700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0488135be0 0x7f048813cfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51108/0 (socket says 172.21.15.84:51108) 2020-01-16T05:44:03.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048f137700 1 -- 172.21.15.84:0/1851424612 learned_addr learned my addr 172.21.15.84:0/1851424612 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:03.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048ced3700 1 --2- 172.21.15.84:0/1851424612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880a45a0 0x7f04880a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:03.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f047dffb700 1 -- 172.21.15.84:0/1851424612 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221328655 0 0) 0x7f04880a3ab0 con 0x7f0488135be0 2020-01-16T05:44:03.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f047dffb700 1 -- 172.21.15.84:0/1851424612 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0468003230 con 0x7f0488135be0 2020-01-16T05:44:03.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048f137700 1 -- 172.21.15.84:0/1851424612 >> v1:172.21.15.84:6789/0 conn(0x7f0488135be0 legacy=0x7f048813cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-01-16T05:44:03.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048f137700 1 -- 172.21.15.84:0/1851424612 >> v1:172.21.15.84:6789/0 conn(0x7f0488135be0 legacy=0x7f048813cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-01-16T05:44:03.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048f137700 1 --1- 172.21.15.84:0/1851424612 >> v1:172.21.15.84:6789/0 conn(0x7f0488135be0 0x7f048813cfd0 :-1 s=OPENED pgs=86 cs=1 l=1).handle_message read tag failed 2020-01-16T05:44:03.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048f137700 1 --1- 172.21.15.84:0/1851424612 >> v1:172.21.15.84:6789/0 conn(0x7f0488135be0 0x7f048813cfd0 :-1 s=OPENED pgs=86 cs=1 l=1).fault on lossy channel, failing 2020-01-16T05:44:03.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f047dffb700 1 -- 172.21.15.84:0/1851424612 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012613533 0 0) 0x7f0488136010 con 0x7f0488127940 2020-01-16T05:44:03.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f047dffb700 1 -- 172.21.15.84:0/1851424612 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04880a3ab0 con 0x7f0488127940 2020-01-16T05:44:03.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048ced3700 1 -- 172.21.15.84:0/1851424612 >> v1:172.21.15.142:6789/0 conn(0x7f0488127940 legacy=0x7f048807c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:03.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048ced3700 1 -- 172.21.15.84:0/1851424612 >> v1:172.21.15.84:6789/0 conn(0x7f0488135be0 legacy=0x7f048813cfd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-01-16T05:44:03.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048ced3700 1 -- 172.21.15.84:0/1851424612 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0488136240 con 0x7f04880a45a0 2020-01-16T05:44:03.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048ced3700 1 --2- 172.21.15.84:0/1851424612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880a45a0 0x7f04880a50e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0478002f30 tx=0x7f0478010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:03.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048ced3700 1 --2- 172.21.15.84:0/1851424612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880a45a0 0x7f04880a50e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0478002f30 tx=0x7f0478010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:03.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048ced3700 1 --2- 172.21.15.84:0/1851424612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880a45a0 0x7f04880a50e0 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f0478002f30 tx=0x7f0478010bf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:03.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048ced3700 1 --2- 172.21.15.84:0/1851424612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880a45a0 0x7f04880a50e0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f0478002f30 tx=0x7f0478010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:03.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f047dffb700 1 -- 172.21.15.84:0/1851424612 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0478007530 con 0x7f04880a45a0 2020-01-16T05:44:03.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048ced3700 1 --2- 172.21.15.84:0/1851424612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880a45a0 0x7f04880a50e0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f0478002f30 tx=0x7f0478010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:03.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048ced3700 1 --2- 172.21.15.84:0/1851424612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880a45a0 0x7f04880a50e0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f0478002f30 tx=0x7f0478010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:03.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f047dffb700 1 -- 172.21.15.84:0/1851424612 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0478007150 con 0x7f04880a45a0 2020-01-16T05:44:03.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048ded5700 1 -- 172.21.15.84:0/1851424612 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f048813e7e0 con 0x7f04880a45a0 2020-01-16T05:44:03.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f047dffb700 1 -- 172.21.15.84:0/1851424612 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0478005aa0 con 0x7f04880a45a0 2020-01-16T05:44:03.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.759+0000 7f048ded5700 1 -- 172.21.15.84:0/1851424612 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f048813e9f0 con 0x7f04880a45a0 2020-01-16T05:44:03.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.763+0000 7f048ced3700 1 --2- 172.21.15.84:0/1851424612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880a45a0 0x7f04880a50e0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f0478002f30 tx=0x7f0478010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:03.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.763+0000 7f048ded5700 1 -- 172.21.15.84:0/1851424612 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f048805e1c0 con 0x7f04880a45a0 2020-01-16T05:44:03.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.763+0000 7f047dffb700 1 -- 172.21.15.84:0/1851424612 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f04780126a0 con 0x7f04880a45a0 2020-01-16T05:44:03.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.763+0000 7f048ced3700 1 --2- 172.21.15.84:0/1851424612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880a45a0 0x7f04880a50e0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f0478002f30 tx=0x7f0478010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:03.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.763+0000 7f047dffb700 1 --2- 172.21.15.84:0/1851424612 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f046803c9f0 0x7f046803ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:03.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.763+0000 7f047dffb700 1 -- 172.21.15.84:0/1851424612 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5557+0+0 (secure 0 0 0) 0x7f047804ca60 con 0x7f04880a45a0 2020-01-16T05:44:03.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.763+0000 7f048d6d4700 1 --2- 172.21.15.84:0/1851424612 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f046803c9f0 0x7f046803ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:03.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.763+0000 7f048d6d4700 1 --2- 172.21.15.84:0/1851424612 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f046803c9f0 0x7f046803ef00 crc :-1 s=READY pgs=37 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:03.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.771+0000 7f048ced3700 1 --2- 172.21.15.84:0/1851424612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880a45a0 0x7f04880a50e0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f0478002f30 tx=0x7f0478010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:03.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.771+0000 7f047dffb700 1 -- 172.21.15.84:0/1851424612 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f0478033080 con 0x7f04880a45a0 2020-01-16T05:44:03.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.923+0000 7f048ded5700 1 -- 172.21.15.84:0/1851424612 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f048805cbc0 con 0x7f04880a45a0 2020-01-16T05:44:03.928 INFO:tasks.ceph.mon.a.smithi084.stderr:2020-01-16T05:44:03.927+0000 7fc88f352700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-01-16T05:44:03.940 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.939+0000 7f048ced3700 1 --2- 172.21.15.84:0/1851424612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880a45a0 0x7f04880a50e0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f0478002f30 tx=0x7f0478010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:03.940 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.939+0000 7f047dffb700 1 -- 172.21.15.84:0/1851424612 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 2 and data pool 3 v2) v1 ==== 187+0+0 (secure 0 0 0) 0x7f04780332e0 con 0x7f04880a45a0 2020-01-16T05:44:03.944 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.943+0000 7f048ded5700 1 -- 172.21.15.84:0/1851424612 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f046803c9f0 msgr2=0x7f046803ef00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:03.944 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.943+0000 7f048ded5700 1 --2- 172.21.15.84:0/1851424612 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f046803c9f0 0x7f046803ef00 crc :-1 s=READY pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:03.944 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.943+0000 7f048ded5700 1 -- 172.21.15.84:0/1851424612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880a45a0 msgr2=0x7f04880a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:03.944 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.943+0000 7f048ded5700 1 --2- 172.21.15.84:0/1851424612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880a45a0 0x7f04880a50e0 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f0478002f30 tx=0x7f0478010bf0).stop 2020-01-16T05:44:03.945 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.943+0000 7f048ded5700 1 -- 172.21.15.84:0/1851424612 shutdown_connections 2020-01-16T05:44:03.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.943+0000 7f048ded5700 1 --2- 172.21.15.84:0/1851424612 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f046803c9f0 0x7f046803ef00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:03.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.943+0000 7f048ded5700 1 --2- 172.21.15.84:0/1851424612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04880a45a0 0x7f04880a50e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:03.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.943+0000 7f048ded5700 1 -- 172.21.15.84:0/1851424612 shutdown_connections 2020-01-16T05:44:03.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.943+0000 7f048ded5700 1 -- 172.21.15.84:0/1851424612 wait complete. 2020-01-16T05:44:03.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:03.943+0000 7f048ded5700 1 -- 172.21.15.84:0/1851424612 >> 172.21.15.84:0/1851424612 conn(0x7f04880a9130 msgr2=0x7f048807efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:03.947 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 2 and data pool 3 2020-01-16T05:44:03.955 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-16T05:44:04.058 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.051+0000 7f4b2efde700 1 Processor -- start 2020-01-16T05:44:04.059 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.051+0000 7f4b2efde700 1 -- start start 2020-01-16T05:44:04.059 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.051+0000 7f4b2efde700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b2805b0f0 0x7f4b280a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:04.059 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.051+0000 7f4b2efde700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4b2808fd80 0x7f4b281503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:04.059 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.051+0000 7f4b2efde700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2807cd60 con 0x7f4b280a2f60 2020-01-16T05:44:04.060 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2efde700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b280a3390 con 0x7f4b2805b0f0 2020-01-16T05:44:04.060 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2efde700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b280905b0 con 0x7f4b2808fd80 2020-01-16T05:44:04.060 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2cd7a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b2805b0f0 0x7f4b280a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.060 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2d57b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4b280a2f60 0x7f4b2807c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51114/0 (socket says 172.21.15.84:51114) 2020-01-16T05:44:04.061 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2d57b700 1 -- 172.21.15.84:0/2657098275 learned_addr learned my addr 172.21.15.84:0/2657098275 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:04.061 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2dd7c700 1 --2- 172.21.15.84:0/2657098275 >> v2:172.21.15.142:3300/0 conn(0x7f4b2808fd80 0x7f4b281503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.061 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2cd7a700 1 -- 172.21.15.84:0/2657098275 >> v2:172.21.15.142:3300/0 conn(0x7f4b2808fd80 msgr2=0x7f4b281503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:04.061 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2cd7a700 1 --2- 172.21.15.84:0/2657098275 >> v2:172.21.15.142:3300/0 conn(0x7f4b2808fd80 0x7f4b281503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:04.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2cd7a700 1 -- 172.21.15.84:0/2657098275 >> v1:172.21.15.84:6789/0 conn(0x7f4b280a2f60 legacy=0x7f4b2807c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:04.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b27fff700 1 -- 172.21.15.84:0/2657098275 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490739598 0 0) 0x7f4b2807cd60 con 0x7f4b280a2f60 2020-01-16T05:44:04.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2cd7a700 1 -- 172.21.15.84:0/2657098275 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2805b520 con 0x7f4b2805b0f0 2020-01-16T05:44:04.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2cd7a700 1 --2- 172.21.15.84:0/2657098275 >> v2:172.21.15.84:3300/0 conn(0x7f4b2805b0f0 0x7f4b280a8ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4b280a2530 tx=0x7f4b18010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2cd7a700 1 --2- 172.21.15.84:0/2657098275 >> v2:172.21.15.84:3300/0 conn(0x7f4b2805b0f0 0x7f4b280a8ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4b280a2530 tx=0x7f4b18010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2cd7a700 1 --2- 172.21.15.84:0/2657098275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b2805b0f0 0x7f4b280a8ff0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f4b280a2530 tx=0x7f4b18010170).ready entity=mon.0 client_cookie=3465d1773f9f6c17 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:04.068 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2cd7a700 1 --2- 172.21.15.84:0/2657098275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b2805b0f0 0x7f4b280a8ff0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f4b280a2530 tx=0x7f4b18010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.068 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b27fff700 1 -- 172.21.15.84:0/2657098275 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1800a160 con 0x7f4b2805b0f0 2020-01-16T05:44:04.068 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2cd7a700 1 --2- 172.21.15.84:0/2657098275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b2805b0f0 0x7f4b280a8ff0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f4b280a2530 tx=0x7f4b18010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.070 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2cd7a700 1 --2- 172.21.15.84:0/2657098275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b2805b0f0 0x7f4b280a8ff0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f4b280a2530 tx=0x7f4b18010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b27fff700 1 -- 172.21.15.84:0/2657098275 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b18011ab0 con 0x7f4b2805b0f0 2020-01-16T05:44:04.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b27fff700 1 -- 172.21.15.84:0/2657098275 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1800a740 con 0x7f4b2805b0f0 2020-01-16T05:44:04.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2efde700 1 -- 172.21.15.84:0/2657098275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b2805b0f0 msgr2=0x7f4b280a8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:04.072 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2efde700 1 --2- 172.21.15.84:0/2657098275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b2805b0f0 0x7f4b280a8ff0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f4b280a2530 tx=0x7f4b18010170).stop 2020-01-16T05:44:04.072 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2efde700 1 -- 172.21.15.84:0/2657098275 shutdown_connections 2020-01-16T05:44:04.072 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2efde700 1 --2- 172.21.15.84:0/2657098275 >> v2:172.21.15.142:3300/0 conn(0x7f4b2808fd80 0x7f4b281503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:04.073 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2efde700 1 --2- 172.21.15.84:0/2657098275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b2805b0f0 0x7f4b280a8ff0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:04.073 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2efde700 1 -- 172.21.15.84:0/2657098275 shutdown_connections 2020-01-16T05:44:04.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2efde700 1 -- 172.21.15.84:0/2657098275 wait complete. 2020-01-16T05:44:04.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2efde700 1 -- 172.21.15.84:0/2657098275 >> 172.21.15.84:0/2657098275 conn(0x7f4b280abc10 msgr2=0x7f4b2805a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:04.081 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.055+0000 7f4b2efde700 1 Processor -- start 2020-01-16T05:44:04.081 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2efde700 1 -- start start 2020-01-16T05:44:04.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2efde700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b2807d2f0 0x7f4b2809c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2efde700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4b28137fc0 0x7f4b2813a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2efde700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2807c2e0 con 0x7f4b2809b620 2020-01-16T05:44:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2efde700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2809ae40 con 0x7f4b2807d2f0 2020-01-16T05:44:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2efde700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2809b0e0 con 0x7f4b28137fc0 2020-01-16T05:44:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2d57b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b2807d2f0 0x7f4b2809c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2d57b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b2807d2f0 0x7f4b2809c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33918/0 (socket says 172.21.15.84:33918) 2020-01-16T05:44:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2d57b700 1 -- 172.21.15.84:0/3546805628 learned_addr learned my addr 172.21.15.84:0/3546805628 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:04.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2dd7c700 1 --2- 172.21.15.84:0/3546805628 >> v2:172.21.15.142:3300/0 conn(0x7f4b28137fc0 0x7f4b2813a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2d57b700 1 -- 172.21.15.84:0/3546805628 >> v2:172.21.15.142:3300/0 conn(0x7f4b28137fc0 msgr2=0x7f4b2813a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:04.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2d57b700 1 --2- 172.21.15.84:0/3546805628 >> v2:172.21.15.142:3300/0 conn(0x7f4b28137fc0 0x7f4b2813a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:04.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2d57b700 1 -- 172.21.15.84:0/3546805628 >> v1:172.21.15.142:6789/0 conn(0x7f4b2809b620 legacy=0x7f4b2807bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:04.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2d57b700 1 -- 172.21.15.84:0/3546805628 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2809c750 con 0x7f4b2807d2f0 2020-01-16T05:44:04.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2d57b700 1 --2- 172.21.15.84:0/3546805628 >> v2:172.21.15.84:3300/0 conn(0x7f4b2807d2f0 0x7f4b2809c200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b20004520 tx=0x7f4b20010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2d57b700 1 --2- 172.21.15.84:0/3546805628 >> v2:172.21.15.84:3300/0 conn(0x7f4b2807d2f0 0x7f4b2809c200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b20004520 tx=0x7f4b20010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2d57b700 1 --2- 172.21.15.84:0/3546805628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b2807d2f0 0x7f4b2809c200 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f4b20004520 tx=0x7f4b20010ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:04.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2d57b700 1 --2- 172.21.15.84:0/3546805628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b2807d2f0 0x7f4b2809c200 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f4b20004520 tx=0x7f4b20010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2d57b700 1 --2- 172.21.15.84:0/3546805628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b2807d2f0 0x7f4b2809c200 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f4b20004520 tx=0x7f4b20010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b25ffb700 1 -- 172.21.15.84:0/3546805628 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b20004990 con 0x7f4b2807d2f0 2020-01-16T05:44:04.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2d57b700 1 --2- 172.21.15.84:0/3546805628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b2807d2f0 0x7f4b2809c200 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f4b20004520 tx=0x7f4b20010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b25ffb700 1 -- 172.21.15.84:0/3546805628 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b200045b0 con 0x7f4b2807d2f0 2020-01-16T05:44:04.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2efde700 1 -- 172.21.15.84:0/3546805628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2809a730 con 0x7f4b2807d2f0 2020-01-16T05:44:04.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b25ffb700 1 -- 172.21.15.84:0/3546805628 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b20012480 con 0x7f4b2807d2f0 2020-01-16T05:44:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2efde700 1 -- 172.21.15.84:0/3546805628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b28080000 con 0x7f4b2807d2f0 2020-01-16T05:44:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2d57b700 1 --2- 172.21.15.84:0/3546805628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b2807d2f0 0x7f4b2809c200 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f4b20004520 tx=0x7f4b20010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.059+0000 7f4b2efde700 1 -- 172.21.15.84:0/3546805628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2805e1c0 con 0x7f4b2807d2f0 2020-01-16T05:44:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.063+0000 7f4b25ffb700 1 -- 172.21.15.84:0/3546805628 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f4b20012750 con 0x7f4b2807d2f0 2020-01-16T05:44:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.063+0000 7f4b2d57b700 1 --2- 172.21.15.84:0/3546805628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b2807d2f0 0x7f4b2809c200 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f4b20004520 tx=0x7f4b20010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.063+0000 7f4b25ffb700 1 --2- 172.21.15.84:0/3546805628 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4b0c03c2d0 0x7f4b0c03e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.063+0000 7f4b25ffb700 1 -- 172.21.15.84:0/3546805628 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f4b2004cba0 con 0x7f4b2807d2f0 2020-01-16T05:44:04.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.063+0000 7f4b2cd7a700 1 --2- 172.21.15.84:0/3546805628 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4b0c03c2d0 0x7f4b0c03e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.063+0000 7f4b2cd7a700 1 --2- 172.21.15.84:0/3546805628 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4b0c03c2d0 0x7f4b0c03e7e0 crc :-1 s=READY pgs=38 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:04.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.071+0000 7f4b2d57b700 1 --2- 172.21.15.84:0/3546805628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b2807d2f0 0x7f4b2809c200 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f4b20004520 tx=0x7f4b20010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.071+0000 7f4b25ffb700 1 -- 172.21.15.84:0/3546805628 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f4b20033180 con 0x7f4b2807d2f0 2020-01-16T05:44:04.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.191+0000 7f4b2efde700 1 -- 172.21.15.84:0/3546805628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b2808f350 con 0x7f4b2807d2f0 2020-01-16T05:44:04.194 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.191+0000 7f4b2d57b700 1 --2- 172.21.15.84:0/3546805628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b2807d2f0 0x7f4b2809c200 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f4b20004520 tx=0x7f4b20010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.194 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.191+0000 7f4b25ffb700 1 -- 172.21.15.84:0/3546805628 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14697 (secure 0 0 0) 0x7f4b200333e0 con 0x7f4b2807d2f0 2020-01-16T05:44:04.195 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:04.195 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":22,"fsid":"cbc67508-4d2a-4483-a1fc-95d371063ac4","created":"2020-01-16T05:43:46.771497+0000","modified":"2020-01-16T05:44:03.929456+0000","last_up_change":"2020-01-16T05:43:55.529492+0000","last_in_change":"2020-01-16T05:43:55.529492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-16T05:43:59.152708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-16T05:44:01.682783+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-16T05:44:02.930765+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15da60bb-4d16-44cc-80c6-cd2c7fa77364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":12644},{"type":"v1","addr":"172.21.15.84:6812","nonce":12644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":12644},{"type":"v1","addr":"172.21.15.84:6816","nonce":12644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":12644},{"type":"v1","addr":"172.21.15.84:6824","nonce":12644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":12644},{"type":"v1","addr":"172.21.15.84:6820","nonce":12644}]},"public_addr":"172.21.15.84:6812/12644","cluster_addr":"172.21.15.84:6816/12644","heartbeat_back_addr":"172.21.15.84:6824/12644","heartbeat_front_addr":"172.21.15.84:6820/12644","state":["exists","up"]},{"osd":1,"uuid":"0800533c-1d5b-4f9f-99bb-34b8133c8b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":12645},{"type":"v1","addr":"172.21.15.84:6803","nonce":12645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":12645},{"type":"v1","addr":"172.21.15.84:6805","nonce":12645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":12645},{"type":"v1","addr":"172.21.15.84:6809","nonce":12645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":12645},{"type":"v1","addr":"172.21.15.84:6807","nonce":12645}]},"public_addr":"172.21.15.84:6803/12645","cluster_addr":"172.21.15.84:6805/12645","heartbeat_back_addr":"172.21.15.84:6809/12645","heartbeat_front_addr":"172.21.15.84:6807/12645","state":["exists","up"]},{"osd":2,"uuid":"519cc27f-5cf9-4ecf-ad66-f722c37339df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":12646},{"type":"v1","addr":"172.21.15.84:6813","nonce":12646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6815","nonce":12646},{"type":"v1","addr":"172.21.15.84:6817","nonce":12646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":12646},{"type":"v1","addr":"172.21.15.84:6825","nonce":12646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":12646},{"type":"v1","addr":"172.21.15.84:6821","nonce":12646}]},"public_addr":"172.21.15.84:6813/12646","cluster_addr":"172.21.15.84:6817/12646","heartbeat_back_addr":"172.21.15.84:6825/12646","heartbeat_front_addr":"172.21.15.84:6821/12646","state":["exists","up"]},{"osd":3,"uuid":"aec305a6-bbac-4e01-8ea1-6077d49e27e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":12647},{"type":"v1","addr":"172.21.15.84:6827","nonce":12647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":12647},{"type":"v1","addr":"172.21.15.84:6829","nonce":12647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":12647},{"type":"v1","addr":"172.21.15.84:6833","nonce":12647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":12647},{"type":"v1","addr":"172.21.15.84:6831","nonce":12647}]},"public_addr":"172.21.15.84:6827/12647","cluster_addr":"172.21.15.84:6829/12647","heartbeat_back_addr":"172.21.15.84:6833/12647","heartbeat_front_addr":"172.21.15.84:6831/12647","state":["exists","up"]},{"osd":4,"uuid":"aaec7f3e-299a-4546-8406-207bcc4b3afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":12842},{"type":"v1","addr":"172.21.15.142:6801","nonce":12842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12842},{"type":"v1","addr":"172.21.15.142:6803","nonce":12842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12842},{"type":"v1","addr":"172.21.15.142:6807","nonce":12842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12842},{"type":"v1","addr":"172.21.15.142:6805","nonce":12842}]},"public_addr":"172.21.15.142:6801/12842","cluster_addr":"172.21.15.142:6803/12842","heartbeat_back_addr":"172.21.15.142:6807/12842","heartbeat_front_addr":"172.21.15.142:6805/12842","state":["exists","up"]},{"osd":5,"uuid":"5a942a47-7346-46d4-adf8-dad2bdb95aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12843},{"type":"v1","addr":"172.21.15.142:6809","nonce":12843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12843},{"type":"v1","addr":"172.21.15.142:6811","nonce":12843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12843},{"type":"v1","addr":"172.21.15.142:6815","nonce":12843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12843},{"type":"v1","addr":"172.21.15.142:6813","nonce":12843}]},"public_addr":"172.21.15.142:6809/12843","cluster_addr":"172.21.15.142:6811/12843","heartbeat_back_addr":"172.21.15.142:6815/12843","heartbeat_front_addr":"172.21.15.142:6813/12843","state":["exists","up"]},{"osd":6,"uuid":"c69fca67-66e4-4c31-ab03-1419e2a83e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12844},{"type":"v1","addr":"172.21.15.142:6818","nonce":12844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":12844},{"type":"v1","addr":"172.21.15.142:6823","nonce":12844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":12844},{"type":"v1","addr":"172.21.15.142:6831","nonce":12844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":12844},{"type":"v1","addr":"172.21.15.142:6827","nonce":12844}]},"public_addr":"172.21.15.142:6818/12844","cluster_addr":"172.21.15.142:6823/12844","heartbeat_back_addr":"172.21.15.142:6831/12844","heartbeat_front_addr":"172.21.15.142:6827/12844","state":["exists","up"]},{"osd":7,"uuid":"c436f64e-aa1f-435b-ac7b-85633e297591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":12845},{"type":"v1","addr":"172.21.15.142:6819","nonce":12845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12845},{"type":"v1","addr":"172.21.15.142:6822","nonce":12845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12845},{"type":"v1","addr":"172.21.15.142:6830","nonce":12845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12845},{"type":"v1","addr":"172.21.15.142:6826","nonce":12845}]},"public_addr":"172.21.15.142:6819/12845","cluster_addr":"172.21.15.142:6822/12845","heartbeat_back_addr":"172.21.15.142:6830/12845","heartbeat_front_addr":"172.21.15.142:6826/12845","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.534744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.505453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.485516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.333028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.483323+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.567824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.273268+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.559741+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-16T05:44:04.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.195+0000 7f4b2efde700 1 -- 172.21.15.84:0/3546805628 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4b0c03c2d0 msgr2=0x7f4b0c03e7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:04.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.195+0000 7f4b2efde700 1 --2- 172.21.15.84:0/3546805628 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4b0c03c2d0 0x7f4b0c03e7e0 crc :-1 s=READY pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:04.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.195+0000 7f4b2efde700 1 -- 172.21.15.84:0/3546805628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b2807d2f0 msgr2=0x7f4b2809c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:04.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.195+0000 7f4b2efde700 1 --2- 172.21.15.84:0/3546805628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b2807d2f0 0x7f4b2809c200 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f4b20004520 tx=0x7f4b20010ac0).stop 2020-01-16T05:44:04.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.195+0000 7f4b2efde700 1 -- 172.21.15.84:0/3546805628 shutdown_connections 2020-01-16T05:44:04.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.195+0000 7f4b2efde700 1 --2- 172.21.15.84:0/3546805628 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4b0c03c2d0 0x7f4b0c03e7e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:04.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.195+0000 7f4b2efde700 1 --2- 172.21.15.84:0/3546805628 >> v2:172.21.15.142:3300/0 conn(0x7f4b28137fc0 0x7f4b2813a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:04.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.195+0000 7f4b2efde700 1 --2- 172.21.15.84:0/3546805628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b2807d2f0 0x7f4b2809c200 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:04.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.195+0000 7f4b2efde700 1 -- 172.21.15.84:0/3546805628 shutdown_connections 2020-01-16T05:44:04.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.195+0000 7f4b2efde700 1 -- 172.21.15.84:0/3546805628 wait complete. 2020-01-16T05:44:04.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.195+0000 7f4b2efde700 1 -- 172.21.15.84:0/3546805628 >> 172.21.15.84:0/3546805628 conn(0x7f4b28090090 msgr2=0x7f4b28126960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:04.220 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-16T05:44:04.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a63fff700 1 Processor -- start 2020-01-16T05:44:04.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a63fff700 1 -- start start 2020-01-16T05:44:04.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a63fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a640a9b30 0x7f1a640abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:04.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a63fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a6407ff10 0x7f1a64066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:04.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a63fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1a640a4250 0x7f1a640a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:04.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a63fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a640a4830 con 0x7f1a6407ff10 2020-01-16T05:44:04.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a63fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a6407f9d0 con 0x7f1a640a4250 2020-01-16T05:44:04.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a63fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6407fc70 con 0x7f1a640a9b30 2020-01-16T05:44:04.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a62ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a6407ff10 0x7f1a64066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a62ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a6407ff10 0x7f1a64066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33928/0 (socket says 172.21.15.84:33928) 2020-01-16T05:44:04.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a62ffd700 1 -- 172.21.15.84:0/3684616364 learned_addr learned my addr 172.21.15.84:0/3684616364 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:04.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a637fe700 1 --2- 172.21.15.84:0/3684616364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a640a9b30 0x7f1a640abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a696c6700 1 --2- 172.21.15.84:0/3684616364 >> v2:172.21.15.142:3300/0 conn(0x7f1a640a4250 0x7f1a640a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a62ffd700 1 -- 172.21.15.84:0/3684616364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a640a9b30 msgr2=0x7f1a640abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:04.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a62ffd700 1 --2- 172.21.15.84:0/3684616364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a640a9b30 0x7f1a640abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:04.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a62ffd700 1 -- 172.21.15.84:0/3684616364 >> v2:172.21.15.142:3300/0 conn(0x7f1a640a4250 msgr2=0x7f1a640a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:04.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a62ffd700 1 --2- 172.21.15.84:0/3684616364 >> v2:172.21.15.142:3300/0 conn(0x7f1a640a4250 0x7f1a640a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:04.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a62ffd700 1 -- 172.21.15.84:0/3684616364 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a64066dd0 con 0x7f1a6407ff10 2020-01-16T05:44:04.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a62ffd700 1 --2- 172.21.15.84:0/3684616364 >> v2:172.21.15.84:3300/0 conn(0x7f1a6407ff10 0x7f1a64066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1a640a49f0 tx=0x7f1a4c00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a62ffd700 1 --2- 172.21.15.84:0/3684616364 >> v2:172.21.15.84:3300/0 conn(0x7f1a6407ff10 0x7f1a64066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1a640a49f0 tx=0x7f1a4c00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.339+0000 7f1a62ffd700 1 --2- 172.21.15.84:0/3684616364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a6407ff10 0x7f1a64066880 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f1a640a49f0 tx=0x7f1a4c00ff30).ready entity=mon.0 client_cookie=f2a24e9231233738 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:04.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a62ffd700 1 --2- 172.21.15.84:0/3684616364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a6407ff10 0x7f1a64066880 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f1a640a49f0 tx=0x7f1a4c00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a627fc700 1 -- 172.21.15.84:0/3684616364 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a4c011760 con 0x7f1a6407ff10 2020-01-16T05:44:04.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a62ffd700 1 --2- 172.21.15.84:0/3684616364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a6407ff10 0x7f1a64066880 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f1a640a49f0 tx=0x7f1a4c00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a627fc700 1 -- 172.21.15.84:0/3684616364 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c008d30 con 0x7f1a6407ff10 2020-01-16T05:44:04.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a62ffd700 1 --2- 172.21.15.84:0/3684616364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a6407ff10 0x7f1a64066880 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f1a640a49f0 tx=0x7f1a4c00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a63fff700 1 -- 172.21.15.84:0/3684616364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a6407ff10 msgr2=0x7f1a64066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:04.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a627fc700 1 -- 172.21.15.84:0/3684616364 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a4c011d40 con 0x7f1a6407ff10 2020-01-16T05:44:04.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a63fff700 1 --2- 172.21.15.84:0/3684616364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a6407ff10 0x7f1a64066880 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f1a640a49f0 tx=0x7f1a4c00ff30).stop 2020-01-16T05:44:04.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a63fff700 1 -- 172.21.15.84:0/3684616364 shutdown_connections 2020-01-16T05:44:04.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a63fff700 1 --2- 172.21.15.84:0/3684616364 >> v2:172.21.15.142:3300/0 conn(0x7f1a640a4250 0x7f1a640a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:04.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a63fff700 1 --2- 172.21.15.84:0/3684616364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a640a9b30 0x7f1a640abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:04.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a63fff700 1 --2- 172.21.15.84:0/3684616364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a6407ff10 0x7f1a64066880 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:04.350 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a63fff700 1 -- 172.21.15.84:0/3684616364 shutdown_connections 2020-01-16T05:44:04.350 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a63fff700 1 -- 172.21.15.84:0/3684616364 wait complete. 2020-01-16T05:44:04.350 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a63fff700 1 -- 172.21.15.84:0/3684616364 >> 172.21.15.84:0/3684616364 conn(0x7f1a640acfc0 msgr2=0x7f1a640a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:04.350 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a63fff700 1 Processor -- start 2020-01-16T05:44:04.350 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a63fff700 1 -- start start 2020-01-16T05:44:04.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a63fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a64062660 0x7f1a64063f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:04.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a63fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1a641325b0 0x7f1a6413cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:04.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a63fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a640a3900 con 0x7f1a640610f0 2020-01-16T05:44:04.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a63fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a64063a50 con 0x7f1a641325b0 2020-01-16T05:44:04.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a63fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a64063280 con 0x7f1a64062660 2020-01-16T05:44:04.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a637fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a64062660 0x7f1a64063f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a696c6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1a641325b0 0x7f1a6413cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a62ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1a640610f0 0x7f1a64065c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:49360/0 (socket says 172.21.15.84:49360) 2020-01-16T05:44:04.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a696c6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1a641325b0 0x7f1a6413cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.84:43916/0 (socket says 172.21.15.84:43916) 2020-01-16T05:44:04.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a637fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a64062660 0x7f1a64063f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:46178/0 (socket says 172.21.15.84:46178) 2020-01-16T05:44:04.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.343+0000 7f1a62ffd700 1 -- 172.21.15.84:0/707077487 learned_addr learned my addr 172.21.15.84:0/707077487 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:04.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a637fe700 1 -- 172.21.15.84:0/707077487 >> v2:172.21.15.142:3300/0 conn(0x7f1a641325b0 msgr2=0x7f1a6413cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:04.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a637fe700 1 --2- 172.21.15.84:0/707077487 >> v2:172.21.15.142:3300/0 conn(0x7f1a641325b0 0x7f1a6413cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:04.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a637fe700 1 -- 172.21.15.84:0/707077487 >> v1:172.21.15.142:6789/0 conn(0x7f1a640610f0 legacy=0x7f1a64065c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:04.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a637fe700 1 -- 172.21.15.84:0/707077487 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a64061870 con 0x7f1a64062660 2020-01-16T05:44:04.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a637fe700 1 --2- 172.21.15.84:0/707077487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a64062660 0x7f1a64063f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1a5c0032b0 tx=0x7f1a5c010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a637fe700 1 --2- 172.21.15.84:0/707077487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a64062660 0x7f1a64063f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1a5c0032b0 tx=0x7f1a5c010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a637fe700 1 --2- 172.21.15.84:0/707077487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a64062660 0x7f1a64063f50 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f1a5c0032b0 tx=0x7f1a5c010ee0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:04.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a637fe700 1 --2- 172.21.15.84:0/707077487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a64062660 0x7f1a64063f50 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f1a5c0032b0 tx=0x7f1a5c010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a5bfff700 1 -- 172.21.15.84:0/707077487 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a5c011920 con 0x7f1a64062660 2020-01-16T05:44:04.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a637fe700 1 --2- 172.21.15.84:0/707077487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a64062660 0x7f1a64063f50 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f1a5c0032b0 tx=0x7f1a5c010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a637fe700 1 --2- 172.21.15.84:0/707077487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a64062660 0x7f1a64063f50 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f1a5c0032b0 tx=0x7f1a5c010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a5bfff700 1 -- 172.21.15.84:0/707077487 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c005a40 con 0x7f1a64062660 2020-01-16T05:44:04.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a63fff700 1 -- 172.21.15.84:0/707077487 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a64062050 con 0x7f1a64062660 2020-01-16T05:44:04.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a5bfff700 1 -- 172.21.15.84:0/707077487 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a5c00c490 con 0x7f1a64062660 2020-01-16T05:44:04.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a63fff700 1 -- 172.21.15.84:0/707077487 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a64061520 con 0x7f1a64062660 2020-01-16T05:44:04.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a637fe700 1 --2- 172.21.15.84:0/707077487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a64062660 0x7f1a64063f50 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f1a5c0032b0 tx=0x7f1a5c010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a63fff700 1 -- 172.21.15.84:0/707077487 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a6405e1c0 con 0x7f1a64062660 2020-01-16T05:44:04.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a5bfff700 1 -- 172.21.15.84:0/707077487 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f1a5c00c7a0 con 0x7f1a64062660 2020-01-16T05:44:04.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a637fe700 1 --2- 172.21.15.84:0/707077487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a64062660 0x7f1a64063f50 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f1a5c0032b0 tx=0x7f1a5c010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a5bfff700 1 --2- 172.21.15.84:0/707077487 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1a4803c2f0 0x7f1a4803e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:04.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a5bfff700 1 -- 172.21.15.84:0/707077487 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f1a5c04c960 con 0x7f1a64062660 2020-01-16T05:44:04.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a62ffd700 1 --2- 172.21.15.84:0/707077487 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1a4803c2f0 0x7f1a4803e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.347+0000 7f1a62ffd700 1 --2- 172.21.15.84:0/707077487 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1a4803c2f0 0x7f1a4803e800 crc :-1 s=READY pgs=39 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:04.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.359+0000 7f1a637fe700 1 --2- 172.21.15.84:0/707077487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a64062660 0x7f1a64063f50 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f1a5c0032b0 tx=0x7f1a5c010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.359+0000 7f1a5bfff700 1 -- 172.21.15.84:0/707077487 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f1a5c0303e0 con 0x7f1a64062660 2020-01-16T05:44:04.476 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.475+0000 7f1a63fff700 1 -- 172.21.15.84:0/707077487 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a6405cbc0 con 0x7f1a64062660 2020-01-16T05:44:04.478 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.475+0000 7f1a637fe700 1 --2- 172.21.15.84:0/707077487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a64062660 0x7f1a64063f50 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f1a5c0032b0 tx=0x7f1a5c010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.479+0000 7f1a5bfff700 1 -- 172.21.15.84:0/707077487 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14697 (secure 0 0 0) 0x7f1a5c034810 con 0x7f1a64062660 2020-01-16T05:44:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:04.480 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":22,"fsid":"cbc67508-4d2a-4483-a1fc-95d371063ac4","created":"2020-01-16T05:43:46.771497+0000","modified":"2020-01-16T05:44:03.929456+0000","last_up_change":"2020-01-16T05:43:55.529492+0000","last_in_change":"2020-01-16T05:43:55.529492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-16T05:43:59.152708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-16T05:44:01.682783+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-16T05:44:02.930765+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15da60bb-4d16-44cc-80c6-cd2c7fa77364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":12644},{"type":"v1","addr":"172.21.15.84:6812","nonce":12644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":12644},{"type":"v1","addr":"172.21.15.84:6816","nonce":12644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":12644},{"type":"v1","addr":"172.21.15.84:6824","nonce":12644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":12644},{"type":"v1","addr":"172.21.15.84:6820","nonce":12644}]},"public_addr":"172.21.15.84:6812/12644","cluster_addr":"172.21.15.84:6816/12644","heartbeat_back_addr":"172.21.15.84:6824/12644","heartbeat_front_addr":"172.21.15.84:6820/12644","state":["exists","up"]},{"osd":1,"uuid":"0800533c-1d5b-4f9f-99bb-34b8133c8b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":12645},{"type":"v1","addr":"172.21.15.84:6803","nonce":12645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":12645},{"type":"v1","addr":"172.21.15.84:6805","nonce":12645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":12645},{"type":"v1","addr":"172.21.15.84:6809","nonce":12645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":12645},{"type":"v1","addr":"172.21.15.84:6807","nonce":12645}]},"public_addr":"172.21.15.84:6803/12645","cluster_addr":"172.21.15.84:6805/12645","heartbeat_back_addr":"172.21.15.84:6809/12645","heartbeat_front_addr":"172.21.15.84:6807/12645","state":["exists","up"]},{"osd":2,"uuid":"519cc27f-5cf9-4ecf-ad66-f722c37339df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":12646},{"type":"v1","addr":"172.21.15.84:6813","nonce":12646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6815","nonce":12646},{"type":"v1","addr":"172.21.15.84:6817","nonce":12646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":12646},{"type":"v1","addr":"172.21.15.84:6825","nonce":12646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":12646},{"type":"v1","addr":"172.21.15.84:6821","nonce":12646}]},"public_addr":"172.21.15.84:6813/12646","cluster_addr":"172.21.15.84:6817/12646","heartbeat_back_addr":"172.21.15.84:6825/12646","heartbeat_front_addr":"172.21.15.84:6821/12646","state":["exists","up"]},{"osd":3,"uuid":"aec305a6-bbac-4e01-8ea1-6077d49e27e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":12647},{"type":"v1","addr":"172.21.15.84:6827","nonce":12647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":12647},{"type":"v1","addr":"172.21.15.84:6829","nonce":12647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":12647},{"type":"v1","addr":"172.21.15.84:6833","nonce":12647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":12647},{"type":"v1","addr":"172.21.15.84:6831","nonce":12647}]},"public_addr":"172.21.15.84:6827/12647","cluster_addr":"172.21.15.84:6829/12647","heartbeat_back_addr":"172.21.15.84:6833/12647","heartbeat_front_addr":"172.21.15.84:6831/12647","state":["exists","up"]},{"osd":4,"uuid":"aaec7f3e-299a-4546-8406-207bcc4b3afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":12842},{"type":"v1","addr":"172.21.15.142:6801","nonce":12842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12842},{"type":"v1","addr":"172.21.15.142:6803","nonce":12842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12842},{"type":"v1","addr":"172.21.15.142:6807","nonce":12842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12842},{"type":"v1","addr":"172.21.15.142:6805","nonce":12842}]},"public_addr":"172.21.15.142:6801/12842","cluster_addr":"172.21.15.142:6803/12842","heartbeat_back_addr":"172.21.15.142:6807/12842","heartbeat_front_addr":"172.21.15.142:6805/12842","state":["exists","up"]},{"osd":5,"uuid":"5a942a47-7346-46d4-adf8-dad2bdb95aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12843},{"type":"v1","addr":"172.21.15.142:6809","nonce":12843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12843},{"type":"v1","addr":"172.21.15.142:6811","nonce":12843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12843},{"type":"v1","addr":"172.21.15.142:6815","nonce":12843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12843},{"type":"v1","addr":"172.21.15.142:6813","nonce":12843}]},"public_addr":"172.21.15.142:6809/12843","cluster_addr":"172.21.15.142:6811/12843","heartbeat_back_addr":"172.21.15.142:6815/12843","heartbeat_front_addr":"172.21.15.142:6813/12843","state":["exists","up"]},{"osd":6,"uuid":"c69fca67-66e4-4c31-ab03-1419e2a83e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12844},{"type":"v1","addr":"172.21.15.142:6818","nonce":12844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":12844},{"type":"v1","addr":"172.21.15.142:6823","nonce":12844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":12844},{"type":"v1","addr":"172.21.15.142:6831","nonce":12844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":12844},{"type":"v1","addr":"172.21.15.142:6827","nonce":12844}]},"public_addr":"172.21.15.142:6818/12844","cluster_addr":"172.21.15.142:6823/12844","heartbeat_back_addr":"172.21.15.142:6831/12844","heartbeat_front_addr":"172.21.15.142:6827/12844","state":["exists","up"]},{"osd":7,"uuid":"c436f64e-aa1f-435b-ac7b-85633e297591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":12845},{"type":"v1","addr":"172.21.15.142:6819","nonce":12845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12845},{"type":"v1","addr":"172.21.15.142:6822","nonce":12845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12845},{"type":"v1","addr":"172.21.15.142:6830","nonce":12845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12845},{"type":"v1","addr":"172.21.15.142:6826","nonce":12845}]},"public_addr":"172.21.15.142:6819/12845","cluster_addr":"172.21.15.142:6822/12845","heartbeat_back_addr":"172.21.15.142:6830/12845","heartbeat_front_addr":"172.21.15.142:6826/12845","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.534744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.505453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.485516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.333028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.483323+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.567824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.273268+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.559741+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-16T05:44:04.482 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.479+0000 7f1a63fff700 1 -- 172.21.15.84:0/707077487 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1a4803c2f0 msgr2=0x7f1a4803e800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:04.482 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.479+0000 7f1a63fff700 1 --2- 172.21.15.84:0/707077487 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1a4803c2f0 0x7f1a4803e800 crc :-1 s=READY pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:04.482 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.479+0000 7f1a63fff700 1 -- 172.21.15.84:0/707077487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a64062660 msgr2=0x7f1a64063f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:04.482 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.479+0000 7f1a63fff700 1 --2- 172.21.15.84:0/707077487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a64062660 0x7f1a64063f50 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f1a5c0032b0 tx=0x7f1a5c010ee0).stop 2020-01-16T05:44:04.483 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.479+0000 7f1a63fff700 1 -- 172.21.15.84:0/707077487 shutdown_connections 2020-01-16T05:44:04.483 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.479+0000 7f1a63fff700 1 --2- 172.21.15.84:0/707077487 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1a4803c2f0 0x7f1a4803e800 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:04.483 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.479+0000 7f1a63fff700 1 --2- 172.21.15.84:0/707077487 >> v2:172.21.15.142:3300/0 conn(0x7f1a641325b0 0x7f1a6413cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:04.483 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.479+0000 7f1a63fff700 1 --2- 172.21.15.84:0/707077487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a64062660 0x7f1a64063f50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:04.483 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.479+0000 7f1a63fff700 1 -- 172.21.15.84:0/707077487 shutdown_connections 2020-01-16T05:44:04.483 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.479+0000 7f1a63fff700 1 -- 172.21.15.84:0/707077487 wait complete. 2020-01-16T05:44:04.483 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.479+0000 7f1a63fff700 1 -- 172.21.15.84:0/707077487 >> 172.21.15.84:0/707077487 conn(0x7f1a640ab6b0 msgr2=0x7f1a640a8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:04.499 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2020-01-16T05:44:04.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.615+0000 7f46e8d4f700 1 Processor -- start 2020-01-16T05:44:04.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.615+0000 7f46e8d4f700 1 -- start start 2020-01-16T05:44:04.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.615+0000 7f46e8d4f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f46e40a9b30 0x7f46e40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:04.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e8d4f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f46e40a4250 0x7f46e4066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:04.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e8d4f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e4066dd0 con 0x7f46e407ff10 2020-01-16T05:44:04.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e8d4f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e40a4830 con 0x7f46e40a9b30 2020-01-16T05:44:04.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e8d4f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e407f9d0 con 0x7f46e40a4250 2020-01-16T05:44:04.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e37fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f46e407ff10 0x7f46e40a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51146/0 (socket says 172.21.15.84:51146) 2020-01-16T05:44:04.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e37fe700 1 -- 172.21.15.84:0/3807213535 learned_addr learned my addr 172.21.15.84:0/3807213535 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:04.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f46e40a9b30 0x7f46e40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e9fb1700 1 --2- 172.21.15.84:0/3807213535 >> v2:172.21.15.142:3300/0 conn(0x7f46e40a4250 0x7f46e4066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 -- 172.21.15.84:0/3807213535 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034063443 0 0) 0x7f46e4066dd0 con 0x7f46e407ff10 2020-01-16T05:44:04.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 -- 172.21.15.84:0/3807213535 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46cc003230 con 0x7f46e407ff10 2020-01-16T05:44:04.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 -- 172.21.15.84:0/3807213535 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2443441500 0 0) 0x7f46cc003230 con 0x7f46e407ff10 2020-01-16T05:44:04.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 -- 172.21.15.84:0/3807213535 >> v2:172.21.15.142:3300/0 conn(0x7f46e40a4250 msgr2=0x7f46e4066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:04.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 --2- 172.21.15.84:0/3807213535 >> v2:172.21.15.142:3300/0 conn(0x7f46e40a4250 0x7f46e4066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:04.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 -- 172.21.15.84:0/3807213535 >> v2:172.21.15.84:3300/0 conn(0x7f46e40a9b30 msgr2=0x7f46e40abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:04.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 --2- 172.21.15.84:0/3807213535 >> v2:172.21.15.84:3300/0 conn(0x7f46e40a9b30 0x7f46e40abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:04.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 -- 172.21.15.84:0/3807213535 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e4150ce0 con 0x7f46e407ff10 2020-01-16T05:44:04.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 -- 172.21.15.84:0/3807213535 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f46d8001750 con 0x7f46e407ff10 2020-01-16T05:44:04.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e3fff700 1 --2- 172.21.15.84:0/3807213535 >> v2:172.21.15.84:3300/0 conn(0x7f46e40a9b30 0x7f46e40abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:04.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 -- 172.21.15.84:0/3807213535 >> v1:172.21.15.84:6789/0 conn(0x7f46e407ff10 legacy=0x7f46e40a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:04.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 --2- 172.21.15.84:0/3807213535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46cc003890 0x7f46cc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:04.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 --2- 172.21.15.84:0/3807213535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46cc0045a0 0x7f46cc0049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:04.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 --2- 172.21.15.84:0/3807213535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46cc004f20 0x7f46cc04f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:04.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 -- 172.21.15.84:0/3807213535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e40a4830 con 0x7f46cc003890 2020-01-16T05:44:04.628 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 -- 172.21.15.84:0/3807213535 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e407f9d0 con 0x7f46cc0045a0 2020-01-16T05:44:04.628 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 -- 172.21.15.84:0/3807213535 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc04fe90 con 0x7f46cc004f20 2020-01-16T05:44:04.628 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e3fff700 1 --2- 172.21.15.84:0/3807213535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46cc003890 0x7f46cc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.628 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e9fb1700 1 --2- 172.21.15.84:0/3807213535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46cc004f20 0x7f46cc04f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.628 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e37fe700 1 --2- 172.21.15.84:0/3807213535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46cc0045a0 0x7f46cc0049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.628 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e3fff700 1 -- 172.21.15.84:0/3807213535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46cc004f20 msgr2=0x7f46cc04f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:04.628 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e3fff700 1 --2- 172.21.15.84:0/3807213535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46cc004f20 0x7f46cc04f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:04.628 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e3fff700 1 -- 172.21.15.84:0/3807213535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46cc0045a0 msgr2=0x7f46cc0049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:04.629 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e3fff700 1 --2- 172.21.15.84:0/3807213535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46cc0045a0 0x7f46cc0049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:04.629 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e9fb1700 1 -- 172.21.15.84:0/3807213535 reap_dead start 2020-01-16T05:44:04.629 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e3fff700 1 -- 172.21.15.84:0/3807213535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc050190 con 0x7f46cc003890 2020-01-16T05:44:04.629 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e3fff700 1 --2- 172.21.15.84:0/3807213535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46cc003890 0x7f46cc003d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f46d40032b0 tx=0x7f46d400c3d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.629 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e3fff700 1 --2- 172.21.15.84:0/3807213535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46cc003890 0x7f46cc003d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f46d40032b0 tx=0x7f46d400c3d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.629 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e3fff700 1 --2- 172.21.15.84:0/3807213535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46cc003890 0x7f46cc003d00 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f46d40032b0 tx=0x7f46d400c3d0).ready entity=mon.0 client_cookie=dca84a8fe6d0b074 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:04.629 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e3fff700 1 --2- 172.21.15.84:0/3807213535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46cc003890 0x7f46cc003d00 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f46d40032b0 tx=0x7f46d400c3d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.630 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 -- 172.21.15.84:0/3807213535 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46d400ca40 con 0x7f46cc003890 2020-01-16T05:44:04.630 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e3fff700 1 --2- 172.21.15.84:0/3807213535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46cc003890 0x7f46cc003d00 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f46d40032b0 tx=0x7f46d400c3d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.630 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 -- 172.21.15.84:0/3807213535 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d4005ae0 con 0x7f46cc003890 2020-01-16T05:44:04.630 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e3fff700 1 --2- 172.21.15.84:0/3807213535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46cc003890 0x7f46cc003d00 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f46d40032b0 tx=0x7f46d400c3d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.630 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e2ffd700 1 -- 172.21.15.84:0/3807213535 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46d400e350 con 0x7f46cc003890 2020-01-16T05:44:04.630 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e8d4f700 1 -- 172.21.15.84:0/3807213535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46cc003890 msgr2=0x7f46cc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:04.630 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e8d4f700 1 --2- 172.21.15.84:0/3807213535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46cc003890 0x7f46cc003d00 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f46d40032b0 tx=0x7f46d400c3d0).stop 2020-01-16T05:44:04.630 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e8d4f700 1 -- 172.21.15.84:0/3807213535 shutdown_connections 2020-01-16T05:44:04.631 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e8d4f700 1 --2- 172.21.15.84:0/3807213535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46cc003890 0x7f46cc003d00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:04.631 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e8d4f700 1 -- 172.21.15.84:0/3807213535 shutdown_connections 2020-01-16T05:44:04.631 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e8d4f700 1 -- 172.21.15.84:0/3807213535 wait complete. 2020-01-16T05:44:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.619+0000 7f46e8d4f700 1 -- 172.21.15.84:0/3807213535 >> 172.21.15.84:0/3807213535 conn(0x7f46e40acfc0 msgr2=0x7f46e40a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:04.635 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.623+0000 7f46e8d4f700 1 Processor -- start 2020-01-16T05:44:04.635 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.623+0000 7f46e8d4f700 1 -- start start 2020-01-16T05:44:04.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.623+0000 7f46e8d4f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f46e41261e0 0x7f46e407ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.623+0000 7f46e8d4f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f46e40a6f40 0x7f46e4132c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.623+0000 7f46e8d4f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e407f330 con 0x7f46e4135930 2020-01-16T05:44:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.623+0000 7f46e8d4f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e4132480 con 0x7f46e41261e0 2020-01-16T05:44:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.623+0000 7f46e8d4f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e405f410 con 0x7f46e40a6f40 2020-01-16T05:44:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.623+0000 7f46e9fb1700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f46e4135930 0x7f46e4135d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51158/0 (socket says 172.21.15.84:51158) 2020-01-16T05:44:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.623+0000 7f46e3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f46e41261e0 0x7f46e407ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.623+0000 7f46e9fb1700 1 -- 172.21.15.84:0/2467673634 learned_addr learned my addr 172.21.15.84:0/2467673634 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e37fe700 1 --2- 172.21.15.84:0/2467673634 >> v2:172.21.15.142:3300/0 conn(0x7f46e40a6f40 0x7f46e4132c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e0ff9700 1 -- 172.21.15.84:0/2467673634 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609252589 0 0) 0x7f46e407f330 con 0x7f46e4135930 2020-01-16T05:44:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e0ff9700 1 -- 172.21.15.84:0/2467673634 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46c4003230 con 0x7f46e4135930 2020-01-16T05:44:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e37fe700 1 -- 172.21.15.84:0/2467673634 >> v2:172.21.15.84:3300/0 conn(0x7f46e41261e0 msgr2=0x7f46e407ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e37fe700 1 --2- 172.21.15.84:0/2467673634 >> v2:172.21.15.84:3300/0 conn(0x7f46e41261e0 0x7f46e407ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:04.639 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e37fe700 1 -- 172.21.15.84:0/2467673634 >> v1:172.21.15.84:6789/0 conn(0x7f46e4135930 legacy=0x7f46e4135d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:04.639 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e37fe700 1 -- 172.21.15.84:0/2467673634 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e4133170 con 0x7f46e40a6f40 2020-01-16T05:44:04.639 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e37fe700 1 --2- 172.21.15.84:0/2467673634 >> v2:172.21.15.142:3300/0 conn(0x7f46e40a6f40 0x7f46e4132c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f46d8001950 tx=0x7f46d8001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.639 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e37fe700 1 --2- 172.21.15.84:0/2467673634 >> v2:172.21.15.142:3300/0 conn(0x7f46e40a6f40 0x7f46e4132c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f46d8001950 tx=0x7f46d8001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.639 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e37fe700 1 --2- 172.21.15.84:0/2467673634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46e40a6f40 0x7f46e4132c20 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f46d8001950 tx=0x7f46d8001880).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:04.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e37fe700 1 --2- 172.21.15.84:0/2467673634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46e40a6f40 0x7f46e4132c20 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f46d8001950 tx=0x7f46d8001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e0ff9700 1 -- 172.21.15.84:0/2467673634 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46d8012b00 con 0x7f46e40a6f40 2020-01-16T05:44:04.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e8d4f700 1 -- 172.21.15.84:0/2467673634 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e4125ab0 con 0x7f46e40a6f40 2020-01-16T05:44:04.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e37fe700 1 --2- 172.21.15.84:0/2467673634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46e40a6f40 0x7f46e4132c20 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f46d8001950 tx=0x7f46d8001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e0ff9700 1 -- 172.21.15.84:0/2467673634 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d8012720 con 0x7f46e40a6f40 2020-01-16T05:44:04.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e37fe700 1 --2- 172.21.15.84:0/2467673634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46e40a6f40 0x7f46e4132c20 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f46d8001950 tx=0x7f46d8001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e0ff9700 1 -- 172.21.15.84:0/2467673634 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46d8008530 con 0x7f46e40a6f40 2020-01-16T05:44:04.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e8d4f700 1 -- 172.21.15.84:0/2467673634 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e4124a50 con 0x7f46e40a6f40 2020-01-16T05:44:04.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e37fe700 1 --2- 172.21.15.84:0/2467673634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46e40a6f40 0x7f46e4132c20 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f46d8001950 tx=0x7f46d8001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e8d4f700 1 -- 172.21.15.84:0/2467673634 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e405e1c0 con 0x7f46e40a6f40 2020-01-16T05:44:04.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e0ff9700 1 -- 172.21.15.84:0/2467673634 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f46d8008730 con 0x7f46e40a6f40 2020-01-16T05:44:04.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e37fe700 1 --2- 172.21.15.84:0/2467673634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46e40a6f40 0x7f46e4132c20 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f46d8001950 tx=0x7f46d8001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e0ff9700 1 --2- 172.21.15.84:0/2467673634 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f46c403c7d0 0x7f46c403ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:04.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e0ff9700 1 -- 172.21.15.84:0/2467673634 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f46d804cc50 con 0x7f46e40a6f40 2020-01-16T05:44:04.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e3fff700 1 --2- 172.21.15.84:0/2467673634 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f46c403c7d0 0x7f46c403ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:04.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.627+0000 7f46e3fff700 1 --2- 172.21.15.84:0/2467673634 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f46c403c7d0 0x7f46c403ece0 crc :-1 s=READY pgs=41 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:04.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.639+0000 7f46e37fe700 1 --2- 172.21.15.84:0/2467673634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46e40a6f40 0x7f46e4132c20 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f46d8001950 tx=0x7f46d8001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:04.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.639+0000 7f46e0ff9700 1 -- 172.21.15.84:0/2467673634 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f46d80011f0 con 0x7f46e40a6f40 2020-01-16T05:44:04.791 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:04.791+0000 7f46e8d4f700 1 -- 172.21.15.84:0/2467673634 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f46e409fce0 con 0x7f46e40a6f40 2020-01-16T05:44:05.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.655+0000 7f46e37fe700 1 --2- 172.21.15.84:0/2467673634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46e40a6f40 0x7f46e4132c20 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f46d8001950 tx=0x7f46d8001880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:05.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.655+0000 7f46e0ff9700 1 -- 172.21.15.84:0/2467673634 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7f46d8033250 con 0x7f46e40a6f40 2020-01-16T05:44:05.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.655+0000 7f46e8d4f700 1 -- 172.21.15.84:0/2467673634 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f46c403c7d0 msgr2=0x7f46c403ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:05.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.655+0000 7f46e8d4f700 1 --2- 172.21.15.84:0/2467673634 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f46c403c7d0 0x7f46c403ece0 crc :-1 s=READY pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:05.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.655+0000 7f46e8d4f700 1 -- 172.21.15.84:0/2467673634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46e40a6f40 msgr2=0x7f46e4132c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:05.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.655+0000 7f46e8d4f700 1 --2- 172.21.15.84:0/2467673634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46e40a6f40 0x7f46e4132c20 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f46d8001950 tx=0x7f46d8001880).stop 2020-01-16T05:44:05.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.655+0000 7f46e8d4f700 1 -- 172.21.15.84:0/2467673634 shutdown_connections 2020-01-16T05:44:05.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.655+0000 7f46e8d4f700 1 --2- 172.21.15.84:0/2467673634 >> v2:172.21.15.84:3300/0 conn(0x7f46e41261e0 0x7f46e407ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:05.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.655+0000 7f46e8d4f700 1 --2- 172.21.15.84:0/2467673634 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f46c403c7d0 0x7f46c403ece0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:05.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.655+0000 7f46e8d4f700 1 --2- 172.21.15.84:0/2467673634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46e40a6f40 0x7f46e4132c20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:05.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.655+0000 7f46e8d4f700 1 -- 172.21.15.84:0/2467673634 shutdown_connections 2020-01-16T05:44:05.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.655+0000 7f46e8d4f700 1 -- 172.21.15.84:0/2467673634 wait complete. 2020-01-16T05:44:05.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.655+0000 7f46e8d4f700 1 -- 172.21.15.84:0/2467673634 >> 172.21.15.84:0/2467673634 conn(0x7f46e4066a80 msgr2=0x7f46e40916e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:05.677 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:44:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a0a5f700 1 Processor -- start 2020-01-16T05:44:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a0a5f700 1 -- start start 2020-01-16T05:44:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a0a5f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f519c0a9b30 0x7f519c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a0a5f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f519c0a4250 0x7f519c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a0a5f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519c066dd0 con 0x7f519c07ff10 2020-01-16T05:44:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a0a5f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519c0a4830 con 0x7f519c0a4250 2020-01-16T05:44:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a0a5f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519c07f9d0 con 0x7f519c0a9b30 2020-01-16T05:44:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a1cc1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f519c0a4250 0x7f519c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f519b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f519c07ff10 0x7f519c0a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51162/0 (socket says 172.21.15.84:51162) 2020-01-16T05:44:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f519b7fe700 1 -- 172.21.15.84:0/1430867852 learned_addr learned my addr 172.21.15.84:0/1430867852 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f519bfff700 1 --2- 172.21.15.84:0/1430867852 >> v2:172.21.15.142:3300/0 conn(0x7f519c0a9b30 0x7f519c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f519affd700 1 -- 172.21.15.84:0/1430867852 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768522692 0 0) 0x7f519c066dd0 con 0x7f519c07ff10 2020-01-16T05:44:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f519affd700 1 -- 172.21.15.84:0/1430867852 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5188003230 con 0x7f519c07ff10 2020-01-16T05:44:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a1cc1700 1 -- 172.21.15.84:0/1430867852 >> v2:172.21.15.142:3300/0 conn(0x7f519c0a9b30 msgr2=0x7f519c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/1430867852 >> v2:172.21.15.142:3300/0 conn(0x7f519c0a9b30 0x7f519c0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a1cc1700 1 -- 172.21.15.84:0/1430867852 >> v1:172.21.15.84:6789/0 conn(0x7f519c07ff10 legacy=0x7f519c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:05.805 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a1cc1700 1 -- 172.21.15.84:0/1430867852 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c150ce0 con 0x7f519c0a4250 2020-01-16T05:44:05.805 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f519bfff700 1 --2- 172.21.15.84:0/1430867852 >> v2:172.21.15.142:3300/0 conn(0x7f519c0a9b30 0x7f519c0abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:44:05.805 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/1430867852 >> v2:172.21.15.84:3300/0 conn(0x7f519c0a4250 0x7f519c066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f519c0a49f0 tx=0x7f5194010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:05.805 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/1430867852 >> v2:172.21.15.84:3300/0 conn(0x7f519c0a4250 0x7f519c066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f519c0a49f0 tx=0x7f5194010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:05.805 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/1430867852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f519c0a4250 0x7f519c066880 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f519c0a49f0 tx=0x7f5194010170).ready entity=mon.0 client_cookie=dc2bc4ab8a4e0e67 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/1430867852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f519c0a4250 0x7f519c066880 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f519c0a49f0 tx=0x7f5194010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f519affd700 1 -- 172.21.15.84:0/1430867852 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f519400a160 con 0x7f519c0a4250 2020-01-16T05:44:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/1430867852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f519c0a4250 0x7f519c066880 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f519c0a49f0 tx=0x7f5194010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f519affd700 1 -- 172.21.15.84:0/1430867852 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5194011ab0 con 0x7f519c0a4250 2020-01-16T05:44:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/1430867852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f519c0a4250 0x7f519c066880 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f519c0a49f0 tx=0x7f5194010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:05.811 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f519affd700 1 -- 172.21.15.84:0/1430867852 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f519400a740 con 0x7f519c0a4250 2020-01-16T05:44:05.811 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a0a5f700 1 -- 172.21.15.84:0/1430867852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f519c0a4250 msgr2=0x7f519c066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:05.811 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.787+0000 7f51a0a5f700 1 --2- 172.21.15.84:0/1430867852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f519c0a4250 0x7f519c066880 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f519c0a49f0 tx=0x7f5194010170).stop 2020-01-16T05:44:05.811 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.791+0000 7f51a0a5f700 1 -- 172.21.15.84:0/1430867852 shutdown_connections 2020-01-16T05:44:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.791+0000 7f51a0a5f700 1 --2- 172.21.15.84:0/1430867852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f519c0a4250 0x7f519c066880 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.791+0000 7f51a0a5f700 1 --2- 172.21.15.84:0/1430867852 >> v2:172.21.15.142:3300/0 conn(0x7f519c0a9b30 0x7f519c0abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.791+0000 7f51a0a5f700 1 -- 172.21.15.84:0/1430867852 shutdown_connections 2020-01-16T05:44:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.791+0000 7f51a0a5f700 1 -- 172.21.15.84:0/1430867852 wait complete. 2020-01-16T05:44:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.791+0000 7f51a0a5f700 1 -- 172.21.15.84:0/1430867852 >> 172.21.15.84:0/1430867852 conn(0x7f519c0acfc0 msgr2=0x7f519c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.791+0000 7f51a0a5f700 1 Processor -- start 2020-01-16T05:44:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.791+0000 7f51a0a5f700 1 -- start start 2020-01-16T05:44:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f51a0a5f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f519c0a40f0 0x7f519c079210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f51a0a5f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f519c136000 0x7f519c0a85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f51a0a5f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519c0a8b30 con 0x7f519c135bd0 2020-01-16T05:44:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f51a0a5f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519c091600 con 0x7f519c136000 2020-01-16T05:44:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f51a0a5f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519c0918a0 con 0x7f519c0a40f0 2020-01-16T05:44:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f519b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f519c135bd0 0x7f519c0a7de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51170/0 (socket says 172.21.15.84:51170) 2020-01-16T05:44:05.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f519b7fe700 1 -- 172.21.15.84:0/3807320791 learned_addr learned my addr 172.21.15.84:0/3807320791 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:05.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/3807320791 >> v2:172.21.15.84:3300/0 conn(0x7f519c136000 0x7f519c0a85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:05.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f519bfff700 1 --2- 172.21.15.84:0/3807320791 >> v2:172.21.15.142:3300/0 conn(0x7f519c0a40f0 0x7f519c079210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:05.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f5198ff9700 1 -- 172.21.15.84:0/3807320791 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633870377 0 0) 0x7f519c0a8b30 con 0x7f519c135bd0 2020-01-16T05:44:05.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f5198ff9700 1 -- 172.21.15.84:0/3807320791 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5180003230 con 0x7f519c135bd0 2020-01-16T05:44:05.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f51a1cc1700 1 -- 172.21.15.84:0/3807320791 >> v2:172.21.15.142:3300/0 conn(0x7f519c0a40f0 msgr2=0x7f519c079210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:05.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/3807320791 >> v2:172.21.15.142:3300/0 conn(0x7f519c0a40f0 0x7f519c079210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:05.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f51a1cc1700 1 -- 172.21.15.84:0/3807320791 >> v1:172.21.15.84:6789/0 conn(0x7f519c135bd0 legacy=0x7f519c0a7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:05.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f51a1cc1700 1 -- 172.21.15.84:0/3807320791 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c0911d0 con 0x7f519c136000 2020-01-16T05:44:05.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/3807320791 >> v2:172.21.15.84:3300/0 conn(0x7f519c136000 0x7f519c0a85e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f519c0917c0 tx=0x7f5194011b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:05.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/3807320791 >> v2:172.21.15.84:3300/0 conn(0x7f519c136000 0x7f519c0a85e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f519c0917c0 tx=0x7f5194011b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:05.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/3807320791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f519c136000 0x7f519c0a85e0 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f519c0917c0 tx=0x7f5194011b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:05.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/3807320791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f519c136000 0x7f519c0a85e0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f519c0917c0 tx=0x7f5194011b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:05.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f5198ff9700 1 -- 172.21.15.84:0/3807320791 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5194005c30 con 0x7f519c136000 2020-01-16T05:44:05.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/3807320791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f519c136000 0x7f519c0a85e0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f519c0917c0 tx=0x7f5194011b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:05.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/3807320791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f519c136000 0x7f519c0a85e0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f519c0917c0 tx=0x7f5194011b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:05.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f5198ff9700 1 -- 172.21.15.84:0/3807320791 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519400a360 con 0x7f519c136000 2020-01-16T05:44:05.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f51a0a5f700 1 -- 172.21.15.84:0/3807320791 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519c136430 con 0x7f519c136000 2020-01-16T05:44:05.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f5198ff9700 1 -- 172.21.15.84:0/3807320791 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f519400ae00 con 0x7f519c136000 2020-01-16T05:44:05.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.795+0000 7f51a0a5f700 1 -- 172.21.15.84:0/3807320791 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519c13d2f0 con 0x7f519c136000 2020-01-16T05:44:05.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.799+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/3807320791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f519c136000 0x7f519c0a85e0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f519c0917c0 tx=0x7f5194011b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:05.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.799+0000 7f51a0a5f700 1 -- 172.21.15.84:0/3807320791 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519c05e1c0 con 0x7f519c136000 2020-01-16T05:44:05.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.799+0000 7f5198ff9700 1 -- 172.21.15.84:0/3807320791 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f5194007150 con 0x7f519c136000 2020-01-16T05:44:05.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.799+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/3807320791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f519c136000 0x7f519c0a85e0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f519c0917c0 tx=0x7f5194011b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:05.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.799+0000 7f5198ff9700 1 --2- 172.21.15.84:0/3807320791 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f518003c790 0x7f518003eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:05.818 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.799+0000 7f5198ff9700 1 -- 172.21.15.84:0/3807320791 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f519404d370 con 0x7f519c136000 2020-01-16T05:44:05.818 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.799+0000 7f519bfff700 1 --2- 172.21.15.84:0/3807320791 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f518003c790 0x7f518003eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:05.818 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.799+0000 7f519bfff700 1 --2- 172.21.15.84:0/3807320791 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f518003c790 0x7f518003eca0 crc :-1 s=READY pgs=42 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:05.819 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.803+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/3807320791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f519c136000 0x7f519c0a85e0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f519c0917c0 tx=0x7f5194011b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:05.819 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.803+0000 7f5198ff9700 1 -- 172.21.15.84:0/3807320791 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f5194033950 con 0x7f519c136000 2020-01-16T05:44:05.958 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.955+0000 7f51a0a5f700 1 -- 172.21.15.84:0/3807320791 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f519c05cbc0 con 0x7f519c136000 2020-01-16T05:44:05.958 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.959+0000 7f51a1cc1700 1 --2- 172.21.15.84:0/3807320791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f519c136000 0x7f519c0a85e0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f519c0917c0 tx=0x7f5194011b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:05.959 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.959+0000 7f5198ff9700 1 -- 172.21.15.84:0/3807320791 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1420 (secure 0 0 0) 0x7f5194033bb0 con 0x7f519c136000 2020-01-16T05:44:05.959 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:05.959 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:44:05.643232+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:44:05.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.959+0000 7f51a0a5f700 1 -- 172.21.15.84:0/3807320791 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f518003c790 msgr2=0x7f518003eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:05.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.959+0000 7f51a0a5f700 1 --2- 172.21.15.84:0/3807320791 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f518003c790 0x7f518003eca0 crc :-1 s=READY pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:05.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.959+0000 7f51a0a5f700 1 -- 172.21.15.84:0/3807320791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f519c136000 msgr2=0x7f519c0a85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:05.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.959+0000 7f51a0a5f700 1 --2- 172.21.15.84:0/3807320791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f519c136000 0x7f519c0a85e0 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f519c0917c0 tx=0x7f5194011b30).stop 2020-01-16T05:44:05.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.959+0000 7f51a0a5f700 1 -- 172.21.15.84:0/3807320791 shutdown_connections 2020-01-16T05:44:05.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.959+0000 7f51a0a5f700 1 --2- 172.21.15.84:0/3807320791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f519c136000 0x7f519c0a85e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:05.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.959+0000 7f51a0a5f700 1 --2- 172.21.15.84:0/3807320791 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f518003c790 0x7f518003eca0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:05.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.959+0000 7f51a0a5f700 1 --2- 172.21.15.84:0/3807320791 >> v2:172.21.15.142:3300/0 conn(0x7f519c0a40f0 0x7f519c079210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.959+0000 7f51a0a5f700 1 -- 172.21.15.84:0/3807320791 shutdown_connections 2020-01-16T05:44:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.959+0000 7f51a0a5f700 1 -- 172.21.15.84:0/3807320791 wait complete. 2020-01-16T05:44:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:05.959+0000 7f51a0a5f700 1 -- 172.21.15.84:0/3807320791 >> 172.21.15.84:0/3807320791 conn(0x7f519c0a4ad0 msgr2=0x7f519c07ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 3 2020-01-16T05:44:05.971 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-16T05:44:06.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.079+0000 7f65c5668700 1 Processor -- start 2020-01-16T05:44:06.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.079+0000 7f65c5668700 1 -- start start 2020-01-16T05:44:06.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.079+0000 7f65c5668700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f65c00a9b30 0x7f65c00abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:06.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.079+0000 7f65c5668700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00a4250 0x7f65c0066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:06.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.079+0000 7f65c5668700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c0066dd0 con 0x7f65c007ff10 2020-01-16T05:44:06.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.079+0000 7f65c5668700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c00a4830 con 0x7f65c00a9b30 2020-01-16T05:44:06.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.079+0000 7f65c5668700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c007f9d0 con 0x7f65c00a4250 2020-01-16T05:44:06.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.079+0000 7f65c4e67700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f65c00a9b30 0x7f65c00abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:06.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.079+0000 7f65c68ca700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00a4250 0x7f65c0066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:06.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.079+0000 7f65c4e67700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f65c00a9b30 0x7f65c00abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.84:43960/0 (socket says 172.21.15.84:43960) 2020-01-16T05:44:06.097 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.079+0000 7f65c4e67700 1 -- 172.21.15.84:0/2496402944 learned_addr learned my addr 172.21.15.84:0/2496402944 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:06.097 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.079+0000 7f65c68ca700 1 -- 172.21.15.84:0/2496402944 >> v2:172.21.15.142:3300/0 conn(0x7f65c00a9b30 msgr2=0x7f65c00abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:06.097 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.079+0000 7f65c68ca700 1 --2- 172.21.15.84:0/2496402944 >> v2:172.21.15.142:3300/0 conn(0x7f65c00a9b30 0x7f65c00abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:06.097 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.079+0000 7f65c68ca700 1 -- 172.21.15.84:0/2496402944 >> v1:172.21.15.142:6789/0 conn(0x7f65c007ff10 legacy=0x7f65c00a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.097 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.079+0000 7f65c68ca700 1 -- 172.21.15.84:0/2496402944 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c0150ce0 con 0x7f65c00a4250 2020-01-16T05:44:06.098 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.079+0000 7f65c68ca700 1 --2- 172.21.15.84:0/2496402944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00a4250 0x7f65c0066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f65b8008910 tx=0x7f65b800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.098 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.079+0000 7f65c68ca700 1 --2- 172.21.15.84:0/2496402944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00a4250 0x7f65c0066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f65b8008910 tx=0x7f65b800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.098 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.079+0000 7f65c68ca700 1 --2- 172.21.15.84:0/2496402944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00a4250 0x7f65c0066880 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f65b8008910 tx=0x7f65b800fdf0).ready entity=mon.2 client_cookie=607d01415bc84b01 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:06.098 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65c68ca700 1 --2- 172.21.15.84:0/2496402944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00a4250 0x7f65c0066880 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f65b8008910 tx=0x7f65b800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.098 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65bf7fe700 1 -- 172.21.15.84:0/2496402944 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65b8011660 con 0x7f65c00a4250 2020-01-16T05:44:06.098 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65c68ca700 1 --2- 172.21.15.84:0/2496402944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00a4250 0x7f65c0066880 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f65b8008910 tx=0x7f65b800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.098 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65c68ca700 1 --2- 172.21.15.84:0/2496402944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00a4250 0x7f65c0066880 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f65b8008910 tx=0x7f65b800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.099 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65bf7fe700 1 -- 172.21.15.84:0/2496402944 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b8008c50 con 0x7f65c00a4250 2020-01-16T05:44:06.099 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65bf7fe700 1 -- 172.21.15.84:0/2496402944 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65b8011c40 con 0x7f65c00a4250 2020-01-16T05:44:06.099 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65c5668700 1 -- 172.21.15.84:0/2496402944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00a4250 msgr2=0x7f65c0066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.099 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65c5668700 1 --2- 172.21.15.84:0/2496402944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00a4250 0x7f65c0066880 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f65b8008910 tx=0x7f65b800fdf0).stop 2020-01-16T05:44:06.099 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65c5668700 1 -- 172.21.15.84:0/2496402944 shutdown_connections 2020-01-16T05:44:06.099 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65c5668700 1 --2- 172.21.15.84:0/2496402944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00a4250 0x7f65c0066880 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:06.100 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65c5668700 1 --2- 172.21.15.84:0/2496402944 >> v2:172.21.15.142:3300/0 conn(0x7f65c00a9b30 0x7f65c00abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:06.100 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65c5668700 1 -- 172.21.15.84:0/2496402944 shutdown_connections 2020-01-16T05:44:06.100 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65c5668700 1 -- 172.21.15.84:0/2496402944 wait complete. 2020-01-16T05:44:06.100 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65c5668700 1 -- 172.21.15.84:0/2496402944 >> 172.21.15.84:0/2496402944 conn(0x7f65c00acfc0 msgr2=0x7f65c00a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:06.100 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65c5668700 1 Processor -- start 2020-01-16T05:44:06.100 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65c5668700 1 -- start start 2020-01-16T05:44:06.100 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65c5668700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f65c00a5660 0x7f65c0122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65c5668700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c0126da0 con 0x7f65c0126970 2020-01-16T05:44:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65c5668700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c0124a40 con 0x7f65c013b120 2020-01-16T05:44:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65c5668700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c0125a60 con 0x7f65c00a5660 2020-01-16T05:44:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65bffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f65c0126970 0x7f65c009f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51186/0 (socket says 172.21.15.84:51186) 2020-01-16T05:44:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65bffff700 1 -- 172.21.15.84:0/539608913 learned_addr learned my addr 172.21.15.84:0/539608913 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.083+0000 7f65c4e67700 1 --2- 172.21.15.84:0/539608913 >> v2:172.21.15.142:3300/0 conn(0x7f65c00a5660 0x7f65c0122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65bd7fa700 1 -- 172.21.15.84:0/539608913 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975683298 0 0) 0x7f65c0126da0 con 0x7f65c0126970 2020-01-16T05:44:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65bd7fa700 1 -- 172.21.15.84:0/539608913 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6598003230 con 0x7f65c0126970 2020-01-16T05:44:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65c4e67700 1 -- 172.21.15.84:0/539608913 >> v1:172.21.15.142:6789/0 conn(0x7f65c013b120 legacy=0x7f65c013d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65c4e67700 1 -- 172.21.15.84:0/539608913 >> v1:172.21.15.84:6789/0 conn(0x7f65c0126970 legacy=0x7f65c009f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65c4e67700 1 -- 172.21.15.84:0/539608913 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c00ab090 con 0x7f65c00a5660 2020-01-16T05:44:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65c4e67700 1 --2- 172.21.15.84:0/539608913 >> v2:172.21.15.142:3300/0 conn(0x7f65c00a5660 0x7f65c0122c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f65a8002f30 tx=0x7f65a8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65c4e67700 1 --2- 172.21.15.84:0/539608913 >> v2:172.21.15.142:3300/0 conn(0x7f65c00a5660 0x7f65c0122c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f65a8002f30 tx=0x7f65a8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65c4e67700 1 --2- 172.21.15.84:0/539608913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c00a5660 0x7f65c0122c40 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f65a8002f30 tx=0x7f65a8010bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:06.103 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65c4e67700 1 --2- 172.21.15.84:0/539608913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c00a5660 0x7f65c0122c40 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f65a8002f30 tx=0x7f65a8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.103 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65bd7fa700 1 -- 172.21.15.84:0/539608913 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65a8008a30 con 0x7f65c00a5660 2020-01-16T05:44:06.103 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65c4e67700 1 --2- 172.21.15.84:0/539608913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c00a5660 0x7f65c0122c40 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f65a8002f30 tx=0x7f65a8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.103 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65c4e67700 1 --2- 172.21.15.84:0/539608913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c00a5660 0x7f65c0122c40 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f65a8002f30 tx=0x7f65a8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.103 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65bd7fa700 1 -- 172.21.15.84:0/539608913 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a8005ab0 con 0x7f65c00a5660 2020-01-16T05:44:06.103 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65c5668700 1 -- 172.21.15.84:0/539608913 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c0125010 con 0x7f65c00a5660 2020-01-16T05:44:06.104 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65bd7fa700 1 -- 172.21.15.84:0/539608913 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65a8007350 con 0x7f65c00a5660 2020-01-16T05:44:06.104 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65c5668700 1 -- 172.21.15.84:0/539608913 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c013ed70 con 0x7f65c00a5660 2020-01-16T05:44:06.104 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65c4e67700 1 --2- 172.21.15.84:0/539608913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c00a5660 0x7f65c0122c40 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f65a8002f30 tx=0x7f65a8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.104 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65c4e67700 1 --2- 172.21.15.84:0/539608913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c00a5660 0x7f65c0122c40 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f65a8002f30 tx=0x7f65a8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.104 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65bd7fa700 1 -- 172.21.15.84:0/539608913 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f65a8012270 con 0x7f65c00a5660 2020-01-16T05:44:06.104 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65c5668700 1 -- 172.21.15.84:0/539608913 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c005e1c0 con 0x7f65c00a5660 2020-01-16T05:44:06.104 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65bd7fa700 1 --2- 172.21.15.84:0/539608913 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f659803c7e0 0x7f659803ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65bd7fa700 1 -- 172.21.15.84:0/539608913 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f65a804cb30 con 0x7f65c00a5660 2020-01-16T05:44:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65bffff700 1 --2- 172.21.15.84:0/539608913 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f659803c7e0 0x7f659803ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.087+0000 7f65bffff700 1 --2- 172.21.15.84:0/539608913 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f659803c7e0 0x7f659803ecf0 crc :-1 s=READY pgs=43 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.095+0000 7f65c4e67700 1 --2- 172.21.15.84:0/539608913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c00a5660 0x7f65c0122c40 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f65a8002f30 tx=0x7f65a8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.095+0000 7f65bd7fa700 1 -- 172.21.15.84:0/539608913 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f65a8033110 con 0x7f65c00a5660 2020-01-16T05:44:06.223 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.215+0000 7f65c5668700 1 -- 172.21.15.84:0/539608913 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65c005cbc0 con 0x7f65c00a5660 2020-01-16T05:44:06.223 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.219+0000 7f65c4e67700 1 --2- 172.21.15.84:0/539608913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c00a5660 0x7f65c0122c40 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f65a8002f30 tx=0x7f65a8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.223 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.219+0000 7f65bd7fa700 1 -- 172.21.15.84:0/539608913 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14672 (secure 0 0 0) 0x7f65a8033370 con 0x7f65c00a5660 2020-01-16T05:44:06.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.219+0000 7f65c5668700 1 -- 172.21.15.84:0/539608913 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f659803c7e0 msgr2=0x7f659803ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.219+0000 7f65c5668700 1 --2- 172.21.15.84:0/539608913 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f659803c7e0 0x7f659803ecf0 crc :-1 s=READY pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:06.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.219+0000 7f65c5668700 1 -- 172.21.15.84:0/539608913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c00a5660 msgr2=0x7f65c0122c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.219+0000 7f65c5668700 1 --2- 172.21.15.84:0/539608913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c00a5660 0x7f65c0122c40 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f65a8002f30 tx=0x7f65a8010bb0).stop 2020-01-16T05:44:06.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.219+0000 7f65c5668700 1 -- 172.21.15.84:0/539608913 shutdown_connections 2020-01-16T05:44:06.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.219+0000 7f65c5668700 1 --2- 172.21.15.84:0/539608913 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f659803c7e0 0x7f659803ecf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:06.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.219+0000 7f65c5668700 1 --2- 172.21.15.84:0/539608913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c00a5660 0x7f65c0122c40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:06.225 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.219+0000 7f65c5668700 1 -- 172.21.15.84:0/539608913 shutdown_connections 2020-01-16T05:44:06.225 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.219+0000 7f65c5668700 1 -- 172.21.15.84:0/539608913 wait complete. 2020-01-16T05:44:06.225 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.219+0000 7f65c5668700 1 -- 172.21.15.84:0/539608913 >> 172.21.15.84:0/539608913 conn(0x7f65c0066650 msgr2=0x7f65c007cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:06.225 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:06.226 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"cbc67508-4d2a-4483-a1fc-95d371063ac4","created":"2020-01-16T05:43:46.771497+0000","modified":"2020-01-16T05:44:05.941278+0000","last_up_change":"2020-01-16T05:43:55.529492+0000","last_in_change":"2020-01-16T05:43:55.529492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-16T05:43:59.152708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-16T05:44:01.682783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-16T05:44:02.930765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15da60bb-4d16-44cc-80c6-cd2c7fa77364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":12644},{"type":"v1","addr":"172.21.15.84:6812","nonce":12644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":12644},{"type":"v1","addr":"172.21.15.84:6816","nonce":12644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":12644},{"type":"v1","addr":"172.21.15.84:6824","nonce":12644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":12644},{"type":"v1","addr":"172.21.15.84:6820","nonce":12644}]},"public_addr":"172.21.15.84:6812/12644","cluster_addr":"172.21.15.84:6816/12644","heartbeat_back_addr":"172.21.15.84:6824/12644","heartbeat_front_addr":"172.21.15.84:6820/12644","state":["exists","up"]},{"osd":1,"uuid":"0800533c-1d5b-4f9f-99bb-34b8133c8b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":12645},{"type":"v1","addr":"172.21.15.84:6803","nonce":12645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":12645},{"type":"v1","addr":"172.21.15.84:6805","nonce":12645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":12645},{"type":"v1","addr":"172.21.15.84:6809","nonce":12645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":12645},{"type":"v1","addr":"172.21.15.84:6807","nonce":12645}]},"public_addr":"172.21.15.84:6803/12645","cluster_addr":"172.21.15.84:6805/12645","heartbeat_back_addr":"172.21.15.84:6809/12645","heartbeat_front_addr":"172.21.15.84:6807/12645","state":["exists","up"]},{"osd":2,"uuid":"519cc27f-5cf9-4ecf-ad66-f722c37339df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":12646},{"type":"v1","addr":"172.21.15.84:6813","nonce":12646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6815","nonce":12646},{"type":"v1","addr":"172.21.15.84:6817","nonce":12646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":12646},{"type":"v1","addr":"172.21.15.84:6825","nonce":12646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":12646},{"type":"v1","addr":"172.21.15.84:6821","nonce":12646}]},"public_addr":"172.21.15.84:6813/12646","cluster_addr":"172.21.15.84:6817/12646","heartbeat_back_addr":"172.21.15.84:6825/12646","heartbeat_front_addr":"172.21.15.84:6821/12646","state":["exists","up"]},{"osd":3,"uuid":"aec305a6-bbac-4e01-8ea1-6077d49e27e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":12647},{"type":"v1","addr":"172.21.15.84:6827","nonce":12647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":12647},{"type":"v1","addr":"172.21.15.84:6829","nonce":12647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":12647},{"type":"v1","addr":"172.21.15.84:6833","nonce":12647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":12647},{"type":"v1","addr":"172.21.15.84:6831","nonce":12647}]},"public_addr":"172.21.15.84:6827/12647","cluster_addr":"172.21.15.84:6829/12647","heartbeat_back_addr":"172.21.15.84:6833/12647","heartbeat_front_addr":"172.21.15.84:6831/12647","state":["exists","up"]},{"osd":4,"uuid":"aaec7f3e-299a-4546-8406-207bcc4b3afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":12842},{"type":"v1","addr":"172.21.15.142:6801","nonce":12842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12842},{"type":"v1","addr":"172.21.15.142:6803","nonce":12842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12842},{"type":"v1","addr":"172.21.15.142:6807","nonce":12842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12842},{"type":"v1","addr":"172.21.15.142:6805","nonce":12842}]},"public_addr":"172.21.15.142:6801/12842","cluster_addr":"172.21.15.142:6803/12842","heartbeat_back_addr":"172.21.15.142:6807/12842","heartbeat_front_addr":"172.21.15.142:6805/12842","state":["exists","up"]},{"osd":5,"uuid":"5a942a47-7346-46d4-adf8-dad2bdb95aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12843},{"type":"v1","addr":"172.21.15.142:6809","nonce":12843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12843},{"type":"v1","addr":"172.21.15.142:6811","nonce":12843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12843},{"type":"v1","addr":"172.21.15.142:6815","nonce":12843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12843},{"type":"v1","addr":"172.21.15.142:6813","nonce":12843}]},"public_addr":"172.21.15.142:6809/12843","cluster_addr":"172.21.15.142:6811/12843","heartbeat_back_addr":"172.21.15.142:6815/12843","heartbeat_front_addr":"172.21.15.142:6813/12843","state":["exists","up"]},{"osd":6,"uuid":"c69fca67-66e4-4c31-ab03-1419e2a83e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12844},{"type":"v1","addr":"172.21.15.142:6818","nonce":12844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":12844},{"type":"v1","addr":"172.21.15.142:6823","nonce":12844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":12844},{"type":"v1","addr":"172.21.15.142:6831","nonce":12844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":12844},{"type":"v1","addr":"172.21.15.142:6827","nonce":12844}]},"public_addr":"172.21.15.142:6818/12844","cluster_addr":"172.21.15.142:6823/12844","heartbeat_back_addr":"172.21.15.142:6831/12844","heartbeat_front_addr":"172.21.15.142:6827/12844","state":["exists","up"]},{"osd":7,"uuid":"c436f64e-aa1f-435b-ac7b-85633e297591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":12845},{"type":"v1","addr":"172.21.15.142:6819","nonce":12845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12845},{"type":"v1","addr":"172.21.15.142:6822","nonce":12845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12845},{"type":"v1","addr":"172.21.15.142:6830","nonce":12845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12845},{"type":"v1","addr":"172.21.15.142:6826","nonce":12845}]},"public_addr":"172.21.15.142:6819/12845","cluster_addr":"172.21.15.142:6822/12845","heartbeat_back_addr":"172.21.15.142:6830/12845","heartbeat_front_addr":"172.21.15.142:6826/12845","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.534744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.505453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.485516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.333028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.483323+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.567824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.273268+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.559741+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-16T05:44:06.233 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-01-16T05:44:06.233 INFO:tasks.ceph.mds.a:Restarting daemon 2020-01-16T05:44:06.233 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-01-16T05:44:06.236 INFO:tasks.ceph.mds.a:Started 2020-01-16T05:44:06.236 INFO:tasks.ceph.mds.b:Restarting daemon 2020-01-16T05:44:06.236 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-01-16T05:44:06.238 INFO:tasks.ceph.mds.b:Started 2020-01-16T05:44:06.239 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-16T05:44:06.239 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-01-16T05:44:06.306 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2020-01-16T05:44:06.315 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2020-01-16T05:44:06.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.339+0000 7fde83fff700 1 Processor -- start 2020-01-16T05:44:06.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.339+0000 7fde83fff700 1 -- start start 2020-01-16T05:44:06.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.339+0000 7fde83fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde840a9b30 0x7fde840abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:06.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.339+0000 7fde83fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde84066880 con 0x7fde8407ff10 2020-01-16T05:44:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.339+0000 7fde83fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde84066ab0 con 0x7fde840a4250 2020-01-16T05:44:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.339+0000 7fde83fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde840a4830 con 0x7fde840a9b30 2020-01-16T05:44:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde82ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fde8407ff10 0x7fde840a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51204/0 (socket says 172.21.15.84:51204) 2020-01-16T05:44:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde82ffd700 1 -- 172.21.15.84:0/4186159081 learned_addr learned my addr 172.21.15.84:0/4186159081 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde837fe700 1 --2- 172.21.15.84:0/4186159081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde840a9b30 0x7fde840abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde827fc700 1 -- 172.21.15.84:0/4186159081 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274310848 0 0) 0x7fde84066880 con 0x7fde8407ff10 2020-01-16T05:44:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde827fc700 1 -- 172.21.15.84:0/4186159081 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde6c003230 con 0x7fde8407ff10 2020-01-16T05:44:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde827fc700 1 -- 172.21.15.84:0/4186159081 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069749014 0 0) 0x7fde84066ab0 con 0x7fde840a4250 2020-01-16T05:44:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde827fc700 1 -- 172.21.15.84:0/4186159081 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde84066880 con 0x7fde840a4250 2020-01-16T05:44:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde827fc700 1 -- 172.21.15.84:0/4186159081 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4282463577 0 0) 0x7fde6c003230 con 0x7fde8407ff10 2020-01-16T05:44:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde837fe700 1 -- 172.21.15.84:0/4186159081 >> v1:172.21.15.142:6789/0 conn(0x7fde840a4250 legacy=0x7fde8414fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde837fe700 1 -- 172.21.15.84:0/4186159081 >> v1:172.21.15.84:6789/0 conn(0x7fde8407ff10 legacy=0x7fde840a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde837fe700 1 -- 172.21.15.84:0/4186159081 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde84066ce0 con 0x7fde840a9b30 2020-01-16T05:44:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde837fe700 1 --2- 172.21.15.84:0/4186159081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde840a9b30 0x7fde840abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fde74001990 tx=0x7fde740014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde837fe700 1 --2- 172.21.15.84:0/4186159081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde840a9b30 0x7fde840abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fde74001990 tx=0x7fde740014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde837fe700 1 --2- 172.21.15.84:0/4186159081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde840a9b30 0x7fde840abdd0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7fde74001990 tx=0x7fde740014a0).ready entity=mon.2 client_cookie=2be078018c4c253d server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde837fe700 1 --2- 172.21.15.84:0/4186159081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde840a9b30 0x7fde840abdd0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7fde74001990 tx=0x7fde740014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde827fc700 1 -- 172.21.15.84:0/4186159081 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde74001750 con 0x7fde840a9b30 2020-01-16T05:44:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde837fe700 1 --2- 172.21.15.84:0/4186159081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde840a9b30 0x7fde840abdd0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7fde74001990 tx=0x7fde740014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde827fc700 1 -- 172.21.15.84:0/4186159081 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde74001560 con 0x7fde840a9b30 2020-01-16T05:44:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde837fe700 1 --2- 172.21.15.84:0/4186159081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde840a9b30 0x7fde840abdd0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7fde74001990 tx=0x7fde740014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde827fc700 1 -- 172.21.15.84:0/4186159081 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde7c00a350 con 0x7fde840a9b30 2020-01-16T05:44:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde83fff700 1 -- 172.21.15.84:0/4186159081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde840a9b30 msgr2=0x7fde840abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde83fff700 1 --2- 172.21.15.84:0/4186159081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde840a9b30 0x7fde840abdd0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7fde74001990 tx=0x7fde740014a0).stop 2020-01-16T05:44:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde83fff700 1 -- 172.21.15.84:0/4186159081 shutdown_connections 2020-01-16T05:44:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde83fff700 1 --2- 172.21.15.84:0/4186159081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde840a9b30 0x7fde840abdd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde83fff700 1 -- 172.21.15.84:0/4186159081 shutdown_connections 2020-01-16T05:44:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde83fff700 1 -- 172.21.15.84:0/4186159081 wait complete. 2020-01-16T05:44:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.343+0000 7fde83fff700 1 -- 172.21.15.84:0/4186159081 >> 172.21.15.84:0/4186159081 conn(0x7fde840acfc0 msgr2=0x7fde840a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:06.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde83fff700 1 Processor -- start 2020-01-16T05:44:06.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde83fff700 1 -- start start 2020-01-16T05:44:06.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde83fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fde840a8400 0x7fde8407c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:06.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde83fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fde8409f300 0x7fde8409f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:06.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde83fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8409fc80 con 0x7fde840a22e0 2020-01-16T05:44:06.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde83fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde840a28a0 con 0x7fde840a8400 2020-01-16T05:44:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde83fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde840a1a20 con 0x7fde8409f300 2020-01-16T05:44:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde837fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fde840a8400 0x7fde8407c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde837fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fde840a8400 0x7fde8407c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34008/0 (socket says 172.21.15.84:34008) 2020-01-16T05:44:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde837fe700 1 -- 172.21.15.84:0/3918275833 learned_addr learned my addr 172.21.15.84:0/3918275833 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde89928700 1 --2- 172.21.15.84:0/3918275833 >> v2:172.21.15.142:3300/0 conn(0x7fde8409f300 0x7fde8409f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde837fe700 1 -- 172.21.15.84:0/3918275833 >> v2:172.21.15.142:3300/0 conn(0x7fde8409f300 msgr2=0x7fde8409f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde837fe700 1 --2- 172.21.15.84:0/3918275833 >> v2:172.21.15.142:3300/0 conn(0x7fde8409f300 0x7fde8409f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde837fe700 1 -- 172.21.15.84:0/3918275833 >> v1:172.21.15.142:6789/0 conn(0x7fde840a22e0 legacy=0x7fde840a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde837fe700 1 -- 172.21.15.84:0/3918275833 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde84134a90 con 0x7fde840a8400 2020-01-16T05:44:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde837fe700 1 --2- 172.21.15.84:0/3918275833 >> v2:172.21.15.84:3300/0 conn(0x7fde840a8400 0x7fde8407c610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fde74001990 tx=0x7fde7c011ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde837fe700 1 --2- 172.21.15.84:0/3918275833 >> v2:172.21.15.84:3300/0 conn(0x7fde840a8400 0x7fde8407c610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fde74001990 tx=0x7fde7c011ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde837fe700 1 --2- 172.21.15.84:0/3918275833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840a8400 0x7fde8407c610 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7fde74001990 tx=0x7fde7c011ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde837fe700 1 --2- 172.21.15.84:0/3918275833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840a8400 0x7fde8407c610 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fde74001990 tx=0x7fde7c011ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde837fe700 1 --2- 172.21.15.84:0/3918275833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840a8400 0x7fde8407c610 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fde74001990 tx=0x7fde7c011ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde6bfff700 1 -- 172.21.15.84:0/3918275833 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde7c00ac40 con 0x7fde840a8400 2020-01-16T05:44:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde837fe700 1 --2- 172.21.15.84:0/3918275833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840a8400 0x7fde8407c610 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fde74001990 tx=0x7fde7c011ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde6bfff700 1 -- 172.21.15.84:0/3918275833 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c011c50 con 0x7fde840a8400 2020-01-16T05:44:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde83fff700 1 -- 172.21.15.84:0/3918275833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde840a3300 con 0x7fde840a8400 2020-01-16T05:44:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde6bfff700 1 -- 172.21.15.84:0/3918275833 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde7c007150 con 0x7fde840a8400 2020-01-16T05:44:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde83fff700 1 -- 172.21.15.84:0/3918275833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8407cfc0 con 0x7fde840a8400 2020-01-16T05:44:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.347+0000 7fde837fe700 1 --2- 172.21.15.84:0/3918275833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840a8400 0x7fde8407c610 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fde74001990 tx=0x7fde7c011ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.351+0000 7fde6bfff700 1 -- 172.21.15.84:0/3918275833 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fde7c007460 con 0x7fde840a8400 2020-01-16T05:44:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.351+0000 7fde837fe700 1 --2- 172.21.15.84:0/3918275833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840a8400 0x7fde8407c610 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fde74001990 tx=0x7fde7c011ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.351+0000 7fde83fff700 1 -- 172.21.15.84:0/3918275833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8405e1c0 con 0x7fde840a8400 2020-01-16T05:44:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.351+0000 7fde6bfff700 1 --2- 172.21.15.84:0/3918275833 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fde6403c280 0x7fde6403e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.351+0000 7fde6bfff700 1 -- 172.21.15.84:0/3918275833 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7fde7c091400 con 0x7fde840a8400 2020-01-16T05:44:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.351+0000 7fde82ffd700 1 --2- 172.21.15.84:0/3918275833 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fde6403c280 0x7fde6403e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.351+0000 7fde82ffd700 1 --2- 172.21.15.84:0/3918275833 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fde6403c280 0x7fde6403e790 crc :-1 s=READY pgs=44 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.355+0000 7fde837fe700 1 --2- 172.21.15.84:0/3918275833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840a8400 0x7fde8407c610 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fde74001990 tx=0x7fde7c011ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.355+0000 7fde6bfff700 1 -- 172.21.15.84:0/3918275833 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fde7c077a20 con 0x7fde840a8400 2020-01-16T05:44:06.478 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.471+0000 7fde83fff700 1 -- 172.21.15.84:0/3918275833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde8405f1e0 con 0x7fde840a8400 2020-01-16T05:44:06.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.471+0000 7fde837fe700 1 --2- 172.21.15.84:0/3918275833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840a8400 0x7fde8407c610 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fde74001990 tx=0x7fde7c011ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.471+0000 7fde6bfff700 1 -- 172.21.15.84:0/3918275833 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14672 (secure 0 0 0) 0x7fde7c077c80 con 0x7fde840a8400 2020-01-16T05:44:06.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.475+0000 7fde83fff700 1 -- 172.21.15.84:0/3918275833 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fde6403c280 msgr2=0x7fde6403e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.475+0000 7fde83fff700 1 --2- 172.21.15.84:0/3918275833 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fde6403c280 0x7fde6403e790 crc :-1 s=READY pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:06.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.475+0000 7fde83fff700 1 -- 172.21.15.84:0/3918275833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840a8400 msgr2=0x7fde8407c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.475+0000 7fde83fff700 1 --2- 172.21.15.84:0/3918275833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840a8400 0x7fde8407c610 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7fde74001990 tx=0x7fde7c011ae0).stop 2020-01-16T05:44:06.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.475+0000 7fde83fff700 1 -- 172.21.15.84:0/3918275833 shutdown_connections 2020-01-16T05:44:06.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.475+0000 7fde83fff700 1 --2- 172.21.15.84:0/3918275833 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fde6403c280 0x7fde6403e790 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:06.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.475+0000 7fde83fff700 1 --2- 172.21.15.84:0/3918275833 >> v2:172.21.15.142:3300/0 conn(0x7fde8409f300 0x7fde8409f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:06.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.475+0000 7fde83fff700 1 --2- 172.21.15.84:0/3918275833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840a8400 0x7fde8407c610 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:06.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.475+0000 7fde83fff700 1 -- 172.21.15.84:0/3918275833 shutdown_connections 2020-01-16T05:44:06.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.475+0000 7fde83fff700 1 -- 172.21.15.84:0/3918275833 wait complete. 2020-01-16T05:44:06.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.475+0000 7fde83fff700 1 -- 172.21.15.84:0/3918275833 >> 172.21.15.84:0/3918275833 conn(0x7fde8407f150 msgr2=0x7fde840a4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:06.481 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:06.481 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"cbc67508-4d2a-4483-a1fc-95d371063ac4","created":"2020-01-16T05:43:46.771497+0000","modified":"2020-01-16T05:44:05.941278+0000","last_up_change":"2020-01-16T05:43:55.529492+0000","last_in_change":"2020-01-16T05:43:55.529492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-16T05:43:59.152708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-16T05:44:01.682783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-16T05:44:02.930765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15da60bb-4d16-44cc-80c6-cd2c7fa77364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":12644},{"type":"v1","addr":"172.21.15.84:6812","nonce":12644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":12644},{"type":"v1","addr":"172.21.15.84:6816","nonce":12644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":12644},{"type":"v1","addr":"172.21.15.84:6824","nonce":12644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":12644},{"type":"v1","addr":"172.21.15.84:6820","nonce":12644}]},"public_addr":"172.21.15.84:6812/12644","cluster_addr":"172.21.15.84:6816/12644","heartbeat_back_addr":"172.21.15.84:6824/12644","heartbeat_front_addr":"172.21.15.84:6820/12644","state":["exists","up"]},{"osd":1,"uuid":"0800533c-1d5b-4f9f-99bb-34b8133c8b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":12645},{"type":"v1","addr":"172.21.15.84:6803","nonce":12645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":12645},{"type":"v1","addr":"172.21.15.84:6805","nonce":12645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":12645},{"type":"v1","addr":"172.21.15.84:6809","nonce":12645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":12645},{"type":"v1","addr":"172.21.15.84:6807","nonce":12645}]},"public_addr":"172.21.15.84:6803/12645","cluster_addr":"172.21.15.84:6805/12645","heartbeat_back_addr":"172.21.15.84:6809/12645","heartbeat_front_addr":"172.21.15.84:6807/12645","state":["exists","up"]},{"osd":2,"uuid":"519cc27f-5cf9-4ecf-ad66-f722c37339df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":12646},{"type":"v1","addr":"172.21.15.84:6813","nonce":12646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6815","nonce":12646},{"type":"v1","addr":"172.21.15.84:6817","nonce":12646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":12646},{"type":"v1","addr":"172.21.15.84:6825","nonce":12646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":12646},{"type":"v1","addr":"172.21.15.84:6821","nonce":12646}]},"public_addr":"172.21.15.84:6813/12646","cluster_addr":"172.21.15.84:6817/12646","heartbeat_back_addr":"172.21.15.84:6825/12646","heartbeat_front_addr":"172.21.15.84:6821/12646","state":["exists","up"]},{"osd":3,"uuid":"aec305a6-bbac-4e01-8ea1-6077d49e27e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":12647},{"type":"v1","addr":"172.21.15.84:6827","nonce":12647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":12647},{"type":"v1","addr":"172.21.15.84:6829","nonce":12647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":12647},{"type":"v1","addr":"172.21.15.84:6833","nonce":12647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":12647},{"type":"v1","addr":"172.21.15.84:6831","nonce":12647}]},"public_addr":"172.21.15.84:6827/12647","cluster_addr":"172.21.15.84:6829/12647","heartbeat_back_addr":"172.21.15.84:6833/12647","heartbeat_front_addr":"172.21.15.84:6831/12647","state":["exists","up"]},{"osd":4,"uuid":"aaec7f3e-299a-4546-8406-207bcc4b3afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":12842},{"type":"v1","addr":"172.21.15.142:6801","nonce":12842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12842},{"type":"v1","addr":"172.21.15.142:6803","nonce":12842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12842},{"type":"v1","addr":"172.21.15.142:6807","nonce":12842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12842},{"type":"v1","addr":"172.21.15.142:6805","nonce":12842}]},"public_addr":"172.21.15.142:6801/12842","cluster_addr":"172.21.15.142:6803/12842","heartbeat_back_addr":"172.21.15.142:6807/12842","heartbeat_front_addr":"172.21.15.142:6805/12842","state":["exists","up"]},{"osd":5,"uuid":"5a942a47-7346-46d4-adf8-dad2bdb95aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12843},{"type":"v1","addr":"172.21.15.142:6809","nonce":12843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12843},{"type":"v1","addr":"172.21.15.142:6811","nonce":12843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12843},{"type":"v1","addr":"172.21.15.142:6815","nonce":12843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12843},{"type":"v1","addr":"172.21.15.142:6813","nonce":12843}]},"public_addr":"172.21.15.142:6809/12843","cluster_addr":"172.21.15.142:6811/12843","heartbeat_back_addr":"172.21.15.142:6815/12843","heartbeat_front_addr":"172.21.15.142:6813/12843","state":["exists","up"]},{"osd":6,"uuid":"c69fca67-66e4-4c31-ab03-1419e2a83e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12844},{"type":"v1","addr":"172.21.15.142:6818","nonce":12844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":12844},{"type":"v1","addr":"172.21.15.142:6823","nonce":12844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":12844},{"type":"v1","addr":"172.21.15.142:6831","nonce":12844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":12844},{"type":"v1","addr":"172.21.15.142:6827","nonce":12844}]},"public_addr":"172.21.15.142:6818/12844","cluster_addr":"172.21.15.142:6823/12844","heartbeat_back_addr":"172.21.15.142:6831/12844","heartbeat_front_addr":"172.21.15.142:6827/12844","state":["exists","up"]},{"osd":7,"uuid":"c436f64e-aa1f-435b-ac7b-85633e297591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":12845},{"type":"v1","addr":"172.21.15.142:6819","nonce":12845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12845},{"type":"v1","addr":"172.21.15.142:6822","nonce":12845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12845},{"type":"v1","addr":"172.21.15.142:6830","nonce":12845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12845},{"type":"v1","addr":"172.21.15.142:6826","nonce":12845}]},"public_addr":"172.21.15.142:6819/12845","cluster_addr":"172.21.15.142:6822/12845","heartbeat_back_addr":"172.21.15.142:6830/12845","heartbeat_front_addr":"172.21.15.142:6826/12845","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.534744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.505453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.485516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.333028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.483323+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.567824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.273268+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.559741+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-16T05:44:06.488 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:43:59.152708+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:44:01.682783+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:44:02.930765+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-16T05:44:06.489 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-16T05:44:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.615+0000 7f5bca374700 1 Processor -- start 2020-01-16T05:44:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.615+0000 7f5bca374700 1 -- start start 2020-01-16T05:44:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.615+0000 7f5bca374700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5bc40a9b30 0x7f5bc40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.615+0000 7f5bca374700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc407ff10 0x7f5bc4066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.615+0000 7f5bca374700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc4066dd0 con 0x7f5bc40a4250 2020-01-16T05:44:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.615+0000 7f5bca374700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc40a4830 con 0x7f5bc40a9b30 2020-01-16T05:44:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.615+0000 7f5bca374700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc407f9d0 con 0x7f5bc407ff10 2020-01-16T05:44:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc9372700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc407ff10 0x7f5bc4066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc9372700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc407ff10 0x7f5bc4066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:46262/0 (socket says 172.21.15.84:46262) 2020-01-16T05:44:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc9b73700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5bc40a9b30 0x7f5bc40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc9372700 1 -- 172.21.15.84:0/4196556186 learned_addr learned my addr 172.21.15.84:0/4196556186 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc9b73700 1 -- 172.21.15.84:0/4196556186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc407ff10 msgr2=0x7f5bc4066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc9b73700 1 --2- 172.21.15.84:0/4196556186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc407ff10 0x7f5bc4066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc9b73700 1 -- 172.21.15.84:0/4196556186 >> v1:172.21.15.142:6789/0 conn(0x7f5bc40a4250 legacy=0x7f5bc40a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc9b73700 1 -- 172.21.15.84:0/4196556186 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc4150ce0 con 0x7f5bc40a9b30 2020-01-16T05:44:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc8b71700 1 -- 172.21.15.84:0/4196556186 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123375532 0 0) 0x7f5bc4066dd0 con 0x7f5bc40a4250 2020-01-16T05:44:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc9372700 1 --2- 172.21.15.84:0/4196556186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc407ff10 0x7f5bc4066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc9b73700 1 --2- 172.21.15.84:0/4196556186 >> v2:172.21.15.142:3300/0 conn(0x7f5bc40a9b30 0x7f5bc40abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5bb8008c90 tx=0x7f5bb8010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc9b73700 1 --2- 172.21.15.84:0/4196556186 >> v2:172.21.15.142:3300/0 conn(0x7f5bc40a9b30 0x7f5bc40abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5bb8008c90 tx=0x7f5bb8010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc9b73700 1 --2- 172.21.15.84:0/4196556186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bc40a9b30 0x7f5bc40abdd0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f5bb8008c90 tx=0x7f5bb8010170).ready entity=mon.1 client_cookie=3e88800eecfd74c7 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc9b73700 1 --2- 172.21.15.84:0/4196556186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bc40a9b30 0x7f5bc40abdd0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f5bb8008c90 tx=0x7f5bb8010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc8b71700 1 -- 172.21.15.84:0/4196556186 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bb800a160 con 0x7f5bc40a9b30 2020-01-16T05:44:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc9b73700 1 --2- 172.21.15.84:0/4196556186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bc40a9b30 0x7f5bc40abdd0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f5bb8008c90 tx=0x7f5bb8010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc8b71700 1 -- 172.21.15.84:0/4196556186 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb8011af0 con 0x7f5bc40a9b30 2020-01-16T05:44:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc9b73700 1 --2- 172.21.15.84:0/4196556186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bc40a9b30 0x7f5bc40abdd0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f5bb8008c90 tx=0x7f5bb8010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bc8b71700 1 -- 172.21.15.84:0/4196556186 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bb800a740 con 0x7f5bc40a9b30 2020-01-16T05:44:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bca374700 1 -- 172.21.15.84:0/4196556186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bc40a9b30 msgr2=0x7f5bc40abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bca374700 1 --2- 172.21.15.84:0/4196556186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bc40a9b30 0x7f5bc40abdd0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f5bb8008c90 tx=0x7f5bb8010170).stop 2020-01-16T05:44:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bca374700 1 -- 172.21.15.84:0/4196556186 shutdown_connections 2020-01-16T05:44:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bca374700 1 --2- 172.21.15.84:0/4196556186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bc40a9b30 0x7f5bc40abdd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bca374700 1 --2- 172.21.15.84:0/4196556186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc407ff10 0x7f5bc4066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bca374700 1 -- 172.21.15.84:0/4196556186 shutdown_connections 2020-01-16T05:44:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bca374700 1 -- 172.21.15.84:0/4196556186 wait complete. 2020-01-16T05:44:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.619+0000 7f5bca374700 1 -- 172.21.15.84:0/4196556186 >> 172.21.15.84:0/4196556186 conn(0x7f5bc40acfc0 msgr2=0x7f5bc40a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:06.632 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bca374700 1 Processor -- start 2020-01-16T05:44:06.632 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bca374700 1 -- start start 2020-01-16T05:44:06.632 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bca374700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc409f320 0x7f5bc409f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:06.632 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bca374700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5bc407ebc0 0x7f5bc407eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:06.632 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bca374700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc409fca0 con 0x7f5bc4091510 2020-01-16T05:44:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bca374700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc41367b0 con 0x7f5bc407ebc0 2020-01-16T05:44:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bca374700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc4136a50 con 0x7f5bc409f320 2020-01-16T05:44:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bc9372700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc409f320 0x7f5bc409f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bcb5d6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5bc407ebc0 0x7f5bc407eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bcb5d6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5bc407ebc0 0x7f5bc407eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.84:44010/0 (socket says 172.21.15.84:44010) 2020-01-16T05:44:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bc9b73700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5bc4091510 0x7f5bc4135bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:49450/0 (socket says 172.21.15.84:49450) 2020-01-16T05:44:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bc9372700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc409f320 0x7f5bc409f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:46272/0 (socket says 172.21.15.84:46272) 2020-01-16T05:44:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bcb5d6700 1 -- 172.21.15.84:0/3694597970 learned_addr learned my addr 172.21.15.84:0/3694597970 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bc9372700 1 -- 172.21.15.84:0/3694597970 >> v2:172.21.15.142:3300/0 conn(0x7f5bc407ebc0 msgr2=0x7f5bc407eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bc9372700 1 --2- 172.21.15.84:0/3694597970 >> v2:172.21.15.142:3300/0 conn(0x7f5bc407ebc0 0x7f5bc407eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bc9372700 1 -- 172.21.15.84:0/3694597970 >> v1:172.21.15.142:6789/0 conn(0x7f5bc4091510 legacy=0x7f5bc4135bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bc9372700 1 -- 172.21.15.84:0/3694597970 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc41363c0 con 0x7f5bc409f320 2020-01-16T05:44:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bc9372700 1 --2- 172.21.15.84:0/3694597970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc409f320 0x7f5bc409f750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5bc0002f30 tx=0x7f5bc0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bc9372700 1 --2- 172.21.15.84:0/3694597970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc409f320 0x7f5bc409f750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5bc0002f30 tx=0x7f5bc0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bc9372700 1 --2- 172.21.15.84:0/3694597970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc409f320 0x7f5bc409f750 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f5bc0002f30 tx=0x7f5bc0010ef0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bc9372700 1 --2- 172.21.15.84:0/3694597970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc409f320 0x7f5bc409f750 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f5bc0002f30 tx=0x7f5bc0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bb67fc700 1 -- 172.21.15.84:0/3694597970 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bc0007540 con 0x7f5bc409f320 2020-01-16T05:44:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bc9372700 1 --2- 172.21.15.84:0/3694597970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc409f320 0x7f5bc409f750 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f5bc0002f30 tx=0x7f5bc0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bc9372700 1 --2- 172.21.15.84:0/3694597970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc409f320 0x7f5bc409f750 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f5bc0002f30 tx=0x7f5bc0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bb67fc700 1 -- 172.21.15.84:0/3694597970 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc0007160 con 0x7f5bc409f320 2020-01-16T05:44:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bca374700 1 -- 172.21.15.84:0/3694597970 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc407f540 con 0x7f5bc409f320 2020-01-16T05:44:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bb67fc700 1 -- 172.21.15.84:0/3694597970 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bc00058d0 con 0x7f5bc409f320 2020-01-16T05:44:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.623+0000 7f5bca374700 1 -- 172.21.15.84:0/3694597970 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc413d010 con 0x7f5bc409f320 2020-01-16T05:44:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.627+0000 7f5bc9372700 1 --2- 172.21.15.84:0/3694597970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc409f320 0x7f5bc409f750 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f5bc0002f30 tx=0x7f5bc0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.627+0000 7f5bca374700 1 -- 172.21.15.84:0/3694597970 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc405e1c0 con 0x7f5bc409f320 2020-01-16T05:44:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.627+0000 7f5bb67fc700 1 -- 172.21.15.84:0/3694597970 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f5bc0005c30 con 0x7f5bc409f320 2020-01-16T05:44:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.627+0000 7f5bc9372700 1 --2- 172.21.15.84:0/3694597970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc409f320 0x7f5bc409f750 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f5bc0002f30 tx=0x7f5bc0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.627+0000 7f5bb67fc700 1 --2- 172.21.15.84:0/3694597970 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5bac03c240 0x7f5bac03e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.627+0000 7f5bb67fc700 1 -- 172.21.15.84:0/3694597970 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f5bc004cbc0 con 0x7f5bc409f320 2020-01-16T05:44:06.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.627+0000 7f5bc9b73700 1 --2- 172.21.15.84:0/3694597970 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5bac03c240 0x7f5bac03e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:06.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.627+0000 7f5bc9b73700 1 --2- 172.21.15.84:0/3694597970 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5bac03c240 0x7f5bac03e750 crc :-1 s=READY pgs=47 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:06.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.635+0000 7f5bc9372700 1 --2- 172.21.15.84:0/3694597970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc409f320 0x7f5bc409f750 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f5bc0002f30 tx=0x7f5bc0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.649 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.635+0000 7f5bb67fc700 1 -- 172.21.15.84:0/3694597970 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f5bc00331c0 con 0x7f5bc409f320 2020-01-16T05:44:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.759+0000 7f5bca374700 1 -- 172.21.15.84:0/3694597970 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5bc405cbc0 con 0x7f5bc409f320 2020-01-16T05:44:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.759+0000 7f5bc9372700 1 --2- 172.21.15.84:0/3694597970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc409f320 0x7f5bc409f750 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f5bc0002f30 tx=0x7f5bc0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.759+0000 7f5bb67fc700 1 -- 172.21.15.84:0/3694597970 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5bc0033420 con 0x7f5bc409f320 2020-01-16T05:44:06.761 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.759+0000 7f5bca374700 1 -- 172.21.15.84:0/3694597970 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5bac03c240 msgr2=0x7f5bac03e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.759+0000 7f5bca374700 1 --2- 172.21.15.84:0/3694597970 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5bac03c240 0x7f5bac03e750 crc :-1 s=READY pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.759+0000 7f5bca374700 1 -- 172.21.15.84:0/3694597970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc409f320 msgr2=0x7f5bc409f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.763+0000 7f5bca374700 1 --2- 172.21.15.84:0/3694597970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc409f320 0x7f5bc409f750 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f5bc0002f30 tx=0x7f5bc0010ef0).stop 2020-01-16T05:44:06.763 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.763+0000 7f5bca374700 1 -- 172.21.15.84:0/3694597970 shutdown_connections 2020-01-16T05:44:06.763 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.763+0000 7f5bca374700 1 --2- 172.21.15.84:0/3694597970 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5bac03c240 0x7f5bac03e750 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:06.764 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.763+0000 7f5bca374700 1 --2- 172.21.15.84:0/3694597970 >> v2:172.21.15.142:3300/0 conn(0x7f5bc407ebc0 0x7f5bc407eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:06.764 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.763+0000 7f5bca374700 1 --2- 172.21.15.84:0/3694597970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bc409f320 0x7f5bc409f750 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:06.764 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.763+0000 7f5bca374700 1 -- 172.21.15.84:0/3694597970 shutdown_connections 2020-01-16T05:44:06.764 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.763+0000 7f5bca374700 1 -- 172.21.15.84:0/3694597970 wait complete. 2020-01-16T05:44:06.765 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.763+0000 7f5bca374700 1 -- 172.21.15.84:0/3694597970 >> 172.21.15.84:0/3694597970 conn(0x7f5bc40667a0 msgr2=0x7f5bc40a4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:06.774 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-01-16T05:44:06.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383e618700 1 Processor -- start 2020-01-16T05:44:06.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383e618700 1 -- start start 2020-01-16T05:44:06.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383e618700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f383807ff10 0x7f38380abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:06.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383e618700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3838066880 con 0x7f38380a9b30 2020-01-16T05:44:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383e618700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3838066ab0 con 0x7f38380a4250 2020-01-16T05:44:06.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383e618700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38380a4830 con 0x7f383807ff10 2020-01-16T05:44:06.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383d616700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f383807ff10 0x7f38380abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:06.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383de17700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f38380a9b30 0x7f38380a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51232/0 (socket says 172.21.15.84:51232) 2020-01-16T05:44:06.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383de17700 1 -- 172.21.15.84:0/4156669408 learned_addr learned my addr 172.21.15.84:0/4156669408 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:06.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383d616700 1 -- 172.21.15.84:0/4156669408 >> v1:172.21.15.142:6789/0 conn(0x7f38380a4250 legacy=0x7f383814fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383d616700 1 -- 172.21.15.84:0/4156669408 >> v1:172.21.15.84:6789/0 conn(0x7f38380a9b30 legacy=0x7f38380a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383d616700 1 -- 172.21.15.84:0/4156669408 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3838066ce0 con 0x7f383807ff10 2020-01-16T05:44:06.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383d616700 1 --2- 172.21.15.84:0/4156669408 >> v2:172.21.15.84:3300/0 conn(0x7f383807ff10 0x7f38380abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3834008c90 tx=0x7f38340100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383d616700 1 --2- 172.21.15.84:0/4156669408 >> v2:172.21.15.84:3300/0 conn(0x7f383807ff10 0x7f38380abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3834008c90 tx=0x7f38340100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383d616700 1 --2- 172.21.15.84:0/4156669408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f383807ff10 0x7f38380abdd0 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f3834008c90 tx=0x7f38340100f0).ready entity=mon.0 client_cookie=47b2c9df36fcc79a server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:06.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383d616700 1 --2- 172.21.15.84:0/4156669408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f383807ff10 0x7f38380abdd0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f3834008c90 tx=0x7f38340100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383d616700 1 --2- 172.21.15.84:0/4156669408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f383807ff10 0x7f38380abdd0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f3834008c90 tx=0x7f38340100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383ce15700 1 -- 172.21.15.84:0/4156669408 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f383400a160 con 0x7f383807ff10 2020-01-16T05:44:06.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383d616700 1 --2- 172.21.15.84:0/4156669408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f383807ff10 0x7f38380abdd0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f3834008c90 tx=0x7f38340100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383ce15700 1 -- 172.21.15.84:0/4156669408 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3834011b60 con 0x7f383807ff10 2020-01-16T05:44:06.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383ce15700 1 -- 172.21.15.84:0/4156669408 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f383400a740 con 0x7f383807ff10 2020-01-16T05:44:06.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383e618700 1 -- 172.21.15.84:0/4156669408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f383807ff10 msgr2=0x7f38380abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.891+0000 7f383e618700 1 --2- 172.21.15.84:0/4156669408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f383807ff10 0x7f38380abdd0 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f3834008c90 tx=0x7f38340100f0).stop 2020-01-16T05:44:06.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.895+0000 7f383e618700 1 -- 172.21.15.84:0/4156669408 shutdown_connections 2020-01-16T05:44:06.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.895+0000 7f383e618700 1 --2- 172.21.15.84:0/4156669408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f383807ff10 0x7f38380abdd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:06.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.895+0000 7f383e618700 1 -- 172.21.15.84:0/4156669408 shutdown_connections 2020-01-16T05:44:06.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.895+0000 7f383e618700 1 -- 172.21.15.84:0/4156669408 wait complete. 2020-01-16T05:44:06.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.895+0000 7f383e618700 1 -- 172.21.15.84:0/4156669408 >> 172.21.15.84:0/4156669408 conn(0x7f38380acfc0 msgr2=0x7f38380a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:06.926 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.895+0000 7f383e618700 1 Processor -- start 2020-01-16T05:44:06.926 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.895+0000 7f383e618700 1 -- start start 2020-01-16T05:44:06.926 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.895+0000 7f383e618700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dae0 0x7f3838123ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:06.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.895+0000 7f383e618700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f38380a22f0 0x7f38380a3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:06.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.895+0000 7f383e618700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38380a03c0 con 0x7f38380a2c10 2020-01-16T05:44:06.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.895+0000 7f383e618700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3838124540 con 0x7f38380a22f0 2020-01-16T05:44:06.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.895+0000 7f383e618700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38380a3660 con 0x7f383807dae0 2020-01-16T05:44:06.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.895+0000 7f383f87a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f38380a22f0 0x7f38380a3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:06.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.895+0000 7f383f87a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f38380a22f0 0x7f38380a3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34040/0 (socket says 172.21.15.84:34040) 2020-01-16T05:44:06.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.895+0000 7f383f87a700 1 -- 172.21.15.84:0/49954892 learned_addr learned my addr 172.21.15.84:0/49954892 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:06.928 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.895+0000 7f383d616700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f38380a2c10 0x7f38380a1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51242/0 (socket says 172.21.15.84:51242) 2020-01-16T05:44:06.928 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.895+0000 7f383de17700 1 --2- 172.21.15.84:0/49954892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dae0 0x7f3838123ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:06.928 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f383f87a700 1 -- 172.21.15.84:0/49954892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dae0 msgr2=0x7f3838123ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.928 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f382e7fc700 1 -- 172.21.15.84:0/49954892 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937482607 0 0) 0x7f38380a03c0 con 0x7f38380a2c10 2020-01-16T05:44:06.929 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f383f87a700 1 --2- 172.21.15.84:0/49954892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dae0 0x7f3838123ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:06.929 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f383f87a700 1 -- 172.21.15.84:0/49954892 >> v1:172.21.15.84:6789/0 conn(0x7f38380a2c10 legacy=0x7f38380a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:06.929 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f383f87a700 1 -- 172.21.15.84:0/49954892 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38380a05f0 con 0x7f38380a22f0 2020-01-16T05:44:06.929 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f383f87a700 1 --2- 172.21.15.84:0/49954892 >> v2:172.21.15.84:3300/0 conn(0x7f38380a22f0 0x7f38380a3040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f38380a3820 tx=0x7f3830010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.929 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f383f87a700 1 --2- 172.21.15.84:0/49954892 >> v2:172.21.15.84:3300/0 conn(0x7f38380a22f0 0x7f38380a3040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f38380a3820 tx=0x7f3830010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.929 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f383f87a700 1 --2- 172.21.15.84:0/49954892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38380a22f0 0x7f38380a3040 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f38380a3820 tx=0x7f3830010940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:06.930 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f383f87a700 1 --2- 172.21.15.84:0/49954892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38380a22f0 0x7f38380a3040 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f38380a3820 tx=0x7f3830010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.930 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f382e7fc700 1 -- 172.21.15.84:0/49954892 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3830006bc0 con 0x7f38380a22f0 2020-01-16T05:44:06.930 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f383f87a700 1 --2- 172.21.15.84:0/49954892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38380a22f0 0x7f38380a3040 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f38380a3820 tx=0x7f3830010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.930 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f383f87a700 1 --2- 172.21.15.84:0/49954892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38380a22f0 0x7f38380a3040 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f38380a3820 tx=0x7f3830010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.930 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f382e7fc700 1 -- 172.21.15.84:0/49954892 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38300067e0 con 0x7f38380a22f0 2020-01-16T05:44:06.930 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f383e618700 1 -- 172.21.15.84:0/49954892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38380a3db0 con 0x7f38380a22f0 2020-01-16T05:44:06.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f382e7fc700 1 -- 172.21.15.84:0/49954892 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3830011140 con 0x7f38380a22f0 2020-01-16T05:44:06.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f383e618700 1 -- 172.21.15.84:0/49954892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38380a4360 con 0x7f38380a22f0 2020-01-16T05:44:06.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f383f87a700 1 --2- 172.21.15.84:0/49954892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38380a22f0 0x7f38380a3040 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f38380a3820 tx=0x7f3830010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f383e618700 1 -- 172.21.15.84:0/49954892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383805e1c0 con 0x7f38380a22f0 2020-01-16T05:44:06.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f382e7fc700 1 -- 172.21.15.84:0/49954892 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f3830011340 con 0x7f38380a22f0 2020-01-16T05:44:06.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f383f87a700 1 --2- 172.21.15.84:0/49954892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38380a22f0 0x7f38380a3040 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f38380a3820 tx=0x7f3830010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f382e7fc700 1 --2- 172.21.15.84:0/49954892 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f381803c1e0 0x7f381803e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:06.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f382e7fc700 1 -- 172.21.15.84:0/49954892 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f383004c8e0 con 0x7f38380a22f0 2020-01-16T05:44:06.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f383de17700 1 --2- 172.21.15.84:0/49954892 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f381803c1e0 0x7f381803e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:06.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.899+0000 7f383de17700 1 --2- 172.21.15.84:0/49954892 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f381803c1e0 0x7f381803e6f0 crc :-1 s=READY pgs=48 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:06.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.907+0000 7f383f87a700 1 --2- 172.21.15.84:0/49954892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38380a22f0 0x7f38380a3040 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f38380a3820 tx=0x7f3830010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:06.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:06.907+0000 7f382e7fc700 1 -- 172.21.15.84:0/49954892 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f3830032f00 con 0x7f38380a22f0 2020-01-16T05:44:07.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.023+0000 7f383e618700 1 -- 172.21.15.84:0/49954892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f383809fce0 con 0x7f38380a22f0 2020-01-16T05:44:07.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.023+0000 7f383f87a700 1 --2- 172.21.15.84:0/49954892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38380a22f0 0x7f38380a3040 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f38380a3820 tx=0x7f3830010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.023+0000 7f382e7fc700 1 -- 172.21.15.84:0/49954892 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3830033160 con 0x7f38380a22f0 2020-01-16T05:44:07.026 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:07.027 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.027+0000 7f383e618700 1 -- 172.21.15.84:0/49954892 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f381803c1e0 msgr2=0x7f381803e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.027 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.027+0000 7f383e618700 1 --2- 172.21.15.84:0/49954892 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f381803c1e0 0x7f381803e6f0 crc :-1 s=READY pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.027 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.027+0000 7f383e618700 1 -- 172.21.15.84:0/49954892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38380a22f0 msgr2=0x7f38380a3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.027+0000 7f383e618700 1 --2- 172.21.15.84:0/49954892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38380a22f0 0x7f38380a3040 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f38380a3820 tx=0x7f3830010940).stop 2020-01-16T05:44:07.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.027+0000 7f383e618700 1 -- 172.21.15.84:0/49954892 shutdown_connections 2020-01-16T05:44:07.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.027+0000 7f383e618700 1 --2- 172.21.15.84:0/49954892 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f381803c1e0 0x7f381803e6f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.027+0000 7f383e618700 1 --2- 172.21.15.84:0/49954892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38380a22f0 0x7f38380a3040 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.027+0000 7f383e618700 1 --2- 172.21.15.84:0/49954892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dae0 0x7f3838123ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.027+0000 7f383e618700 1 -- 172.21.15.84:0/49954892 shutdown_connections 2020-01-16T05:44:07.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.027+0000 7f383e618700 1 -- 172.21.15.84:0/49954892 wait complete. 2020-01-16T05:44:07.029 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.027+0000 7f383e618700 1 -- 172.21.15.84:0/49954892 >> 172.21.15.84:0/49954892 conn(0x7f38380a9b30 msgr2=0x7f38380a4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:07.038 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-01-16T05:44:07.159 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafde520700 1 Processor -- start 2020-01-16T05:44:07.159 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafde520700 1 -- start start 2020-01-16T05:44:07.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafde520700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fafd80a9b30 0x7fafd80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:07.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafde520700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd807ff10 0x7fafd8066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:07.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafde520700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd8066dd0 con 0x7fafd80a4250 2020-01-16T05:44:07.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafde520700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd80a4830 con 0x7fafd80a9b30 2020-01-16T05:44:07.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafde520700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd807f9d0 con 0x7fafd807ff10 2020-01-16T05:44:07.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdf782700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fafd80a4250 0x7fafd80a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51248/0 (socket says 172.21.15.84:51248) 2020-01-16T05:44:07.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdf782700 1 -- 172.21.15.84:0/349004533 learned_addr learned my addr 172.21.15.84:0/349004533 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:07.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdd51e700 1 --2- 172.21.15.84:0/349004533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd807ff10 0x7fafd8066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafddd1f700 1 --2- 172.21.15.84:0/349004533 >> v2:172.21.15.142:3300/0 conn(0x7fafd80a9b30 0x7fafd80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdcd1d700 1 -- 172.21.15.84:0/349004533 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824537482 0 0) 0x7fafd8066dd0 con 0x7fafd80a4250 2020-01-16T05:44:07.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdcd1d700 1 -- 172.21.15.84:0/349004533 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafc4003230 con 0x7fafd80a4250 2020-01-16T05:44:07.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdcd1d700 1 -- 172.21.15.84:0/349004533 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 81060551 0 0) 0x7fafc4003230 con 0x7fafd80a4250 2020-01-16T05:44:07.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdd51e700 1 -- 172.21.15.84:0/349004533 >> v2:172.21.15.142:3300/0 conn(0x7fafd80a9b30 msgr2=0x7fafd80abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:07.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdd51e700 1 --2- 172.21.15.84:0/349004533 >> v2:172.21.15.142:3300/0 conn(0x7fafd80a9b30 0x7fafd80abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:07.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdd51e700 1 -- 172.21.15.84:0/349004533 >> v1:172.21.15.84:6789/0 conn(0x7fafd80a4250 legacy=0x7fafd80a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdd51e700 1 -- 172.21.15.84:0/349004533 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd8150ce0 con 0x7fafd807ff10 2020-01-16T05:44:07.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdd51e700 1 --2- 172.21.15.84:0/349004533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd807ff10 0x7fafd8066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fafc8008910 tx=0x7fafd0001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdd51e700 1 --2- 172.21.15.84:0/349004533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd807ff10 0x7fafd8066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fafc8008910 tx=0x7fafd0001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdd51e700 1 --2- 172.21.15.84:0/349004533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd807ff10 0x7fafd8066880 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7fafc8008910 tx=0x7fafd0001820).ready entity=mon.2 client_cookie=1d4b9c8028f15e59 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:07.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdd51e700 1 --2- 172.21.15.84:0/349004533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd807ff10 0x7fafd8066880 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fafc8008910 tx=0x7fafd0001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.163 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdcd1d700 1 -- 172.21.15.84:0/349004533 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafd0001ad0 con 0x7fafd807ff10 2020-01-16T05:44:07.163 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdd51e700 1 --2- 172.21.15.84:0/349004533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd807ff10 0x7fafd8066880 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fafc8008910 tx=0x7fafd0001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.163 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdd51e700 1 --2- 172.21.15.84:0/349004533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd807ff10 0x7fafd8066880 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fafc8008910 tx=0x7fafd0001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.163 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdcd1d700 1 -- 172.21.15.84:0/349004533 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd00018e0 con 0x7fafd807ff10 2020-01-16T05:44:07.163 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafdcd1d700 1 -- 172.21.15.84:0/349004533 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafc8011750 con 0x7fafd807ff10 2020-01-16T05:44:07.163 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafde520700 1 -- 172.21.15.84:0/349004533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd807ff10 msgr2=0x7fafd8066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.163 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafde520700 1 --2- 172.21.15.84:0/349004533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd807ff10 0x7fafd8066880 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7fafc8008910 tx=0x7fafd0001820).stop 2020-01-16T05:44:07.163 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafde520700 1 -- 172.21.15.84:0/349004533 shutdown_connections 2020-01-16T05:44:07.164 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafde520700 1 --2- 172.21.15.84:0/349004533 >> v2:172.21.15.142:3300/0 conn(0x7fafd80a9b30 0x7fafd80abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:07.164 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafde520700 1 --2- 172.21.15.84:0/349004533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd807ff10 0x7fafd8066880 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.164 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafde520700 1 -- 172.21.15.84:0/349004533 shutdown_connections 2020-01-16T05:44:07.164 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafde520700 1 -- 172.21.15.84:0/349004533 wait complete. 2020-01-16T05:44:07.164 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.155+0000 7fafde520700 1 -- 172.21.15.84:0/349004533 >> 172.21.15.84:0/349004533 conn(0x7fafd80acfc0 msgr2=0x7fafd80a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:07.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.159+0000 7fafde520700 1 Processor -- start 2020-01-16T05:44:07.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.159+0000 7fafde520700 1 -- start start 2020-01-16T05:44:07.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.159+0000 7fafde520700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fafd80a3030 0x7fafd8063ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:07.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.159+0000 7fafde520700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd807eb10 0x7fafd807ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:07.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.159+0000 7fafde520700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd8064410 con 0x7fafd8062f60 2020-01-16T05:44:07.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.159+0000 7fafde520700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd8064ca0 con 0x7fafd80a3030 2020-01-16T05:44:07.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.159+0000 7fafde520700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd8064760 con 0x7fafd807eb10 2020-01-16T05:44:07.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.159+0000 7fafdf782700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fafd8062f60 0x7fafd8063390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51256/0 (socket says 172.21.15.84:51256) 2020-01-16T05:44:07.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.159+0000 7fafdf782700 1 -- 172.21.15.84:0/3827079830 learned_addr learned my addr 172.21.15.84:0/3827079830 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:07.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.159+0000 7fafddd1f700 1 --2- 172.21.15.84:0/3827079830 >> v2:172.21.15.142:3300/0 conn(0x7fafd80a3030 0x7fafd8063ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.159+0000 7fafdd51e700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd807eb10 0x7fafd807ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.159+0000 7fafce7fc700 1 -- 172.21.15.84:0/3827079830 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084545406 0 0) 0x7fafd8064410 con 0x7fafd8062f60 2020-01-16T05:44:07.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.159+0000 7fafce7fc700 1 -- 172.21.15.84:0/3827079830 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafc0003230 con 0x7fafd8062f60 2020-01-16T05:44:07.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafce7fc700 1 -- 172.21.15.84:0/3827079830 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 128402377 0 0) 0x7fafc0003230 con 0x7fafd8062f60 2020-01-16T05:44:07.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafce7fc700 1 -- 172.21.15.84:0/3827079830 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fafd8064410 con 0x7fafd8062f60 2020-01-16T05:44:07.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafce7fc700 1 -- 172.21.15.84:0/3827079830 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7fafd0001ea0 con 0x7fafd8062f60 2020-01-16T05:44:07.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafce7fc700 1 -- 172.21.15.84:0/3827079830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd807eb10 msgr2=0x7fafd807ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafce7fc700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd807eb10 0x7fafd807ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafce7fc700 1 -- 172.21.15.84:0/3827079830 >> v2:172.21.15.142:3300/0 conn(0x7fafd80a3030 msgr2=0x7fafd8063ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafce7fc700 1 --2- 172.21.15.84:0/3827079830 >> v2:172.21.15.142:3300/0 conn(0x7fafd80a3030 0x7fafd8063ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafce7fc700 1 -- 172.21.15.84:0/3827079830 >> v1:172.21.15.84:6789/0 conn(0x7fafd8062f60 legacy=0x7fafd8063390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafce7fc700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc0003a20 0x7fafc0003e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:07.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafce7fc700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafc00045a0 0x7fafc00049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:07.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafce7fc700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc0004f70 0x7fafc000b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:07.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafce7fc700 1 -- 172.21.15.84:0/3827079830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd8064760 con 0x7fafc0004f70 2020-01-16T05:44:07.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafce7fc700 1 -- 172.21.15.84:0/3827079830 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc000bd70 con 0x7fafc0003a20 2020-01-16T05:44:07.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafce7fc700 1 -- 172.21.15.84:0/3827079830 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc000bfb0 con 0x7fafc00045a0 2020-01-16T05:44:07.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafdd51e700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd807eb10 0x7fafd807ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:07.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafddd1f700 1 --2- 172.21.15.84:0/3827079830 >> v2:172.21.15.142:3300/0 conn(0x7fafd80a3030 0x7fafd8063ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:07.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafdf782700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc0004f70 0x7fafc000b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafddd1f700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc0003a20 0x7fafc0003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafdd51e700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafc00045a0 0x7fafc00049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafdf782700 1 -- 172.21.15.84:0/3827079830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafc00045a0 msgr2=0x7fafc00049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafdf782700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafc00045a0 0x7fafc00049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafdf782700 1 -- 172.21.15.84:0/3827079830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc0003a20 msgr2=0x7fafc0003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafdf782700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc0003a20 0x7fafc0003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafdf782700 1 -- 172.21.15.84:0/3827079830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd807f490 con 0x7fafc0004f70 2020-01-16T05:44:07.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafde520700 1 -- 172.21.15.84:0/3827079830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd8066150 con 0x7fafc0004f70 2020-01-16T05:44:07.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafdf782700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc0004f70 0x7fafc000b7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fafd00016f0 tx=0x7fafd0011b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafde520700 1 -- 172.21.15.84:0/3827079830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd807eb10 con 0x7fafc0004f70 2020-01-16T05:44:07.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafdf782700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc0004f70 0x7fafc000b7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fafd00016f0 tx=0x7fafd0011b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafdf782700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc0004f70 0x7fafc000b7f0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7fafd00016f0 tx=0x7fafd0011b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:07.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafdf782700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc0004f70 0x7fafc000b7f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fafd00016f0 tx=0x7fafd0011b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafce7fc700 1 -- 172.21.15.84:0/3827079830 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafd0008b10 con 0x7fafc0004f70 2020-01-16T05:44:07.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafdf782700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc0004f70 0x7fafc000b7f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fafd00016f0 tx=0x7fafd0011b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafdf782700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc0004f70 0x7fafc000b7f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fafd00016f0 tx=0x7fafd0011b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafce7fc700 1 -- 172.21.15.84:0/3827079830 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd000ab90 con 0x7fafc0004f70 2020-01-16T05:44:07.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafce7fc700 1 -- 172.21.15.84:0/3827079830 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafd000b260 con 0x7fafc0004f70 2020-01-16T05:44:07.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafdf782700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc0004f70 0x7fafc000b7f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fafd00016f0 tx=0x7fafd0011b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafde520700 1 -- 172.21.15.84:0/3827079830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb4003360 con 0x7fafc0004f70 2020-01-16T05:44:07.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafce7fc700 1 -- 172.21.15.84:0/3827079830 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fafd000b460 con 0x7fafc0004f70 2020-01-16T05:44:07.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.163+0000 7fafdf782700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc0004f70 0x7fafc000b7f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fafd00016f0 tx=0x7fafd0011b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.167+0000 7fafce7fc700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fafc0045320 0x7fafc0047830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:07.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.167+0000 7fafce7fc700 1 -- 172.21.15.84:0/3827079830 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7fafd004d490 con 0x7fafc0004f70 2020-01-16T05:44:07.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.167+0000 7fafddd1f700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fafc0045320 0x7fafc0047830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.167+0000 7fafddd1f700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fafc0045320 0x7fafc0047830 crc :-1 s=READY pgs=49 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:07.178 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.171+0000 7fafdf782700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc0004f70 0x7fafc000b7f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fafd00016f0 tx=0x7fafd0011b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.178 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.171+0000 7fafce7fc700 1 -- 172.21.15.84:0/3827079830 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fafd0033ab0 con 0x7fafc0004f70 2020-01-16T05:44:07.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.283+0000 7fafde520700 1 -- 172.21.15.84:0/3827079830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fafb4002220 con 0x7fafc0004f70 2020-01-16T05:44:07.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.283+0000 7fafdf782700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc0004f70 0x7fafc000b7f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fafd00016f0 tx=0x7fafd0011b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.283+0000 7fafce7fc700 1 -- 172.21.15.84:0/3827079830 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7fafd0033d10 con 0x7fafc0004f70 2020-01-16T05:44:07.286 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:07.287 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.287+0000 7fafde520700 1 -- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fafc0045320 msgr2=0x7fafc0047830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.287 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.287+0000 7fafde520700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fafc0045320 0x7fafc0047830 crc :-1 s=READY pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.287+0000 7fafde520700 1 -- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc0004f70 msgr2=0x7fafc000b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.287+0000 7fafdf782700 1 -- 172.21.15.84:0/3827079830 reap_dead start 2020-01-16T05:44:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.287+0000 7fafde520700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc0004f70 0x7fafc000b7f0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7fafd00016f0 tx=0x7fafd0011b60).stop 2020-01-16T05:44:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.287+0000 7fafde520700 1 -- 172.21.15.84:0/3827079830 shutdown_connections 2020-01-16T05:44:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.287+0000 7fafde520700 1 --2- 172.21.15.84:0/3827079830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafc0004f70 0x7fafc000b7f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.287+0000 7fafde520700 1 -- 172.21.15.84:0/3827079830 shutdown_connections 2020-01-16T05:44:07.291 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.287+0000 7fafde520700 1 -- 172.21.15.84:0/3827079830 wait complete. 2020-01-16T05:44:07.291 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.287+0000 7fafde520700 1 -- 172.21.15.84:0/3827079830 >> 172.21.15.84:0/3827079830 conn(0x7fafd80ab6b0 msgr2=0x7fafd80a5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:07.298 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-01-16T05:44:07.298 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-01-16T05:44:07.299 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2020-01-16T05:44:07.422 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071b4d9700 1 Processor -- start 2020-01-16T05:44:07.422 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071b4d9700 1 -- start start 2020-01-16T05:44:07.422 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071b4d9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f071405b0f0 0x7f07140a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:07.422 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071b4d9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f071408fd80 0x7f07141503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:07.422 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071b4d9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071407cd60 con 0x7f07140a2f60 2020-01-16T05:44:07.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071b4d9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07140a3390 con 0x7f071408fd80 2020-01-16T05:44:07.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071b4d9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07140905b0 con 0x7f071405b0f0 2020-01-16T05:44:07.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f0719275700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f071405b0f0 0x7f07140a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071a277700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f071408fd80 0x7f07141503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071a277700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f071408fd80 0x7f07141503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.84:44052/0 (socket says 172.21.15.84:44052) 2020-01-16T05:44:07.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071a277700 1 -- 172.21.15.84:0/2292420566 learned_addr learned my addr 172.21.15.84:0/2292420566 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:07.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f0719275700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f071405b0f0 0x7f07140a8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:46312/0 (socket says 172.21.15.84:46312) 2020-01-16T05:44:07.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f0719a76700 1 --1- 172.21.15.84:0/2292420566 >> v1:172.21.15.142:6789/0 conn(0x7f07140a2f60 0x7f071407c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:49492/0 (socket says 172.21.15.84:49492) 2020-01-16T05:44:07.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071a277700 1 -- 172.21.15.84:0/2292420566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f071405b0f0 msgr2=0x7f07140a8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:07.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071a277700 1 --2- 172.21.15.84:0/2292420566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f071405b0f0 0x7f07140a8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:07.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071a277700 1 -- 172.21.15.84:0/2292420566 >> v1:172.21.15.142:6789/0 conn(0x7f07140a2f60 legacy=0x7f071407c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f0718a74700 1 -- 172.21.15.84:0/2292420566 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601725063 0 0) 0x7f071407cd60 con 0x7f07140a2f60 2020-01-16T05:44:07.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071a277700 1 -- 172.21.15.84:0/2292420566 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071405b520 con 0x7f071408fd80 2020-01-16T05:44:07.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071a277700 1 --2- 172.21.15.84:0/2292420566 >> v2:172.21.15.142:3300/0 conn(0x7f071408fd80 0x7f07141503f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0714090770 tx=0x7f070c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071a277700 1 --2- 172.21.15.84:0/2292420566 >> v2:172.21.15.142:3300/0 conn(0x7f071408fd80 0x7f07141503f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0714090770 tx=0x7f070c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071a277700 1 --2- 172.21.15.84:0/2292420566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f071408fd80 0x7f07141503f0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f0714090770 tx=0x7f070c00feb0).ready entity=mon.1 client_cookie=5d6f68ca04d50ed4 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:07.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071a277700 1 --2- 172.21.15.84:0/2292420566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f071408fd80 0x7f07141503f0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f0714090770 tx=0x7f070c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f0718a74700 1 -- 172.21.15.84:0/2292420566 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f070c011720 con 0x7f071408fd80 2020-01-16T05:44:07.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071a277700 1 --2- 172.21.15.84:0/2292420566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f071408fd80 0x7f07141503f0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f0714090770 tx=0x7f070c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071a277700 1 --2- 172.21.15.84:0/2292420566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f071408fd80 0x7f07141503f0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f0714090770 tx=0x7f070c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f0718a74700 1 -- 172.21.15.84:0/2292420566 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c008d30 con 0x7f071408fd80 2020-01-16T05:44:07.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f0718a74700 1 -- 172.21.15.84:0/2292420566 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f070c011d00 con 0x7f071408fd80 2020-01-16T05:44:07.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071b4d9700 1 -- 172.21.15.84:0/2292420566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f071408fd80 msgr2=0x7f07141503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.411+0000 7f071b4d9700 1 --2- 172.21.15.84:0/2292420566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f071408fd80 0x7f07141503f0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f0714090770 tx=0x7f070c00feb0).stop 2020-01-16T05:44:07.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.415+0000 7f071b4d9700 1 -- 172.21.15.84:0/2292420566 shutdown_connections 2020-01-16T05:44:07.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.415+0000 7f071b4d9700 1 --2- 172.21.15.84:0/2292420566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f071408fd80 0x7f07141503f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.415+0000 7f071b4d9700 1 --2- 172.21.15.84:0/2292420566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f071405b0f0 0x7f07140a8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:07.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.415+0000 7f071b4d9700 1 -- 172.21.15.84:0/2292420566 shutdown_connections 2020-01-16T05:44:07.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.415+0000 7f071b4d9700 1 -- 172.21.15.84:0/2292420566 wait complete. 2020-01-16T05:44:07.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.415+0000 7f071b4d9700 1 -- 172.21.15.84:0/2292420566 >> 172.21.15.84:0/2292420566 conn(0x7f07140abc10 msgr2=0x7f071405a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:07.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.415+0000 7f071b4d9700 1 Processor -- start 2020-01-16T05:44:07.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.415+0000 7f071b4d9700 1 -- start start 2020-01-16T05:44:07.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.415+0000 7f071b4d9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f07140a5df0 0x7f071407fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:07.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.415+0000 7f071b4d9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071409c990 con 0x7f0714063ed0 2020-01-16T05:44:07.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.415+0000 7f071b4d9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0714064300 con 0x7f0714099990 2020-01-16T05:44:07.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.415+0000 7f071b4d9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07140656e0 con 0x7f07140a5df0 2020-01-16T05:44:07.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f0719a76700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f07140a5df0 0x7f071407fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f0719275700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0714063ed0 0x7f071409c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51274/0 (socket says 172.21.15.84:51274) 2020-01-16T05:44:07.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f071a277700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0714099990 0x7f071413c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:49502/0 (socket says 172.21.15.84:49502) 2020-01-16T05:44:07.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f0719275700 1 -- 172.21.15.84:0/3914641967 learned_addr learned my addr 172.21.15.84:0/3914641967 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:07.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f07067fc700 1 -- 172.21.15.84:0/3914641967 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072237720 0 0) 0x7f0708002240 con 0x7f0714063ed0 2020-01-16T05:44:07.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f07067fc700 1 -- 172.21.15.84:0/3914641967 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06fc003230 con 0x7f0714063ed0 2020-01-16T05:44:07.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f0719a76700 1 -- 172.21.15.84:0/3914641967 >> v1:172.21.15.142:6789/0 conn(0x7f0714099990 legacy=0x7f071413c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f07067fc700 1 -- 172.21.15.84:0/3914641967 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260409856 0 0) 0x7f0714064300 con 0x7f0714099990 2020-01-16T05:44:07.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f0719a76700 1 -- 172.21.15.84:0/3914641967 >> v1:172.21.15.84:6789/0 conn(0x7f0714063ed0 legacy=0x7f071409c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f0719a76700 1 -- 172.21.15.84:0/3914641967 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0714099dc0 con 0x7f07140a5df0 2020-01-16T05:44:07.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f0719a76700 1 --2- 172.21.15.84:0/3914641967 >> v2:172.21.15.142:3300/0 conn(0x7f07140a5df0 0x7f071407fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0710000b80 tx=0x7f0710010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f0719a76700 1 --2- 172.21.15.84:0/3914641967 >> v2:172.21.15.142:3300/0 conn(0x7f07140a5df0 0x7f071407fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0710000b80 tx=0x7f0710010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f0719a76700 1 --2- 172.21.15.84:0/3914641967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07140a5df0 0x7f071407fd30 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f0710000b80 tx=0x7f0710010940).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:07.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f0719a76700 1 --2- 172.21.15.84:0/3914641967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07140a5df0 0x7f071407fd30 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f0710000b80 tx=0x7f0710010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f07067fc700 1 -- 172.21.15.84:0/3914641967 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0710011760 con 0x7f07140a5df0 2020-01-16T05:44:07.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f0719a76700 1 --2- 172.21.15.84:0/3914641967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07140a5df0 0x7f071407fd30 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f0710000b80 tx=0x7f0710010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f0719a76700 1 --2- 172.21.15.84:0/3914641967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07140a5df0 0x7f071407fd30 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f0710000b80 tx=0x7f0710010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f07067fc700 1 -- 172.21.15.84:0/3914641967 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0710011380 con 0x7f07140a5df0 2020-01-16T05:44:07.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f071b4d9700 1 -- 172.21.15.84:0/3914641967 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0714065c20 con 0x7f07140a5df0 2020-01-16T05:44:07.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f07067fc700 1 -- 172.21.15.84:0/3914641967 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0710011d40 con 0x7f07140a5df0 2020-01-16T05:44:07.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f071b4d9700 1 -- 172.21.15.84:0/3914641967 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071413d810 con 0x7f07140a5df0 2020-01-16T05:44:07.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f0719a76700 1 --2- 172.21.15.84:0/3914641967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07140a5df0 0x7f071407fd30 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f0710000b80 tx=0x7f0710010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f071b4d9700 1 -- 172.21.15.84:0/3914641967 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f071405e1c0 con 0x7f07140a5df0 2020-01-16T05:44:07.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f07067fc700 1 -- 172.21.15.84:0/3914641967 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f071000b330 con 0x7f07140a5df0 2020-01-16T05:44:07.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f0719a76700 1 --2- 172.21.15.84:0/3914641967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07140a5df0 0x7f071407fd30 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f0710000b80 tx=0x7f0710010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.419+0000 7f07067fc700 1 --2- 172.21.15.84:0/3914641967 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f06fc03c7e0 0x7f06fc03ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:07.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.423+0000 7f07067fc700 1 -- 172.21.15.84:0/3914641967 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f071004cab0 con 0x7f07140a5df0 2020-01-16T05:44:07.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.423+0000 7f0719275700 1 --2- 172.21.15.84:0/3914641967 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f06fc03c7e0 0x7f06fc03ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.423+0000 7f0719275700 1 --2- 172.21.15.84:0/3914641967 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f06fc03c7e0 0x7f06fc03ecf0 crc :-1 s=READY pgs=50 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:07.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.427+0000 7f0719a76700 1 --2- 172.21.15.84:0/3914641967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07140a5df0 0x7f071407fd30 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f0710000b80 tx=0x7f0710010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.427+0000 7f07067fc700 1 -- 172.21.15.84:0/3914641967 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f07100330d0 con 0x7f07140a5df0 2020-01-16T05:44:07.577 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.575+0000 7f071b4d9700 1 -- 172.21.15.84:0/3914641967 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f07140a2ea0 con 0x7f07140a5df0 2020-01-16T05:44:07.581 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.579+0000 7f0719a76700 1 --2- 172.21.15.84:0/3914641967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07140a5df0 0x7f071407fd30 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f0710000b80 tx=0x7f0710010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.581 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.579+0000 7f07067fc700 1 -- 172.21.15.84:0/3914641967 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+96144 (secure 0 0 0) 0x7f0710033330 con 0x7f07140a5df0 2020-01-16T05:44:07.584 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:07.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.583+0000 7f071b4d9700 1 -- 172.21.15.84:0/3914641967 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f06fc03c7e0 msgr2=0x7f06fc03ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.583+0000 7f071b4d9700 1 --2- 172.21.15.84:0/3914641967 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f06fc03c7e0 0x7f06fc03ecf0 crc :-1 s=READY pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.583+0000 7f071b4d9700 1 -- 172.21.15.84:0/3914641967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07140a5df0 msgr2=0x7f071407fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.583+0000 7f071b4d9700 1 --2- 172.21.15.84:0/3914641967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07140a5df0 0x7f071407fd30 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f0710000b80 tx=0x7f0710010940).stop 2020-01-16T05:44:07.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.583+0000 7f071b4d9700 1 -- 172.21.15.84:0/3914641967 shutdown_connections 2020-01-16T05:44:07.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.583+0000 7f071b4d9700 1 --2- 172.21.15.84:0/3914641967 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f06fc03c7e0 0x7f06fc03ecf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.583+0000 7f071b4d9700 1 --2- 172.21.15.84:0/3914641967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07140a5df0 0x7f071407fd30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.583+0000 7f071b4d9700 1 -- 172.21.15.84:0/3914641967 shutdown_connections 2020-01-16T05:44:07.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.583+0000 7f071b4d9700 1 -- 172.21.15.84:0/3914641967 wait complete. 2020-01-16T05:44:07.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.583+0000 7f071b4d9700 1 -- 172.21.15.84:0/3914641967 >> 172.21.15.84:0/3914641967 conn(0x7f07140a86a0 msgr2=0x7f07140a6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:07.596 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":4,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":12486},{"type":"v1","addr":"172.21.15.84:6801","nonce":12486}]},"active_addr":"172.21.15.84:6801/12486","active_change":"2020-01-16T05:43:50.462508+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"str","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"str","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["ansible","cephadm","deepsea","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"str","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"str","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["ansible","cephadm","deepsea","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1166872284}]}]}} 2020-01-16T05:44:07.606 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-01-16T05:44:07.606 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-01-16T05:44:07.607 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-16T05:44:07.718 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.711+0000 7f9763549700 1 Processor -- start 2020-01-16T05:44:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.711+0000 7f9763549700 1 -- start start 2020-01-16T05:44:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9763549700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f975c07ff10 0x7f975c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9763549700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f975c0a4250 0x7f975c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9763549700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975c066dd0 con 0x7f975c0a9b30 2020-01-16T05:44:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9763549700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975c0a4830 con 0x7f975c07ff10 2020-01-16T05:44:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9763549700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975c07f9d0 con 0x7f975c0a4250 2020-01-16T05:44:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9762547700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f975c07ff10 0x7f975c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9762547700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f975c07ff10 0x7f975c0abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34082/0 (socket says 172.21.15.84:34082) 2020-01-16T05:44:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9762547700 1 -- 172.21.15.84:0/663827865 learned_addr learned my addr 172.21.15.84:0/663827865 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f97647ab700 1 --2- 172.21.15.84:0/663827865 >> v2:172.21.15.142:3300/0 conn(0x7f975c0a4250 0x7f975c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9762547700 1 -- 172.21.15.84:0/663827865 >> v2:172.21.15.142:3300/0 conn(0x7f975c0a4250 msgr2=0x7f975c066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9762547700 1 --2- 172.21.15.84:0/663827865 >> v2:172.21.15.142:3300/0 conn(0x7f975c0a4250 0x7f975c066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9762547700 1 -- 172.21.15.84:0/663827865 >> v1:172.21.15.142:6789/0 conn(0x7f975c0a9b30 legacy=0x7f975c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9762547700 1 -- 172.21.15.84:0/663827865 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c150ce0 con 0x7f975c07ff10 2020-01-16T05:44:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9761d46700 1 -- 172.21.15.84:0/663827865 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579433466 0 0) 0x7f975c066dd0 con 0x7f975c0a9b30 2020-01-16T05:44:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9762547700 1 --2- 172.21.15.84:0/663827865 >> v2:172.21.15.84:3300/0 conn(0x7f975c07ff10 0x7f975c0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f975c0a49f0 tx=0x7f975800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9762547700 1 --2- 172.21.15.84:0/663827865 >> v2:172.21.15.84:3300/0 conn(0x7f975c07ff10 0x7f975c0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f975c0a49f0 tx=0x7f975800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9762547700 1 --2- 172.21.15.84:0/663827865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f975c07ff10 0x7f975c0abdd0 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f975c0a49f0 tx=0x7f975800feb0).ready entity=mon.0 client_cookie=939f9d10d9857ce2 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9762547700 1 --2- 172.21.15.84:0/663827865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f975c07ff10 0x7f975c0abdd0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f975c0a49f0 tx=0x7f975800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.722 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9761d46700 1 -- 172.21.15.84:0/663827865 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97580116e0 con 0x7f975c07ff10 2020-01-16T05:44:07.722 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9762547700 1 --2- 172.21.15.84:0/663827865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f975c07ff10 0x7f975c0abdd0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f975c0a49f0 tx=0x7f975800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.722 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9762547700 1 --2- 172.21.15.84:0/663827865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f975c07ff10 0x7f975c0abdd0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f975c0a49f0 tx=0x7f975800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.722 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9761d46700 1 -- 172.21.15.84:0/663827865 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9758008d30 con 0x7f975c07ff10 2020-01-16T05:44:07.722 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9761d46700 1 -- 172.21.15.84:0/663827865 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9758011cc0 con 0x7f975c07ff10 2020-01-16T05:44:07.722 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9763549700 1 -- 172.21.15.84:0/663827865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f975c07ff10 msgr2=0x7f975c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.722 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9763549700 1 --2- 172.21.15.84:0/663827865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f975c07ff10 0x7f975c0abdd0 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f975c0a49f0 tx=0x7f975800feb0).stop 2020-01-16T05:44:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9763549700 1 -- 172.21.15.84:0/663827865 shutdown_connections 2020-01-16T05:44:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9763549700 1 --2- 172.21.15.84:0/663827865 >> v2:172.21.15.142:3300/0 conn(0x7f975c0a4250 0x7f975c066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9763549700 1 --2- 172.21.15.84:0/663827865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f975c07ff10 0x7f975c0abdd0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9763549700 1 -- 172.21.15.84:0/663827865 shutdown_connections 2020-01-16T05:44:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9763549700 1 -- 172.21.15.84:0/663827865 wait complete. 2020-01-16T05:44:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.715+0000 7f9763549700 1 -- 172.21.15.84:0/663827865 >> 172.21.15.84:0/663827865 conn(0x7f975c0acfc0 msgr2=0x7f975c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f9763549700 1 Processor -- start 2020-01-16T05:44:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f9763549700 1 -- start start 2020-01-16T05:44:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f9763549700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f975c124100 0x7f975c07ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f9763549700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975c07a960 con 0x7f975c07b3c0 2020-01-16T05:44:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f9763549700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975c0a3610 con 0x7f975c066040 2020-01-16T05:44:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f9763549700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975c065da0 con 0x7f975c124100 2020-01-16T05:44:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f9762547700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f975c124100 0x7f975c07ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f97647ab700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f975c07b3c0 0x7f975c13f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51292/0 (socket says 172.21.15.84:51292) 2020-01-16T05:44:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f9762d48700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f975c066040 0x7f975c09f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:49514/0 (socket says 172.21.15.84:49514) 2020-01-16T05:44:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f97647ab700 1 -- 172.21.15.84:0/2800652346 learned_addr learned my addr 172.21.15.84:0/2800652346 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f974f7fe700 1 -- 172.21.15.84:0/2800652346 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459867847 0 0) 0x7f9750001420 con 0x7f975c066040 2020-01-16T05:44:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f974f7fe700 1 -- 172.21.15.84:0/2800652346 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9744003230 con 0x7f975c066040 2020-01-16T05:44:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f974f7fe700 1 -- 172.21.15.84:0/2800652346 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415876343 0 0) 0x7f975c07a960 con 0x7f975c07b3c0 2020-01-16T05:44:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f9762547700 1 -- 172.21.15.84:0/2800652346 >> v1:172.21.15.142:6789/0 conn(0x7f975c066040 legacy=0x7f975c09f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f9762547700 1 -- 172.21.15.84:0/2800652346 >> v1:172.21.15.84:6789/0 conn(0x7f975c07b3c0 legacy=0x7f975c13f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f9762547700 1 -- 172.21.15.84:0/2800652346 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c0656c0 con 0x7f975c124100 2020-01-16T05:44:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f9762547700 1 --2- 172.21.15.84:0/2800652346 >> v2:172.21.15.84:3300/0 conn(0x7f975c124100 0x7f975c07ae70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f975c0a49f0 tx=0x7f9758011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f9762547700 1 --2- 172.21.15.84:0/2800652346 >> v2:172.21.15.84:3300/0 conn(0x7f975c124100 0x7f975c07ae70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f975c0a49f0 tx=0x7f9758011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f9762547700 1 --2- 172.21.15.84:0/2800652346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f975c124100 0x7f975c07ae70 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f975c0a49f0 tx=0x7f9758011720).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f9762547700 1 --2- 172.21.15.84:0/2800652346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f975c124100 0x7f975c07ae70 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f975c0a49f0 tx=0x7f9758011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.719+0000 7f974f7fe700 1 -- 172.21.15.84:0/2800652346 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f975800f760 con 0x7f975c124100 2020-01-16T05:44:07.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.723+0000 7f9762547700 1 --2- 172.21.15.84:0/2800652346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f975c124100 0x7f975c07ae70 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f975c0a49f0 tx=0x7f9758011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.723+0000 7f9762547700 1 --2- 172.21.15.84:0/2800652346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f975c124100 0x7f975c07ae70 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f975c0a49f0 tx=0x7f9758011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.723+0000 7f974f7fe700 1 -- 172.21.15.84:0/2800652346 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97580118e0 con 0x7f975c124100 2020-01-16T05:44:07.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.723+0000 7f9763549700 1 -- 172.21.15.84:0/2800652346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975c091c50 con 0x7f975c124100 2020-01-16T05:44:07.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.723+0000 7f974f7fe700 1 -- 172.21.15.84:0/2800652346 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9758007530 con 0x7f975c124100 2020-01-16T05:44:07.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.723+0000 7f9763549700 1 -- 172.21.15.84:0/2800652346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975c08fe90 con 0x7f975c124100 2020-01-16T05:44:07.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.723+0000 7f9762547700 1 --2- 172.21.15.84:0/2800652346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f975c124100 0x7f975c07ae70 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f975c0a49f0 tx=0x7f9758011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.723+0000 7f9763549700 1 -- 172.21.15.84:0/2800652346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975c05e1c0 con 0x7f975c124100 2020-01-16T05:44:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.723+0000 7f974f7fe700 1 -- 172.21.15.84:0/2800652346 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f97580056c0 con 0x7f975c124100 2020-01-16T05:44:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.723+0000 7f9762547700 1 --2- 172.21.15.84:0/2800652346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f975c124100 0x7f975c07ae70 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f975c0a49f0 tx=0x7f9758011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.723+0000 7f974f7fe700 1 --2- 172.21.15.84:0/2800652346 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f974403c7a0 0x7f974403ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.723+0000 7f974f7fe700 1 -- 172.21.15.84:0/2800652346 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f975804cf80 con 0x7f975c124100 2020-01-16T05:44:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.723+0000 7f9762d48700 1 --2- 172.21.15.84:0/2800652346 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f974403c7a0 0x7f974403ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.723+0000 7f9762d48700 1 --2- 172.21.15.84:0/2800652346 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f974403c7a0 0x7f974403ecb0 crc :-1 s=READY pgs=52 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.727+0000 7f9762547700 1 --2- 172.21.15.84:0/2800652346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f975c124100 0x7f975c07ae70 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f975c0a49f0 tx=0x7f9758011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.727+0000 7f974f7fe700 1 -- 172.21.15.84:0/2800652346 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f97580335a0 con 0x7f975c124100 2020-01-16T05:44:07.847 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.847+0000 7f9763549700 1 -- 172.21.15.84:0/2800652346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f975c05cbc0 con 0x7f975c124100 2020-01-16T05:44:07.849 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.847+0000 7f9762547700 1 --2- 172.21.15.84:0/2800652346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f975c124100 0x7f975c07ae70 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f975c0a49f0 tx=0x7f9758011720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.849 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.847+0000 7f974f7fe700 1 -- 172.21.15.84:0/2800652346 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14672 (secure 0 0 0) 0x7f9758033800 con 0x7f975c124100 2020-01-16T05:44:07.849 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:07.850 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"cbc67508-4d2a-4483-a1fc-95d371063ac4","created":"2020-01-16T05:43:46.771497+0000","modified":"2020-01-16T05:44:05.941278+0000","last_up_change":"2020-01-16T05:43:55.529492+0000","last_in_change":"2020-01-16T05:43:55.529492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-16T05:43:59.152708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-16T05:44:01.682783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-16T05:44:02.930765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15da60bb-4d16-44cc-80c6-cd2c7fa77364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":12644},{"type":"v1","addr":"172.21.15.84:6812","nonce":12644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":12644},{"type":"v1","addr":"172.21.15.84:6816","nonce":12644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":12644},{"type":"v1","addr":"172.21.15.84:6824","nonce":12644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":12644},{"type":"v1","addr":"172.21.15.84:6820","nonce":12644}]},"public_addr":"172.21.15.84:6812/12644","cluster_addr":"172.21.15.84:6816/12644","heartbeat_back_addr":"172.21.15.84:6824/12644","heartbeat_front_addr":"172.21.15.84:6820/12644","state":["exists","up"]},{"osd":1,"uuid":"0800533c-1d5b-4f9f-99bb-34b8133c8b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":12645},{"type":"v1","addr":"172.21.15.84:6803","nonce":12645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":12645},{"type":"v1","addr":"172.21.15.84:6805","nonce":12645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":12645},{"type":"v1","addr":"172.21.15.84:6809","nonce":12645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":12645},{"type":"v1","addr":"172.21.15.84:6807","nonce":12645}]},"public_addr":"172.21.15.84:6803/12645","cluster_addr":"172.21.15.84:6805/12645","heartbeat_back_addr":"172.21.15.84:6809/12645","heartbeat_front_addr":"172.21.15.84:6807/12645","state":["exists","up"]},{"osd":2,"uuid":"519cc27f-5cf9-4ecf-ad66-f722c37339df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":12646},{"type":"v1","addr":"172.21.15.84:6813","nonce":12646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6815","nonce":12646},{"type":"v1","addr":"172.21.15.84:6817","nonce":12646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":12646},{"type":"v1","addr":"172.21.15.84:6825","nonce":12646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":12646},{"type":"v1","addr":"172.21.15.84:6821","nonce":12646}]},"public_addr":"172.21.15.84:6813/12646","cluster_addr":"172.21.15.84:6817/12646","heartbeat_back_addr":"172.21.15.84:6825/12646","heartbeat_front_addr":"172.21.15.84:6821/12646","state":["exists","up"]},{"osd":3,"uuid":"aec305a6-bbac-4e01-8ea1-6077d49e27e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":12647},{"type":"v1","addr":"172.21.15.84:6827","nonce":12647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":12647},{"type":"v1","addr":"172.21.15.84:6829","nonce":12647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":12647},{"type":"v1","addr":"172.21.15.84:6833","nonce":12647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":12647},{"type":"v1","addr":"172.21.15.84:6831","nonce":12647}]},"public_addr":"172.21.15.84:6827/12647","cluster_addr":"172.21.15.84:6829/12647","heartbeat_back_addr":"172.21.15.84:6833/12647","heartbeat_front_addr":"172.21.15.84:6831/12647","state":["exists","up"]},{"osd":4,"uuid":"aaec7f3e-299a-4546-8406-207bcc4b3afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":12842},{"type":"v1","addr":"172.21.15.142:6801","nonce":12842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12842},{"type":"v1","addr":"172.21.15.142:6803","nonce":12842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12842},{"type":"v1","addr":"172.21.15.142:6807","nonce":12842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12842},{"type":"v1","addr":"172.21.15.142:6805","nonce":12842}]},"public_addr":"172.21.15.142:6801/12842","cluster_addr":"172.21.15.142:6803/12842","heartbeat_back_addr":"172.21.15.142:6807/12842","heartbeat_front_addr":"172.21.15.142:6805/12842","state":["exists","up"]},{"osd":5,"uuid":"5a942a47-7346-46d4-adf8-dad2bdb95aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12843},{"type":"v1","addr":"172.21.15.142:6809","nonce":12843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12843},{"type":"v1","addr":"172.21.15.142:6811","nonce":12843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12843},{"type":"v1","addr":"172.21.15.142:6815","nonce":12843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12843},{"type":"v1","addr":"172.21.15.142:6813","nonce":12843}]},"public_addr":"172.21.15.142:6809/12843","cluster_addr":"172.21.15.142:6811/12843","heartbeat_back_addr":"172.21.15.142:6815/12843","heartbeat_front_addr":"172.21.15.142:6813/12843","state":["exists","up"]},{"osd":6,"uuid":"c69fca67-66e4-4c31-ab03-1419e2a83e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12844},{"type":"v1","addr":"172.21.15.142:6818","nonce":12844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":12844},{"type":"v1","addr":"172.21.15.142:6823","nonce":12844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":12844},{"type":"v1","addr":"172.21.15.142:6831","nonce":12844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":12844},{"type":"v1","addr":"172.21.15.142:6827","nonce":12844}]},"public_addr":"172.21.15.142:6818/12844","cluster_addr":"172.21.15.142:6823/12844","heartbeat_back_addr":"172.21.15.142:6831/12844","heartbeat_front_addr":"172.21.15.142:6827/12844","state":["exists","up"]},{"osd":7,"uuid":"c436f64e-aa1f-435b-ac7b-85633e297591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":12845},{"type":"v1","addr":"172.21.15.142:6819","nonce":12845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12845},{"type":"v1","addr":"172.21.15.142:6822","nonce":12845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12845},{"type":"v1","addr":"172.21.15.142:6830","nonce":12845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12845},{"type":"v1","addr":"172.21.15.142:6826","nonce":12845}]},"public_addr":"172.21.15.142:6819/12845","cluster_addr":"172.21.15.142:6822/12845","heartbeat_back_addr":"172.21.15.142:6830/12845","heartbeat_front_addr":"172.21.15.142:6826/12845","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.534744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.505453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.485516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.333028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.483323+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.567824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.273268+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.559741+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-16T05:44:07.853 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.847+0000 7f9763549700 1 -- 172.21.15.84:0/2800652346 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f974403c7a0 msgr2=0x7f974403ecb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.853 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.847+0000 7f9763549700 1 --2- 172.21.15.84:0/2800652346 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f974403c7a0 0x7f974403ecb0 crc :-1 s=READY pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.854 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.847+0000 7f9763549700 1 -- 172.21.15.84:0/2800652346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f975c124100 msgr2=0x7f975c07ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.854 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.847+0000 7f9763549700 1 --2- 172.21.15.84:0/2800652346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f975c124100 0x7f975c07ae70 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f975c0a49f0 tx=0x7f9758011720).stop 2020-01-16T05:44:07.854 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.847+0000 7f9763549700 1 -- 172.21.15.84:0/2800652346 shutdown_connections 2020-01-16T05:44:07.854 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.847+0000 7f9763549700 1 --2- 172.21.15.84:0/2800652346 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f974403c7a0 0x7f974403ecb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.854 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.847+0000 7f9763549700 1 --2- 172.21.15.84:0/2800652346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f975c124100 0x7f975c07ae70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.855 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.847+0000 7f9763549700 1 -- 172.21.15.84:0/2800652346 shutdown_connections 2020-01-16T05:44:07.855 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.847+0000 7f9763549700 1 -- 172.21.15.84:0/2800652346 wait complete. 2020-01-16T05:44:07.855 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.847+0000 7f9763549700 1 -- 172.21.15.84:0/2800652346 >> 172.21.15.84:0/2800652346 conn(0x7f975c0a9b30 msgr2=0x7f975c0a3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:07.864 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-01-16T05:44:07.864 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-16T05:44:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.971+0000 7f92519b5700 1 Processor -- start 2020-01-16T05:44:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.971+0000 7f92519b5700 1 -- start start 2020-01-16T05:44:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.971+0000 7f92519b5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f924c07ff10 0x7f924c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.971+0000 7f92519b5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f924c066880 con 0x7f924c0a4250 2020-01-16T05:44:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.971+0000 7f92519b5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f924c066ab0 con 0x7f924c0a9b30 2020-01-16T05:44:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.971+0000 7f92519b5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924c0a4830 con 0x7f924c07ff10 2020-01-16T05:44:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.971+0000 7f9252c17700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f924c0a4250 0x7f924c14fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51298/0 (socket says 172.21.15.84:51298) 2020-01-16T05:44:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.971+0000 7f92509b3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f924c07ff10 0x7f924c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.971+0000 7f9252c17700 1 -- 172.21.15.84:0/170037080 learned_addr learned my addr 172.21.15.84:0/170037080 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.971+0000 7f92509b3700 1 -- 172.21.15.84:0/170037080 >> v1:172.21.15.142:6789/0 conn(0x7f924c0a9b30 legacy=0x7f924c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.971+0000 7f92509b3700 1 -- 172.21.15.84:0/170037080 >> v1:172.21.15.84:6789/0 conn(0x7f924c0a4250 legacy=0x7f924c14fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.971+0000 7f924bfff700 1 -- 172.21.15.84:0/170037080 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475075508 0 0) 0x7f924c066880 con 0x7f924c0a4250 2020-01-16T05:44:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.971+0000 7f92509b3700 1 -- 172.21.15.84:0/170037080 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c066ce0 con 0x7f924c07ff10 2020-01-16T05:44:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.971+0000 7f92509b3700 1 --2- 172.21.15.84:0/170037080 >> v2:172.21.15.84:3300/0 conn(0x7f924c07ff10 0x7f924c0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9240008910 tx=0x7f924000fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.971+0000 7f92509b3700 1 --2- 172.21.15.84:0/170037080 >> v2:172.21.15.84:3300/0 conn(0x7f924c07ff10 0x7f924c0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9240008910 tx=0x7f924000fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.975+0000 7f92509b3700 1 --2- 172.21.15.84:0/170037080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f924c07ff10 0x7f924c0abdd0 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f9240008910 tx=0x7f924000fd70).ready entity=mon.0 client_cookie=d09bff8420dbcea0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.975+0000 7f92509b3700 1 --2- 172.21.15.84:0/170037080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f924c07ff10 0x7f924c0abdd0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f9240008910 tx=0x7f924000fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.975+0000 7f924bfff700 1 -- 172.21.15.84:0/170037080 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92400115e0 con 0x7f924c07ff10 2020-01-16T05:44:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.975+0000 7f92509b3700 1 --2- 172.21.15.84:0/170037080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f924c07ff10 0x7f924c0abdd0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f9240008910 tx=0x7f924000fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.975+0000 7f92509b3700 1 --2- 172.21.15.84:0/170037080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f924c07ff10 0x7f924c0abdd0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f9240008910 tx=0x7f924000fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.975+0000 7f924bfff700 1 -- 172.21.15.84:0/170037080 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9240008d40 con 0x7f924c07ff10 2020-01-16T05:44:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.975+0000 7f924bfff700 1 -- 172.21.15.84:0/170037080 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9240011bc0 con 0x7f924c07ff10 2020-01-16T05:44:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.975+0000 7f92519b5700 1 -- 172.21.15.84:0/170037080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f924c07ff10 msgr2=0x7f924c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.975+0000 7f92519b5700 1 --2- 172.21.15.84:0/170037080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f924c07ff10 0x7f924c0abdd0 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f9240008910 tx=0x7f924000fd70).stop 2020-01-16T05:44:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.975+0000 7f92519b5700 1 -- 172.21.15.84:0/170037080 shutdown_connections 2020-01-16T05:44:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.975+0000 7f92519b5700 1 --2- 172.21.15.84:0/170037080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f924c07ff10 0x7f924c0abdd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.975+0000 7f92519b5700 1 -- 172.21.15.84:0/170037080 shutdown_connections 2020-01-16T05:44:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.975+0000 7f92519b5700 1 -- 172.21.15.84:0/170037080 wait complete. 2020-01-16T05:44:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.975+0000 7f92519b5700 1 -- 172.21.15.84:0/170037080 >> 172.21.15.84:0/170037080 conn(0x7f924c0acfc0 msgr2=0x7f924c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:07.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.975+0000 7f92519b5700 1 Processor -- start 2020-01-16T05:44:07.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.975+0000 7f92519b5700 1 -- start start 2020-01-16T05:44:07.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92519b5700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f924c127390 0x7f924c07d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:07.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92519b5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f924c13d120 0x7f924c13f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:07.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92519b5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f924c0a7e60 con 0x7f924c0a78c0 2020-01-16T05:44:07.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92519b5700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924c0907a0 con 0x7f924c127390 2020-01-16T05:44:07.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92519b5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924c090a40 con 0x7f924c13d120 2020-01-16T05:44:07.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92509b3700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f924c127390 0x7f924c07d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f9252c17700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f924c13d120 0x7f924c13f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f9252c17700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f924c13d120 0x7f924c13f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:46350/0 (socket says 172.21.15.84:46350) 2020-01-16T05:44:07.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92509b3700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f924c127390 0x7f924c07d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.84:44088/0 (socket says 172.21.15.84:44088) 2020-01-16T05:44:07.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f9252c17700 1 -- 172.21.15.84:0/3904242828 learned_addr learned my addr 172.21.15.84:0/3904242828 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:07.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92509b3700 1 -- 172.21.15.84:0/3904242828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f924c13d120 msgr2=0x7f924c13f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92509b3700 1 --2- 172.21.15.84:0/3904242828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f924c13d120 0x7f924c13f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:07.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92509b3700 1 -- 172.21.15.84:0/3904242828 >> v1:172.21.15.142:6789/0 conn(0x7f924c0a78c0 legacy=0x7f924c137d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:07.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92509b3700 1 -- 172.21.15.84:0/3904242828 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c0a6f40 con 0x7f924c127390 2020-01-16T05:44:07.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f9249ffb700 1 -- 172.21.15.84:0/3904242828 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989317722 0 0) 0x7f924c0a7e60 con 0x7f924c0a78c0 2020-01-16T05:44:07.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92509b3700 1 --2- 172.21.15.84:0/3904242828 >> v2:172.21.15.142:3300/0 conn(0x7f924c127390 0x7f924c07d1e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f924c090960 tx=0x7f92400116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92509b3700 1 --2- 172.21.15.84:0/3904242828 >> v2:172.21.15.142:3300/0 conn(0x7f924c127390 0x7f924c07d1e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f924c090960 tx=0x7f92400116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92509b3700 1 --2- 172.21.15.84:0/3904242828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f924c127390 0x7f924c07d1e0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f924c090960 tx=0x7f92400116a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92509b3700 1 --2- 172.21.15.84:0/3904242828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f924c127390 0x7f924c07d1e0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f924c090960 tx=0x7f92400116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f9249ffb700 1 -- 172.21.15.84:0/3904242828 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f924000f700 con 0x7f924c127390 2020-01-16T05:44:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92509b3700 1 --2- 172.21.15.84:0/3904242828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f924c127390 0x7f924c07d1e0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f924c090960 tx=0x7f92400116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92509b3700 1 --2- 172.21.15.84:0/3904242828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f924c127390 0x7f924c07d1e0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f924c090960 tx=0x7f92400116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f9249ffb700 1 -- 172.21.15.84:0/3904242828 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92400117e0 con 0x7f924c127390 2020-01-16T05:44:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92519b5700 1 -- 172.21.15.84:0/3904242828 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924c0a9030 con 0x7f924c127390 2020-01-16T05:44:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f9249ffb700 1 -- 172.21.15.84:0/3904242828 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9240007530 con 0x7f924c127390 2020-01-16T05:44:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92519b5700 1 -- 172.21.15.84:0/3904242828 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924c090ce0 con 0x7f924c127390 2020-01-16T05:44:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92509b3700 1 --2- 172.21.15.84:0/3904242828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f924c127390 0x7f924c07d1e0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f924c090960 tx=0x7f92400116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f9249ffb700 1 -- 172.21.15.84:0/3904242828 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f92400056c0 con 0x7f924c127390 2020-01-16T05:44:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92509b3700 1 --2- 172.21.15.84:0/3904242828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f924c127390 0x7f924c07d1e0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f924c090960 tx=0x7f92400116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.979+0000 7f92519b5700 1 -- 172.21.15.84:0/3904242828 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924c05e1c0 con 0x7f924c127390 2020-01-16T05:44:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.983+0000 7f9249ffb700 1 --2- 172.21.15.84:0/3904242828 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f922c03c1a0 0x7f922c03e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:07.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.983+0000 7f9249ffb700 1 -- 172.21.15.84:0/3904242828 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f924004ce40 con 0x7f924c127390 2020-01-16T05:44:07.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.983+0000 7f92511b4700 1 --2- 172.21.15.84:0/3904242828 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f922c03c1a0 0x7f922c03e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:07.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.983+0000 7f92511b4700 1 --2- 172.21.15.84:0/3904242828 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f922c03c1a0 0x7f922c03e6b0 crc :-1 s=READY pgs=53 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:07.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.987+0000 7f92509b3700 1 --2- 172.21.15.84:0/3904242828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f924c127390 0x7f924c07d1e0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f924c090960 tx=0x7f92400116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:07.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:07.987+0000 7f9249ffb700 1 -- 172.21.15.84:0/3904242828 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f9240033440 con 0x7f924c127390 2020-01-16T05:44:08.110 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.111+0000 7f92519b5700 1 -- 172.21.15.84:0/3904242828 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f924c05cbc0 con 0x7f924c127390 2020-01-16T05:44:08.112 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.111+0000 7f92509b3700 1 --2- 172.21.15.84:0/3904242828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f924c127390 0x7f924c07d1e0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f924c090960 tx=0x7f92400116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.113 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.111+0000 7f9249ffb700 1 -- 172.21.15.84:0/3904242828 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14672 (secure 0 0 0) 0x7f92400336a0 con 0x7f924c127390 2020-01-16T05:44:08.113 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:08.113 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"cbc67508-4d2a-4483-a1fc-95d371063ac4","created":"2020-01-16T05:43:46.771497+0000","modified":"2020-01-16T05:44:05.941278+0000","last_up_change":"2020-01-16T05:43:55.529492+0000","last_in_change":"2020-01-16T05:43:55.529492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-16T05:43:59.152708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-16T05:44:01.682783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-16T05:44:02.930765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15da60bb-4d16-44cc-80c6-cd2c7fa77364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":12644},{"type":"v1","addr":"172.21.15.84:6812","nonce":12644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":12644},{"type":"v1","addr":"172.21.15.84:6816","nonce":12644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":12644},{"type":"v1","addr":"172.21.15.84:6824","nonce":12644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":12644},{"type":"v1","addr":"172.21.15.84:6820","nonce":12644}]},"public_addr":"172.21.15.84:6812/12644","cluster_addr":"172.21.15.84:6816/12644","heartbeat_back_addr":"172.21.15.84:6824/12644","heartbeat_front_addr":"172.21.15.84:6820/12644","state":["exists","up"]},{"osd":1,"uuid":"0800533c-1d5b-4f9f-99bb-34b8133c8b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":12645},{"type":"v1","addr":"172.21.15.84:6803","nonce":12645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":12645},{"type":"v1","addr":"172.21.15.84:6805","nonce":12645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":12645},{"type":"v1","addr":"172.21.15.84:6809","nonce":12645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":12645},{"type":"v1","addr":"172.21.15.84:6807","nonce":12645}]},"public_addr":"172.21.15.84:6803/12645","cluster_addr":"172.21.15.84:6805/12645","heartbeat_back_addr":"172.21.15.84:6809/12645","heartbeat_front_addr":"172.21.15.84:6807/12645","state":["exists","up"]},{"osd":2,"uuid":"519cc27f-5cf9-4ecf-ad66-f722c37339df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":12646},{"type":"v1","addr":"172.21.15.84:6813","nonce":12646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6815","nonce":12646},{"type":"v1","addr":"172.21.15.84:6817","nonce":12646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":12646},{"type":"v1","addr":"172.21.15.84:6825","nonce":12646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":12646},{"type":"v1","addr":"172.21.15.84:6821","nonce":12646}]},"public_addr":"172.21.15.84:6813/12646","cluster_addr":"172.21.15.84:6817/12646","heartbeat_back_addr":"172.21.15.84:6825/12646","heartbeat_front_addr":"172.21.15.84:6821/12646","state":["exists","up"]},{"osd":3,"uuid":"aec305a6-bbac-4e01-8ea1-6077d49e27e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":12647},{"type":"v1","addr":"172.21.15.84:6827","nonce":12647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":12647},{"type":"v1","addr":"172.21.15.84:6829","nonce":12647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":12647},{"type":"v1","addr":"172.21.15.84:6833","nonce":12647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":12647},{"type":"v1","addr":"172.21.15.84:6831","nonce":12647}]},"public_addr":"172.21.15.84:6827/12647","cluster_addr":"172.21.15.84:6829/12647","heartbeat_back_addr":"172.21.15.84:6833/12647","heartbeat_front_addr":"172.21.15.84:6831/12647","state":["exists","up"]},{"osd":4,"uuid":"aaec7f3e-299a-4546-8406-207bcc4b3afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":12842},{"type":"v1","addr":"172.21.15.142:6801","nonce":12842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12842},{"type":"v1","addr":"172.21.15.142:6803","nonce":12842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12842},{"type":"v1","addr":"172.21.15.142:6807","nonce":12842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12842},{"type":"v1","addr":"172.21.15.142:6805","nonce":12842}]},"public_addr":"172.21.15.142:6801/12842","cluster_addr":"172.21.15.142:6803/12842","heartbeat_back_addr":"172.21.15.142:6807/12842","heartbeat_front_addr":"172.21.15.142:6805/12842","state":["exists","up"]},{"osd":5,"uuid":"5a942a47-7346-46d4-adf8-dad2bdb95aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12843},{"type":"v1","addr":"172.21.15.142:6809","nonce":12843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12843},{"type":"v1","addr":"172.21.15.142:6811","nonce":12843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12843},{"type":"v1","addr":"172.21.15.142:6815","nonce":12843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12843},{"type":"v1","addr":"172.21.15.142:6813","nonce":12843}]},"public_addr":"172.21.15.142:6809/12843","cluster_addr":"172.21.15.142:6811/12843","heartbeat_back_addr":"172.21.15.142:6815/12843","heartbeat_front_addr":"172.21.15.142:6813/12843","state":["exists","up"]},{"osd":6,"uuid":"c69fca67-66e4-4c31-ab03-1419e2a83e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12844},{"type":"v1","addr":"172.21.15.142:6818","nonce":12844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":12844},{"type":"v1","addr":"172.21.15.142:6823","nonce":12844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":12844},{"type":"v1","addr":"172.21.15.142:6831","nonce":12844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":12844},{"type":"v1","addr":"172.21.15.142:6827","nonce":12844}]},"public_addr":"172.21.15.142:6818/12844","cluster_addr":"172.21.15.142:6823/12844","heartbeat_back_addr":"172.21.15.142:6831/12844","heartbeat_front_addr":"172.21.15.142:6827/12844","state":["exists","up"]},{"osd":7,"uuid":"c436f64e-aa1f-435b-ac7b-85633e297591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":12845},{"type":"v1","addr":"172.21.15.142:6819","nonce":12845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12845},{"type":"v1","addr":"172.21.15.142:6822","nonce":12845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12845},{"type":"v1","addr":"172.21.15.142:6830","nonce":12845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12845},{"type":"v1","addr":"172.21.15.142:6826","nonce":12845}]},"public_addr":"172.21.15.142:6819/12845","cluster_addr":"172.21.15.142:6822/12845","heartbeat_back_addr":"172.21.15.142:6830/12845","heartbeat_front_addr":"172.21.15.142:6826/12845","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.534744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.505453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.485516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.333028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.483323+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.567824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.273268+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.559741+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-16T05:44:08.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.115+0000 7f92519b5700 1 -- 172.21.15.84:0/3904242828 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f922c03c1a0 msgr2=0x7f922c03e6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.115+0000 7f92519b5700 1 --2- 172.21.15.84:0/3904242828 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f922c03c1a0 0x7f922c03e6b0 crc :-1 s=READY pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.115+0000 7f92519b5700 1 -- 172.21.15.84:0/3904242828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f924c127390 msgr2=0x7f924c07d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.115+0000 7f92519b5700 1 --2- 172.21.15.84:0/3904242828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f924c127390 0x7f924c07d1e0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f924c090960 tx=0x7f92400116a0).stop 2020-01-16T05:44:08.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.115+0000 7f92519b5700 1 -- 172.21.15.84:0/3904242828 shutdown_connections 2020-01-16T05:44:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.115+0000 7f92519b5700 1 --2- 172.21.15.84:0/3904242828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f924c13d120 0x7f924c13f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.115+0000 7f92519b5700 1 --2- 172.21.15.84:0/3904242828 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f922c03c1a0 0x7f922c03e6b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.115+0000 7f92519b5700 1 --2- 172.21.15.84:0/3904242828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f924c127390 0x7f924c07d1e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.115+0000 7f92519b5700 1 -- 172.21.15.84:0/3904242828 shutdown_connections 2020-01-16T05:44:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.115+0000 7f92519b5700 1 -- 172.21.15.84:0/3904242828 wait complete. 2020-01-16T05:44:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.115+0000 7f92519b5700 1 -- 172.21.15.84:0/3904242828 >> 172.21.15.84:0/3904242828 conn(0x7f924c05f400 msgr2=0x7f924c0246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:08.133 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2020-01-16T05:44:08.247 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.239+0000 7f30e951c700 1 Processor -- start 2020-01-16T05:44:08.248 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.239+0000 7f30e951c700 1 -- start start 2020-01-16T05:44:08.248 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e951c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30e40a8ff0 0x7f30e408fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:08.248 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e951c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e40902d0 con 0x7f30e405b0f0 2020-01-16T05:44:08.248 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e951c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e407cd60 con 0x7f30e40a2f60 2020-01-16T05:44:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e951c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e40a3390 con 0x7f30e40a8ff0 2020-01-16T05:44:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e2ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f30e405b0f0 0x7f30e414e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51310/0 (socket says 172.21.15.84:51310) 2020-01-16T05:44:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e2ffd700 1 -- 172.21.15.84:0/2223909556 learned_addr learned my addr 172.21.15.84:0/2223909556 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e3fff700 1 --2- 172.21.15.84:0/2223909556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30e40a8ff0 0x7f30e408fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 -- 172.21.15.84:0/2223909556 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126295811 0 0) 0x7f30d80010d0 con 0x7f30e405b0f0 2020-01-16T05:44:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 -- 172.21.15.84:0/2223909556 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30cc003230 con 0x7f30e405b0f0 2020-01-16T05:44:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 -- 172.21.15.84:0/2223909556 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871351558 0 0) 0x7f30e407cd60 con 0x7f30e40a2f60 2020-01-16T05:44:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 -- 172.21.15.84:0/2223909556 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30d80010d0 con 0x7f30e40a2f60 2020-01-16T05:44:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 -- 172.21.15.84:0/2223909556 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1334795812 0 0) 0x7f30cc003230 con 0x7f30e405b0f0 2020-01-16T05:44:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 -- 172.21.15.84:0/2223909556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30e40a8ff0 msgr2=0x7f30e408fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 --2- 172.21.15.84:0/2223909556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30e40a8ff0 0x7f30e408fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 -- 172.21.15.84:0/2223909556 >> v1:172.21.15.142:6789/0 conn(0x7f30e40a2f60 legacy=0x7f30e407c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 -- 172.21.15.84:0/2223909556 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e405b520 con 0x7f30e405b0f0 2020-01-16T05:44:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 -- 172.21.15.84:0/2223909556 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f30d8001980 con 0x7f30e405b0f0 2020-01-16T05:44:08.251 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 -- 172.21.15.84:0/2223909556 >> v1:172.21.15.84:6789/0 conn(0x7f30e405b0f0 legacy=0x7f30e414e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.251 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 --2- 172.21.15.84:0/2223909556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30cc003ac0 0x7f30cc003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:08.251 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 --2- 172.21.15.84:0/2223909556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30cc0045a0 0x7f30cc004a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:08.251 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/2223909556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30cc0045a0 0x7f30cc004a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 --2- 172.21.15.84:0/2223909556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30cc005120 0x7f30cc04f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:08.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 -- 172.21.15.84:0/2223909556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e40a3390 con 0x7f30cc0045a0 2020-01-16T05:44:08.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 -- 172.21.15.84:0/2223909556 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc04fd80 con 0x7f30cc003ac0 2020-01-16T05:44:08.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 -- 172.21.15.84:0/2223909556 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc04ffc0 con 0x7f30cc005120 2020-01-16T05:44:08.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e37fe700 1 --2- 172.21.15.84:0/2223909556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30cc003ac0 0x7f30cc003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e3fff700 1 --2- 172.21.15.84:0/2223909556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30cc005120 0x7f30cc04f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e2ffd700 1 -- 172.21.15.84:0/2223909556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30cc005120 msgr2=0x7f30cc04f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:08.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/2223909556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30cc005120 0x7f30cc04f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:08.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e2ffd700 1 -- 172.21.15.84:0/2223909556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30cc003ac0 msgr2=0x7f30cc003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:08.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/2223909556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30cc003ac0 0x7f30cc003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:08.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e2ffd700 1 -- 172.21.15.84:0/2223909556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc050260 con 0x7f30cc0045a0 2020-01-16T05:44:08.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/2223909556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30cc0045a0 0x7f30cc004a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f30d8001750 tx=0x7f30d800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/2223909556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30cc0045a0 0x7f30cc004a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f30d8001750 tx=0x7f30d800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/2223909556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30cc0045a0 0x7f30cc004a70 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7f30d8001750 tx=0x7f30d800c4e0).ready entity=mon.0 client_cookie=64c19a0d31ccde5a server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/2223909556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30cc0045a0 0x7f30cc004a70 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f30d8001750 tx=0x7f30d800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 -- 172.21.15.84:0/2223909556 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30d80059c0 con 0x7f30cc0045a0 2020-01-16T05:44:08.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/2223909556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30cc0045a0 0x7f30cc004a70 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f30d8001750 tx=0x7f30d800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/2223909556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30cc0045a0 0x7f30cc004a70 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f30d8001750 tx=0x7f30d800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 -- 172.21.15.84:0/2223909556 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d80055e0 con 0x7f30cc0045a0 2020-01-16T05:44:08.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e27fc700 1 -- 172.21.15.84:0/2223909556 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30d8010160 con 0x7f30cc0045a0 2020-01-16T05:44:08.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e951c700 1 -- 172.21.15.84:0/2223909556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30cc0045a0 msgr2=0x7f30cc004a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e951c700 1 --2- 172.21.15.84:0/2223909556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30cc0045a0 0x7f30cc004a70 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7f30d8001750 tx=0x7f30d800c4e0).stop 2020-01-16T05:44:08.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e3fff700 1 -- 172.21.15.84:0/2223909556 reap_dead start 2020-01-16T05:44:08.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e951c700 1 -- 172.21.15.84:0/2223909556 shutdown_connections 2020-01-16T05:44:08.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e951c700 1 -- 172.21.15.84:0/2223909556 shutdown_connections 2020-01-16T05:44:08.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e951c700 1 -- 172.21.15.84:0/2223909556 wait complete. 2020-01-16T05:44:08.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.243+0000 7f30e951c700 1 -- 172.21.15.84:0/2223909556 >> 172.21.15.84:0/2223909556 conn(0x7f30e40abc10 msgr2=0x7f30e405a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:08.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e951c700 1 Processor -- start 2020-01-16T05:44:08.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e951c700 1 -- start start 2020-01-16T05:44:08.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e951c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f30e40a19f0 0x7f30e41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e951c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30e4125ec0 0x7f30e40a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e951c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e40998a0 con 0x7f30e4149290 2020-01-16T05:44:08.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e951c700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e412fcd0 con 0x7f30e40a19f0 2020-01-16T05:44:08.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e951c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e412ff70 con 0x7f30e4125ec0 2020-01-16T05:44:08.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e37fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f30e40a19f0 0x7f30e41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e2ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30e4125ec0 0x7f30e40a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.266 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e37fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f30e40a19f0 0x7f30e41304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.84:44106/0 (socket says 172.21.15.84:44106) 2020-01-16T05:44:08.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e2ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30e4125ec0 0x7f30e40a58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:46370/0 (socket says 172.21.15.84:46370) 2020-01-16T05:44:08.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e37fe700 1 -- 172.21.15.84:0/1233812009 learned_addr learned my addr 172.21.15.84:0/1233812009 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:08.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e2ffd700 1 -- 172.21.15.84:0/1233812009 >> v2:172.21.15.142:3300/0 conn(0x7f30e40a19f0 msgr2=0x7f30e41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/1233812009 >> v2:172.21.15.142:3300/0 conn(0x7f30e40a19f0 0x7f30e41304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e2ffd700 1 -- 172.21.15.84:0/1233812009 >> v1:172.21.15.142:6789/0 conn(0x7f30e4149290 legacy=0x7f30e4132e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e2ffd700 1 -- 172.21.15.84:0/1233812009 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e40a5df0 con 0x7f30e4125ec0 2020-01-16T05:44:08.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e37fe700 1 --2- 172.21.15.84:0/1233812009 >> v2:172.21.15.142:3300/0 conn(0x7f30e40a19f0 0x7f30e41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/1233812009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30e4125ec0 0x7f30e40a58a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f30d8001750 tx=0x7f30d800bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/1233812009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30e4125ec0 0x7f30e40a58a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f30d8001750 tx=0x7f30d800bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/1233812009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30e4125ec0 0x7f30e40a58a0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f30d8001750 tx=0x7f30d800bf80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/1233812009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30e4125ec0 0x7f30e40a58a0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f30d8001750 tx=0x7f30d800bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30cbfff700 1 -- 172.21.15.84:0/1233812009 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30d8001b90 con 0x7f30e4125ec0 2020-01-16T05:44:08.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/1233812009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30e4125ec0 0x7f30e40a58a0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f30d8001750 tx=0x7f30d800bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/1233812009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30e4125ec0 0x7f30e40a58a0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f30d8001750 tx=0x7f30d800bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30cbfff700 1 -- 172.21.15.84:0/1233812009 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d8005bc0 con 0x7f30e4125ec0 2020-01-16T05:44:08.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30e951c700 1 -- 172.21.15.84:0/1233812009 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e412f8a0 con 0x7f30e4125ec0 2020-01-16T05:44:08.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.247+0000 7f30cbfff700 1 -- 172.21.15.84:0/1233812009 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30d8008b90 con 0x7f30e4125ec0 2020-01-16T05:44:08.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.251+0000 7f30e951c700 1 -- 172.21.15.84:0/1233812009 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e41496c0 con 0x7f30e4125ec0 2020-01-16T05:44:08.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.251+0000 7f30e951c700 1 -- 172.21.15.84:0/1233812009 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f30e405e1c0 con 0x7f30e4125ec0 2020-01-16T05:44:08.275 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.251+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/1233812009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30e4125ec0 0x7f30e40a58a0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f30d8001750 tx=0x7f30d800bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.275 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.251+0000 7f30cbfff700 1 -- 172.21.15.84:0/1233812009 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f30d800b220 con 0x7f30e4125ec0 2020-01-16T05:44:08.275 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.251+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/1233812009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30e4125ec0 0x7f30e40a58a0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f30d8001750 tx=0x7f30d800bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.275 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.251+0000 7f30e2ffd700 1 --2- 172.21.15.84:0/1233812009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30e4125ec0 0x7f30e40a58a0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f30d8001750 tx=0x7f30d800bf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.276 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.251+0000 7f30cbfff700 1 --2- 172.21.15.84:0/1233812009 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f30c403c270 0x7f30c403e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.276 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.251+0000 7f30cbfff700 1 -- 172.21.15.84:0/1233812009 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f30d804ca10 con 0x7f30e4125ec0 2020-01-16T05:44:08.276 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.251+0000 7f30e37fe700 1 --2- 172.21.15.84:0/1233812009 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f30c403c270 0x7f30c403e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.276 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.251+0000 7f30cbfff700 1 --2- 172.21.15.84:0/1233812009 >> [v2:172.21.15.84:6810/12644,v1:172.21.15.84:6812/12644] conn(0x7f30c4042b20 0x7f30c4044f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.276 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.251+0000 7f30cbfff700 1 -- 172.21.15.84:0/1233812009 --> [v2:172.21.15.84:6810/12644,v1:172.21.15.84:6812/12644] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30c4045640 con 0x7f30c4042b20 2020-01-16T05:44:08.276 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.251+0000 7f30cbfff700 1 -- 172.21.15.84:0/1233812009 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30d804cea0 con 0x7f30e4125ec0 2020-01-16T05:44:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.251+0000 7f30e37fe700 1 --2- 172.21.15.84:0/1233812009 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f30c403c270 0x7f30c403e780 crc :-1 s=READY pgs=54 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.251+0000 7f30e3fff700 1 --2- 172.21.15.84:0/1233812009 >> [v2:172.21.15.84:6810/12644,v1:172.21.15.84:6812/12644] conn(0x7f30c4042b20 0x7f30c4044f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.251+0000 7f30e3fff700 1 -- 172.21.15.84:0/1233812009 >> [v2:172.21.15.84:6810/12644,v1:172.21.15.84:6812/12644] conn(0x7f30c4042b20 msgr2=0x7f30c4044f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2020-01-16T05:44:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.251+0000 7f30e3fff700 1 --2- 172.21.15.84:0/1233812009 >> [v2:172.21.15.84:6810/12644,v1:172.21.15.84:6812/12644] conn(0x7f30c4042b20 0x7f30c4044f90 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.255+0000 7f30cbfff700 1 -- 172.21.15.84:0/1233812009 <== osd.0 v2:172.21.15.84:6810/12644 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (crc 0 0 0) 0x7f30c4045640 con 0x7f30c4042b20 2020-01-16T05:44:08.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.271+0000 7f30e951c700 1 -- 172.21.15.84:0/1233812009 --> [v2:172.21.15.84:6810/12644,v1:172.21.15.84:6812/12644] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f30e408f350 con 0x7f30c4042b20 2020-01-16T05:44:08.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.275+0000 7f30cbfff700 1 -- 172.21.15.84:0/1233812009 <== osd.0 v2:172.21.15.84:6810/12644 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f30e408f350 con 0x7f30c4042b20 2020-01-16T05:44:08.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.275+0000 7f30e951c700 1 -- 172.21.15.84:0/1233812009 >> [v2:172.21.15.84:6810/12644,v1:172.21.15.84:6812/12644] conn(0x7f30c4042b20 msgr2=0x7f30c4044f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.275+0000 7f30e951c700 1 --2- 172.21.15.84:0/1233812009 >> [v2:172.21.15.84:6810/12644,v1:172.21.15.84:6812/12644] conn(0x7f30c4042b20 0x7f30c4044f90 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.275+0000 7f30e951c700 1 -- 172.21.15.84:0/1233812009 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f30c403c270 msgr2=0x7f30c403e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.275+0000 7f30e951c700 1 --2- 172.21.15.84:0/1233812009 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f30c403c270 0x7f30c403e780 crc :-1 s=READY pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.275+0000 7f30e951c700 1 -- 172.21.15.84:0/1233812009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30e4125ec0 msgr2=0x7f30e40a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.275+0000 7f30e951c700 1 --2- 172.21.15.84:0/1233812009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30e4125ec0 0x7f30e40a58a0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f30d8001750 tx=0x7f30d800bf80).stop 2020-01-16T05:44:08.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.275+0000 7f30e3fff700 1 -- 172.21.15.84:0/1233812009 reap_dead start 2020-01-16T05:44:08.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.275+0000 7f30e951c700 1 -- 172.21.15.84:0/1233812009 shutdown_connections 2020-01-16T05:44:08.287 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.275+0000 7f30e951c700 1 -- 172.21.15.84:0/1233812009 shutdown_connections 2020-01-16T05:44:08.287 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.275+0000 7f30e951c700 1 -- 172.21.15.84:0/1233812009 wait complete. 2020-01-16T05:44:08.287 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.275+0000 7f30e951c700 1 -- 172.21.15.84:0/1233812009 >> 172.21.15.84:0/1233812009 conn(0x7f30e40a6bc0 msgr2=0x7f30e409d210 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:08.294 INFO:teuthology.orchestra.run.smithi084.stdout:60129542150 2020-01-16T05:44:08.300 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2020-01-16T05:44:08.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.415+0000 7f4e8a7b2700 1 Processor -- start 2020-01-16T05:44:08.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.415+0000 7f4e8a7b2700 1 -- start start 2020-01-16T05:44:08.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e8a7b2700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4e840a2f60 0x7f4e8405b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:08.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e8a7b2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4e8408fd80 0x7f4e841503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:08.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e8a7b2700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8407cd60 con 0x7f4e840a8ff0 2020-01-16T05:44:08.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e8a7b2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e840a3390 con 0x7f4e8408fd80 2020-01-16T05:44:08.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e8a7b2700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e840905b0 con 0x7f4e840a2f60 2020-01-16T05:44:08.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e89550700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4e8408fd80 0x7f4e841503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e89550700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4e8408fd80 0x7f4e841503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34136/0 (socket says 172.21.15.84:34136) 2020-01-16T05:44:08.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e89550700 1 -- 172.21.15.84:0/3770587499 learned_addr learned my addr 172.21.15.84:0/3770587499 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:08.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e88d4f700 1 --2- 172.21.15.84:0/3770587499 >> v2:172.21.15.142:3300/0 conn(0x7f4e840a2f60 0x7f4e8405b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e89550700 1 -- 172.21.15.84:0/3770587499 >> v2:172.21.15.142:3300/0 conn(0x7f4e840a2f60 msgr2=0x7f4e8405b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:08.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e89550700 1 --2- 172.21.15.84:0/3770587499 >> v2:172.21.15.142:3300/0 conn(0x7f4e840a2f60 0x7f4e8405b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:08.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e89550700 1 -- 172.21.15.84:0/3770587499 >> v1:172.21.15.142:6789/0 conn(0x7f4e840a8ff0 legacy=0x7f4e8407c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e89550700 1 -- 172.21.15.84:0/3770587499 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e840a9420 con 0x7f4e8408fd80 2020-01-16T05:44:08.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e89550700 1 --2- 172.21.15.84:0/3770587499 >> v2:172.21.15.84:3300/0 conn(0x7f4e8408fd80 0x7f4e841503f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4e840a2530 tx=0x7f4e7c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e89550700 1 --2- 172.21.15.84:0/3770587499 >> v2:172.21.15.84:3300/0 conn(0x7f4e8408fd80 0x7f4e841503f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4e840a2530 tx=0x7f4e7c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e89550700 1 --2- 172.21.15.84:0/3770587499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e8408fd80 0x7f4e841503f0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f4e840a2530 tx=0x7f4e7c00feb0).ready entity=mon.0 client_cookie=5f57165e1fa03b36 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e89550700 1 --2- 172.21.15.84:0/3770587499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e8408fd80 0x7f4e841503f0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f4e840a2530 tx=0x7f4e7c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e89550700 1 --2- 172.21.15.84:0/3770587499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e8408fd80 0x7f4e841503f0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f4e840a2530 tx=0x7f4e7c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e837fe700 1 -- 172.21.15.84:0/3770587499 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7c0116e0 con 0x7f4e8408fd80 2020-01-16T05:44:08.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e89550700 1 --2- 172.21.15.84:0/3770587499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e8408fd80 0x7f4e841503f0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f4e840a2530 tx=0x7f4e7c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e837fe700 1 -- 172.21.15.84:0/3770587499 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c008d30 con 0x7f4e8408fd80 2020-01-16T05:44:08.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e837fe700 1 -- 172.21.15.84:0/3770587499 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7c011cc0 con 0x7f4e8408fd80 2020-01-16T05:44:08.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e8a7b2700 1 -- 172.21.15.84:0/3770587499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e8408fd80 msgr2=0x7f4e841503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e8a7b2700 1 --2- 172.21.15.84:0/3770587499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e8408fd80 0x7f4e841503f0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f4e840a2530 tx=0x7f4e7c00feb0).stop 2020-01-16T05:44:08.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e8a7b2700 1 -- 172.21.15.84:0/3770587499 shutdown_connections 2020-01-16T05:44:08.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e8a7b2700 1 --2- 172.21.15.84:0/3770587499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e8408fd80 0x7f4e841503f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e8a7b2700 1 --2- 172.21.15.84:0/3770587499 >> v2:172.21.15.142:3300/0 conn(0x7f4e840a2f60 0x7f4e8405b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:08.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e8a7b2700 1 -- 172.21.15.84:0/3770587499 shutdown_connections 2020-01-16T05:44:08.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e8a7b2700 1 -- 172.21.15.84:0/3770587499 wait complete. 2020-01-16T05:44:08.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.419+0000 7f4e8a7b2700 1 -- 172.21.15.84:0/3770587499 >> 172.21.15.84:0/3770587499 conn(0x7f4e840abc10 msgr2=0x7f4e8405a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:08.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e8a7b2700 1 Processor -- start 2020-01-16T05:44:08.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e8a7b2700 1 -- start start 2020-01-16T05:44:08.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e8a7b2700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4e8407f170 0x7f4e841341c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e8a7b2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4e84134710 0x7f4e84134b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e8a7b2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e84123b70 con 0x7f4e84148d20 2020-01-16T05:44:08.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e8a7b2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e841497b0 con 0x7f4e84134710 2020-01-16T05:44:08.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e8a7b2700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e84149a50 con 0x7f4e8407f170 2020-01-16T05:44:08.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e88d4f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4e84148d20 0x7f4e84123370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51340/0 (socket says 172.21.15.84:51340) 2020-01-16T05:44:08.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e88d4f700 1 -- 172.21.15.84:0/3575106434 learned_addr learned my addr 172.21.15.84:0/3575106434 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:08.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e89550700 1 --2- 172.21.15.84:0/3575106434 >> v2:172.21.15.84:3300/0 conn(0x7f4e84134710 0x7f4e84134b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e83fff700 1 --2- 172.21.15.84:0/3575106434 >> v2:172.21.15.142:3300/0 conn(0x7f4e8407f170 0x7f4e841341c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e89550700 1 -- 172.21.15.84:0/3575106434 >> v2:172.21.15.142:3300/0 conn(0x7f4e8407f170 msgr2=0x7f4e841341c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e89550700 1 --2- 172.21.15.84:0/3575106434 >> v2:172.21.15.142:3300/0 conn(0x7f4e8407f170 0x7f4e841341c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e89550700 1 -- 172.21.15.84:0/3575106434 >> v1:172.21.15.84:6789/0 conn(0x7f4e84148d20 legacy=0x7f4e84123370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e89550700 1 -- 172.21.15.84:0/3575106434 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e84124180 con 0x7f4e84134710 2020-01-16T05:44:08.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e817fa700 1 -- 172.21.15.84:0/3575106434 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436046653 0 0) 0x7f4e84123b70 con 0x7f4e84148d20 2020-01-16T05:44:08.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e89550700 1 --2- 172.21.15.84:0/3575106434 >> v2:172.21.15.84:3300/0 conn(0x7f4e84134710 0x7f4e84134b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4e84149970 tx=0x7f4e7c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e89550700 1 --2- 172.21.15.84:0/3575106434 >> v2:172.21.15.84:3300/0 conn(0x7f4e84134710 0x7f4e84134b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4e84149970 tx=0x7f4e7c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e89550700 1 --2- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e84134710 0x7f4e84134b40 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f4e84149970 tx=0x7f4e7c0117a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e89550700 1 --2- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e84134710 0x7f4e84134b40 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f4e84149970 tx=0x7f4e7c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e817fa700 1 -- 172.21.15.84:0/3575106434 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7c00f700 con 0x7f4e84134710 2020-01-16T05:44:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e89550700 1 --2- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e84134710 0x7f4e84134b40 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f4e84149970 tx=0x7f4e7c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e89550700 1 --2- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e84134710 0x7f4e84134b40 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f4e84149970 tx=0x7f4e7c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e817fa700 1 -- 172.21.15.84:0/3575106434 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c0118e0 con 0x7f4e84134710 2020-01-16T05:44:08.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e8a7b2700 1 -- 172.21.15.84:0/3575106434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e84149cf0 con 0x7f4e84134710 2020-01-16T05:44:08.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e817fa700 1 -- 172.21.15.84:0/3575106434 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7c0056c0 con 0x7f4e84134710 2020-01-16T05:44:08.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e8a7b2700 1 -- 172.21.15.84:0/3575106434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e84149150 con 0x7f4e84134710 2020-01-16T05:44:08.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.423+0000 7f4e89550700 1 --2- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e84134710 0x7f4e84134b40 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f4e84149970 tx=0x7f4e7c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.427+0000 7f4e817fa700 1 -- 172.21.15.84:0/3575106434 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f4e7c0059d0 con 0x7f4e84134710 2020-01-16T05:44:08.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.427+0000 7f4e8a7b2700 1 -- 172.21.15.84:0/3575106434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4e8405e1c0 con 0x7f4e84134710 2020-01-16T05:44:08.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.427+0000 7f4e89550700 1 --2- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e84134710 0x7f4e84134b40 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f4e84149970 tx=0x7f4e7c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.427+0000 7f4e89550700 1 --2- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e84134710 0x7f4e84134b40 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f4e84149970 tx=0x7f4e7c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.427+0000 7f4e817fa700 1 --2- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4e6803c240 0x7f4e6803e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.427+0000 7f4e817fa700 1 -- 172.21.15.84:0/3575106434 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f4e7c04ccf0 con 0x7f4e84134710 2020-01-16T05:44:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.427+0000 7f4e817fa700 1 --2- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:6802/12645,v1:172.21.15.84:6803/12645] conn(0x7f4e68042a60 0x7f4e68044ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.427+0000 7f4e88d4f700 1 --2- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4e6803c240 0x7f4e6803e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.427+0000 7f4e817fa700 1 -- 172.21.15.84:0/3575106434 --> [v2:172.21.15.84:6802/12645,v1:172.21.15.84:6803/12645] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e68045580 con 0x7f4e68042a60 2020-01-16T05:44:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.427+0000 7f4e817fa700 1 -- 172.21.15.84:0/3575106434 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e7c04d110 con 0x7f4e84134710 2020-01-16T05:44:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.427+0000 7f4e83fff700 1 --2- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:6802/12645,v1:172.21.15.84:6803/12645] conn(0x7f4e68042a60 0x7f4e68044ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.427+0000 7f4e88d4f700 1 --2- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4e6803c240 0x7f4e6803e750 crc :-1 s=READY pgs=55 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.427+0000 7f4e83fff700 1 -- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:6802/12645,v1:172.21.15.84:6803/12645] conn(0x7f4e68042a60 msgr2=0x7f4e68044ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2020-01-16T05:44:08.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.427+0000 7f4e83fff700 1 --2- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:6802/12645,v1:172.21.15.84:6803/12645] conn(0x7f4e68042a60 0x7f4e68044ed0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.427+0000 7f4e817fa700 1 -- 172.21.15.84:0/3575106434 <== osd.1 v2:172.21.15.84:6802/12645 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (crc 0 0 0) 0x7f4e68045580 con 0x7f4e68042a60 2020-01-16T05:44:08.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.447+0000 7f4e8a7b2700 1 -- 172.21.15.84:0/3575106434 --> [v2:172.21.15.84:6802/12645,v1:172.21.15.84:6803/12645] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4e84127600 con 0x7f4e68042a60 2020-01-16T05:44:08.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.447+0000 7f4e817fa700 1 -- 172.21.15.84:0/3575106434 <== osd.1 v2:172.21.15.84:6802/12645 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4e84127600 con 0x7f4e68042a60 2020-01-16T05:44:08.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.451+0000 7f4e8a7b2700 1 -- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:6802/12645,v1:172.21.15.84:6803/12645] conn(0x7f4e68042a60 msgr2=0x7f4e68044ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.451+0000 7f4e8a7b2700 1 --2- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:6802/12645,v1:172.21.15.84:6803/12645] conn(0x7f4e68042a60 0x7f4e68044ed0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.451+0000 7f4e8a7b2700 1 -- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4e6803c240 msgr2=0x7f4e6803e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.451+0000 7f4e8a7b2700 1 --2- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4e6803c240 0x7f4e6803e750 crc :-1 s=READY pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.451+0000 7f4e8a7b2700 1 -- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e84134710 msgr2=0x7f4e84134b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.451+0000 7f4e8a7b2700 1 --2- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e84134710 0x7f4e84134b40 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f4e84149970 tx=0x7f4e7c0117a0).stop 2020-01-16T05:44:08.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.451+0000 7f4e89550700 1 -- 172.21.15.84:0/3575106434 reap_dead start 2020-01-16T05:44:08.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.451+0000 7f4e8a7b2700 1 -- 172.21.15.84:0/3575106434 shutdown_connections 2020-01-16T05:44:08.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.451+0000 7f4e8a7b2700 1 --2- 172.21.15.84:0/3575106434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e84134710 0x7f4e84134b40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.451+0000 7f4e8a7b2700 1 -- 172.21.15.84:0/3575106434 shutdown_connections 2020-01-16T05:44:08.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.451+0000 7f4e8a7b2700 1 -- 172.21.15.84:0/3575106434 wait complete. 2020-01-16T05:44:08.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.451+0000 7f4e8a7b2700 1 -- 172.21.15.84:0/3575106434 >> 172.21.15.84:0/3575106434 conn(0x7f4e84090880 msgr2=0x7f4e84126b90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:08.464 INFO:teuthology.orchestra.run.smithi084.stdout:60129542148 2020-01-16T05:44:08.464 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2020-01-16T05:44:08.579 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.571+0000 7feddb59e700 1 Processor -- start 2020-01-16T05:44:08.580 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.571+0000 7feddb59e700 1 -- start start 2020-01-16T05:44:08.580 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7feddb59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feddc0a9b30 0x7feddc0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:08.580 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7feddb59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feddc07ff10 0x7feddc066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:08.580 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7feddb59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feddc0a4250 0x7feddc0a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:08.580 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7feddb59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feddc0a4830 con 0x7feddc0a4250 2020-01-16T05:44:08.580 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7feddb59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feddc07f9d0 con 0x7feddc07ff10 2020-01-16T05:44:08.580 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7feddb59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc07fc70 con 0x7feddc0a9b30 2020-01-16T05:44:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fede096b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feddc0a4250 0x7feddc0a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fede096b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feddc0a4250 0x7feddc0a4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34150/0 (socket says 172.21.15.84:34150) 2020-01-16T05:44:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fede096b700 1 -- 172.21.15.84:0/3199857672 learned_addr learned my addr 172.21.15.84:0/3199857672 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7feddad9d700 1 --2- 172.21.15.84:0/3199857672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feddc0a9b30 0x7feddc0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fedda59c700 1 --2- 172.21.15.84:0/3199857672 >> v2:172.21.15.142:3300/0 conn(0x7feddc07ff10 0x7feddc066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fede096b700 1 -- 172.21.15.84:0/3199857672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feddc0a9b30 msgr2=0x7feddc0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fede096b700 1 --2- 172.21.15.84:0/3199857672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feddc0a9b30 0x7feddc0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fede096b700 1 -- 172.21.15.84:0/3199857672 >> v2:172.21.15.142:3300/0 conn(0x7feddc07ff10 msgr2=0x7feddc066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fede096b700 1 --2- 172.21.15.84:0/3199857672 >> v2:172.21.15.142:3300/0 conn(0x7feddc07ff10 0x7feddc066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fede096b700 1 -- 172.21.15.84:0/3199857672 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc066dd0 con 0x7feddc0a4250 2020-01-16T05:44:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fedda59c700 1 --2- 172.21.15.84:0/3199857672 >> v2:172.21.15.142:3300/0 conn(0x7feddc07ff10 0x7feddc066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:44:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fede096b700 1 --2- 172.21.15.84:0/3199857672 >> v2:172.21.15.84:3300/0 conn(0x7feddc0a4250 0x7feddc0a4ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feddc0a49f0 tx=0x7fedd400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fede096b700 1 --2- 172.21.15.84:0/3199857672 >> v2:172.21.15.84:3300/0 conn(0x7feddc0a4250 0x7feddc0a4ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feddc0a49f0 tx=0x7fedd400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fede096b700 1 --2- 172.21.15.84:0/3199857672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feddc0a4250 0x7feddc0a4ad0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7feddc0a49f0 tx=0x7fedd400ff30).ready entity=mon.0 client_cookie=8903a62d7919a9bd server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fede096b700 1 --2- 172.21.15.84:0/3199857672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feddc0a4250 0x7feddc0a4ad0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7feddc0a49f0 tx=0x7fedd400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fedd9d9b700 1 -- 172.21.15.84:0/3199857672 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedd4011760 con 0x7feddc0a4250 2020-01-16T05:44:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fede096b700 1 --2- 172.21.15.84:0/3199857672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feddc0a4250 0x7feddc0a4ad0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7feddc0a49f0 tx=0x7fedd400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fedd9d9b700 1 -- 172.21.15.84:0/3199857672 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd4008d30 con 0x7feddc0a4250 2020-01-16T05:44:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fede096b700 1 --2- 172.21.15.84:0/3199857672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feddc0a4250 0x7feddc0a4ad0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7feddc0a49f0 tx=0x7fedd400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7fedd9d9b700 1 -- 172.21.15.84:0/3199857672 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedd4011d40 con 0x7feddc0a4250 2020-01-16T05:44:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7feddb59e700 1 -- 172.21.15.84:0/3199857672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feddc0a4250 msgr2=0x7feddc0a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7feddb59e700 1 --2- 172.21.15.84:0/3199857672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feddc0a4250 0x7feddc0a4ad0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7feddc0a49f0 tx=0x7fedd400ff30).stop 2020-01-16T05:44:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7feddb59e700 1 -- 172.21.15.84:0/3199857672 shutdown_connections 2020-01-16T05:44:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7feddb59e700 1 --2- 172.21.15.84:0/3199857672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feddc0a4250 0x7feddc0a4ad0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7feddb59e700 1 --2- 172.21.15.84:0/3199857672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feddc0a9b30 0x7feddc0abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7feddb59e700 1 --2- 172.21.15.84:0/3199857672 >> v2:172.21.15.142:3300/0 conn(0x7feddc07ff10 0x7feddc066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7feddb59e700 1 -- 172.21.15.84:0/3199857672 shutdown_connections 2020-01-16T05:44:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7feddb59e700 1 -- 172.21.15.84:0/3199857672 wait complete. 2020-01-16T05:44:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.575+0000 7feddb59e700 1 -- 172.21.15.84:0/3199857672 >> 172.21.15.84:0/3199857672 conn(0x7feddc0acfc0 msgr2=0x7feddc0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:08.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7feddb59e700 1 Processor -- start 2020-01-16T05:44:08.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7feddb59e700 1 -- start start 2020-01-16T05:44:08.589 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7feddb59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feddc13e340 0x7feddc140780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.589 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7feddb59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feddc1259d0 con 0x7feddc0a5320 2020-01-16T05:44:08.589 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7feddb59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feddc0a7090 con 0x7feddc0a6c60 2020-01-16T05:44:08.589 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7feddb59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc125cb0 con 0x7feddc13e340 2020-01-16T05:44:08.592 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7feddad9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7feddc0a5320 0x7feddc123f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51354/0 (socket says 172.21.15.84:51354) 2020-01-16T05:44:08.592 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7feddad9d700 1 -- 172.21.15.84:0/397212275 learned_addr learned my addr 172.21.15.84:0/397212275 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:08.592 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7fede096b700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feddc13e340 0x7feddc140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.592 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7fedd37fe700 1 -- 172.21.15.84:0/397212275 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541498873 0 0) 0x7feddc1259d0 con 0x7feddc0a5320 2020-01-16T05:44:08.592 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7fedd37fe700 1 -- 172.21.15.84:0/397212275 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedb4003230 con 0x7feddc0a5320 2020-01-16T05:44:08.592 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7fedd37fe700 1 -- 172.21.15.84:0/397212275 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1093592623 0 0) 0x7fedb4003230 con 0x7feddc0a5320 2020-01-16T05:44:08.592 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7fedd37fe700 1 -- 172.21.15.84:0/397212275 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7feddc1259d0 con 0x7feddc0a5320 2020-01-16T05:44:08.593 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7fedd37fe700 1 -- 172.21.15.84:0/397212275 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7fedcc001810 con 0x7feddc0a5320 2020-01-16T05:44:08.593 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7fede096b700 1 -- 172.21.15.84:0/397212275 >> v1:172.21.15.142:6789/0 conn(0x7feddc0a6c60 legacy=0x7feddc134a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.593 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7fede096b700 1 -- 172.21.15.84:0/397212275 >> v1:172.21.15.84:6789/0 conn(0x7feddc0a5320 legacy=0x7feddc123f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.593 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7fede096b700 1 -- 172.21.15.84:0/397212275 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc0ab090 con 0x7feddc13e340 2020-01-16T05:44:08.593 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7fede096b700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feddc13e340 0x7feddc140780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fedc4007920 tx=0x7fedd400fb20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.593 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7fede096b700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feddc13e340 0x7feddc140780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fedc4007920 tx=0x7fedd400fb20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.593 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7fede096b700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feddc13e340 0x7feddc140780 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fedc4007920 tx=0x7fedd400fb20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.594 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7fede096b700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feddc13e340 0x7feddc140780 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fedc4007920 tx=0x7fedd400fb20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.594 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7fedd37fe700 1 -- 172.21.15.84:0/397212275 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedd4007340 con 0x7feddc13e340 2020-01-16T05:44:08.594 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7fede096b700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feddc13e340 0x7feddc140780 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fedc4007920 tx=0x7fedd400fb20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.594 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7fede096b700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feddc13e340 0x7feddc140780 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fedc4007920 tx=0x7fedd400fb20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.594 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7fedd37fe700 1 -- 172.21.15.84:0/397212275 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd4011960 con 0x7feddc13e340 2020-01-16T05:44:08.594 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7feddb59e700 1 -- 172.21.15.84:0/397212275 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feddc124e70 con 0x7feddc13e340 2020-01-16T05:44:08.594 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7fedd37fe700 1 -- 172.21.15.84:0/397212275 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedd400f550 con 0x7feddc13e340 2020-01-16T05:44:08.595 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.579+0000 7feddb59e700 1 -- 172.21.15.84:0/397212275 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feddc135210 con 0x7feddc13e340 2020-01-16T05:44:08.595 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.583+0000 7fede096b700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feddc13e340 0x7feddc140780 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fedc4007920 tx=0x7fedd400fb20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.595 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.583+0000 7fedd37fe700 1 -- 172.21.15.84:0/397212275 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fedd40056c0 con 0x7feddc13e340 2020-01-16T05:44:08.595 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.583+0000 7fede096b700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feddc13e340 0x7feddc140780 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fedc4007920 tx=0x7fedd400fb20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.595 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.583+0000 7feddb59e700 1 -- 172.21.15.84:0/397212275 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feddc05e1c0 con 0x7feddc13e340 2020-01-16T05:44:08.595 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.583+0000 7fede096b700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feddc13e340 0x7feddc140780 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fedc4007920 tx=0x7fedd400fb20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.595 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.583+0000 7fedd37fe700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fedb403cc30 0x7fedb403f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.595 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.583+0000 7fedd37fe700 1 -- 172.21.15.84:0/397212275 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7fedd404ca50 con 0x7feddc13e340 2020-01-16T05:44:08.596 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.583+0000 7feddad9d700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fedb403cc30 0x7fedb403f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.596 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.583+0000 7fedd37fe700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.84:6811/12646,v1:172.21.15.84:6813/12646] conn(0x7fedb40433c0 0x7fedb4045830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.596 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.583+0000 7fedd37fe700 1 -- 172.21.15.84:0/397212275 --> [v2:172.21.15.84:6811/12646,v1:172.21.15.84:6813/12646] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fedb4045ee0 con 0x7fedb40433c0 2020-01-16T05:44:08.596 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.583+0000 7fedd37fe700 1 -- 172.21.15.84:0/397212275 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedd404ce70 con 0x7feddc13e340 2020-01-16T05:44:08.596 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.583+0000 7feddad9d700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fedb403cc30 0x7fedb403f140 crc :-1 s=READY pgs=56 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.596 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.583+0000 7fedda59c700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.84:6811/12646,v1:172.21.15.84:6813/12646] conn(0x7fedb40433c0 0x7fedb4045830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.596 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.583+0000 7fedda59c700 1 -- 172.21.15.84:0/397212275 >> [v2:172.21.15.84:6811/12646,v1:172.21.15.84:6813/12646] conn(0x7fedb40433c0 msgr2=0x7fedb4045830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2020-01-16T05:44:08.597 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.583+0000 7fedda59c700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.84:6811/12646,v1:172.21.15.84:6813/12646] conn(0x7fedb40433c0 0x7fedb4045830 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.597 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.587+0000 7fedd37fe700 1 -- 172.21.15.84:0/397212275 <== osd.2 v2:172.21.15.84:6811/12646 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (crc 0 0 0) 0x7fedb4045ee0 con 0x7fedb40433c0 2020-01-16T05:44:08.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.607+0000 7feddb59e700 1 -- 172.21.15.84:0/397212275 --> [v2:172.21.15.84:6811/12646,v1:172.21.15.84:6813/12646] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feddc024950 con 0x7fedb40433c0 2020-01-16T05:44:08.610 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.607+0000 7fedd37fe700 1 -- 172.21.15.84:0/397212275 <== osd.2 v2:172.21.15.84:6811/12646 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feddc024950 con 0x7fedb40433c0 2020-01-16T05:44:08.610 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.607+0000 7feddb59e700 1 -- 172.21.15.84:0/397212275 >> [v2:172.21.15.84:6811/12646,v1:172.21.15.84:6813/12646] conn(0x7fedb40433c0 msgr2=0x7fedb4045830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.610 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.607+0000 7feddb59e700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.84:6811/12646,v1:172.21.15.84:6813/12646] conn(0x7fedb40433c0 0x7fedb4045830 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.610 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.607+0000 7feddb59e700 1 -- 172.21.15.84:0/397212275 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fedb403cc30 msgr2=0x7fedb403f140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.610 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.607+0000 7feddb59e700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fedb403cc30 0x7fedb403f140 crc :-1 s=READY pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.610 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.607+0000 7feddb59e700 1 -- 172.21.15.84:0/397212275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feddc13e340 msgr2=0x7feddc140780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.607+0000 7feddb59e700 1 --2- 172.21.15.84:0/397212275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feddc13e340 0x7feddc140780 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fedc4007920 tx=0x7fedd400fb20).stop 2020-01-16T05:44:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.607+0000 7fede096b700 1 -- 172.21.15.84:0/397212275 reap_dead start 2020-01-16T05:44:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.607+0000 7feddb59e700 1 -- 172.21.15.84:0/397212275 shutdown_connections 2020-01-16T05:44:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.607+0000 7feddb59e700 1 -- 172.21.15.84:0/397212275 shutdown_connections 2020-01-16T05:44:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.607+0000 7feddb59e700 1 -- 172.21.15.84:0/397212275 wait complete. 2020-01-16T05:44:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.607+0000 7feddb59e700 1 -- 172.21.15.84:0/397212275 >> 172.21.15.84:0/397212275 conn(0x7feddc0a5e80 msgr2=0x7feddc0a8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:08.621 INFO:teuthology.orchestra.run.smithi084.stdout:60129542148 2020-01-16T05:44:08.622 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2020-01-16T05:44:08.740 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0efa353700 1 Processor -- start 2020-01-16T05:44:08.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0efa353700 1 -- start start 2020-01-16T05:44:08.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0efa353700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef40a9b30 0x7f0ef40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:08.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0efa353700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0ef40a4250 0x7f0ef4066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:08.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0efa353700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef4066dd0 con 0x7f0ef407ff10 2020-01-16T05:44:08.742 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0efa353700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef40a4830 con 0x7f0ef40a4250 2020-01-16T05:44:08.742 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0efa353700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef407f9d0 con 0x7f0ef40a9b30 2020-01-16T05:44:08.742 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0efb5b5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0ef40a4250 0x7f0ef4066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.743 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0ef9351700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0ef407ff10 0x7f0ef40a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51366/0 (socket says 172.21.15.84:51366) 2020-01-16T05:44:08.743 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0ef9351700 1 -- 172.21.15.84:0/105064885 learned_addr learned my addr 172.21.15.84:0/105064885 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:08.743 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0ef9b52700 1 --2- 172.21.15.84:0/105064885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef40a9b30 0x7f0ef40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.743 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0efb5b5700 1 -- 172.21.15.84:0/105064885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef40a9b30 msgr2=0x7f0ef40abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0efb5b5700 1 --2- 172.21.15.84:0/105064885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef40a9b30 0x7f0ef40abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0efb5b5700 1 -- 172.21.15.84:0/105064885 >> v1:172.21.15.84:6789/0 conn(0x7f0ef407ff10 legacy=0x7f0ef40a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0ef8b50700 1 -- 172.21.15.84:0/105064885 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334904776 0 0) 0x7f0ef4066dd0 con 0x7f0ef407ff10 2020-01-16T05:44:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0efb5b5700 1 -- 172.21.15.84:0/105064885 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef4150ce0 con 0x7f0ef40a4250 2020-01-16T05:44:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0efb5b5700 1 --2- 172.21.15.84:0/105064885 >> v2:172.21.15.84:3300/0 conn(0x7f0ef40a4250 0x7f0ef4066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0eec008c90 tx=0x7f0eec010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0efb5b5700 1 --2- 172.21.15.84:0/105064885 >> v2:172.21.15.84:3300/0 conn(0x7f0ef40a4250 0x7f0ef4066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0eec008c90 tx=0x7f0eec010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0efb5b5700 1 --2- 172.21.15.84:0/105064885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ef40a4250 0x7f0ef4066880 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f0eec008c90 tx=0x7f0eec010170).ready entity=mon.0 client_cookie=ca592c291f631ee6 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0efb5b5700 1 --2- 172.21.15.84:0/105064885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ef40a4250 0x7f0ef4066880 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f0eec008c90 tx=0x7f0eec010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0ef8b50700 1 -- 172.21.15.84:0/105064885 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eec00a160 con 0x7f0ef40a4250 2020-01-16T05:44:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.735+0000 7f0efb5b5700 1 --2- 172.21.15.84:0/105064885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ef40a4250 0x7f0ef4066880 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f0eec008c90 tx=0x7f0eec010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.739+0000 7f0ef8b50700 1 -- 172.21.15.84:0/105064885 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eec011af0 con 0x7f0ef40a4250 2020-01-16T05:44:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.739+0000 7f0efb5b5700 1 --2- 172.21.15.84:0/105064885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ef40a4250 0x7f0ef4066880 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f0eec008c90 tx=0x7f0eec010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.739+0000 7f0ef8b50700 1 -- 172.21.15.84:0/105064885 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eec00a740 con 0x7f0ef40a4250 2020-01-16T05:44:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.739+0000 7f0efa353700 1 -- 172.21.15.84:0/105064885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ef40a4250 msgr2=0x7f0ef4066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.739+0000 7f0efa353700 1 --2- 172.21.15.84:0/105064885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ef40a4250 0x7f0ef4066880 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f0eec008c90 tx=0x7f0eec010170).stop 2020-01-16T05:44:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.739+0000 7f0efa353700 1 -- 172.21.15.84:0/105064885 shutdown_connections 2020-01-16T05:44:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.739+0000 7f0efa353700 1 --2- 172.21.15.84:0/105064885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ef40a4250 0x7f0ef4066880 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.739+0000 7f0efa353700 1 --2- 172.21.15.84:0/105064885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef40a9b30 0x7f0ef40abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:08.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.739+0000 7f0efa353700 1 -- 172.21.15.84:0/105064885 shutdown_connections 2020-01-16T05:44:08.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.739+0000 7f0efa353700 1 -- 172.21.15.84:0/105064885 wait complete. 2020-01-16T05:44:08.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.739+0000 7f0efa353700 1 -- 172.21.15.84:0/105064885 >> 172.21.15.84:0/105064885 conn(0x7f0ef40acfc0 msgr2=0x7f0ef40a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.739+0000 7f0efa353700 1 Processor -- start 2020-01-16T05:44:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.739+0000 7f0efa353700 1 -- start start 2020-01-16T05:44:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efa353700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0ef4126860 0x7f0ef408f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efa353700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef408fa70 0x7f0ef413d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efa353700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef4091b30 con 0x7f0ef407d410 2020-01-16T05:44:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efa353700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef4091350 con 0x7f0ef4126860 2020-01-16T05:44:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efa353700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef40915f0 con 0x7f0ef408fa70 2020-01-16T05:44:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0ef9b52700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0ef407d410 0x7f0ef407ba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51370/0 (socket says 172.21.15.84:51370) 2020-01-16T05:44:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0ef9b52700 1 -- 172.21.15.84:0/1081864692 learned_addr learned my addr 172.21.15.84:0/1081864692 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efb5b5700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef408fa70 0x7f0ef413d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0ef9351700 1 --2- 172.21.15.84:0/1081864692 >> v2:172.21.15.142:3300/0 conn(0x7f0ef4126860 0x7f0ef408f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0eea7fc700 1 -- 172.21.15.84:0/1081864692 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796391594 0 0) 0x7f0ef4091b30 con 0x7f0ef407d410 2020-01-16T05:44:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0eea7fc700 1 -- 172.21.15.84:0/1081864692 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0edc003230 con 0x7f0ef407d410 2020-01-16T05:44:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0eea7fc700 1 -- 172.21.15.84:0/1081864692 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3261105052 0 0) 0x7f0edc003230 con 0x7f0ef407d410 2020-01-16T05:44:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0eea7fc700 1 -- 172.21.15.84:0/1081864692 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0ef4091b30 con 0x7f0ef407d410 2020-01-16T05:44:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0eea7fc700 1 -- 172.21.15.84:0/1081864692 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f0ef0001490 con 0x7f0ef407d410 2020-01-16T05:44:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efb5b5700 1 -- 172.21.15.84:0/1081864692 >> v2:172.21.15.142:3300/0 conn(0x7f0ef4126860 msgr2=0x7f0ef408f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efb5b5700 1 --2- 172.21.15.84:0/1081864692 >> v2:172.21.15.142:3300/0 conn(0x7f0ef4126860 0x7f0ef408f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efb5b5700 1 -- 172.21.15.84:0/1081864692 >> v1:172.21.15.84:6789/0 conn(0x7f0ef407d410 legacy=0x7f0ef407ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efb5b5700 1 -- 172.21.15.84:0/1081864692 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef4091090 con 0x7f0ef408fa70 2020-01-16T05:44:08.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0ef9351700 1 --2- 172.21.15.84:0/1081864692 >> v2:172.21.15.142:3300/0 conn(0x7f0ef4126860 0x7f0ef408f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:08.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efb5b5700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef408fa70 0x7f0ef413d040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0eec008c90 tx=0x7f0ef0002ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efb5b5700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef408fa70 0x7f0ef413d040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0eec008c90 tx=0x7f0ef0002ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efb5b5700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef408fa70 0x7f0ef413d040 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f0eec008c90 tx=0x7f0ef0002ff0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efb5b5700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef408fa70 0x7f0ef413d040 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f0eec008c90 tx=0x7f0ef0002ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0eea7fc700 1 -- 172.21.15.84:0/1081864692 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eec005c30 con 0x7f0ef408fa70 2020-01-16T05:44:08.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efb5b5700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef408fa70 0x7f0ef413d040 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f0eec008c90 tx=0x7f0ef0002ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0eea7fc700 1 -- 172.21.15.84:0/1081864692 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eec00a360 con 0x7f0ef408fa70 2020-01-16T05:44:08.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efb5b5700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef408fa70 0x7f0ef413d040 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f0eec008c90 tx=0x7f0ef0002ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efa353700 1 -- 172.21.15.84:0/1081864692 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef407c210 con 0x7f0ef408fa70 2020-01-16T05:44:08.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0eea7fc700 1 -- 172.21.15.84:0/1081864692 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0eec00ae00 con 0x7f0ef408fa70 2020-01-16T05:44:08.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efa353700 1 -- 172.21.15.84:0/1081864692 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef408fea0 con 0x7f0ef408fa70 2020-01-16T05:44:08.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efb5b5700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef408fa70 0x7f0ef413d040 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f0eec008c90 tx=0x7f0ef0002ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.743+0000 7f0efa353700 1 -- 172.21.15.84:0/1081864692 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ef405e1c0 con 0x7f0ef408fa70 2020-01-16T05:44:08.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.747+0000 7f0eea7fc700 1 -- 172.21.15.84:0/1081864692 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f0eec007150 con 0x7f0ef408fa70 2020-01-16T05:44:08.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.747+0000 7f0efb5b5700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef408fa70 0x7f0ef413d040 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f0eec008c90 tx=0x7f0ef0002ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.747+0000 7f0eea7fc700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0edc03cba0 0x7f0edc03f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.747+0000 7f0efb5b5700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef408fa70 0x7f0ef413d040 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f0eec008c90 tx=0x7f0ef0002ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.747+0000 7f0eea7fc700 1 -- 172.21.15.84:0/1081864692 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f0eec0911b0 con 0x7f0ef408fa70 2020-01-16T05:44:08.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.747+0000 7f0eea7fc700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.84:6826/12647,v1:172.21.15.84:6827/12647] conn(0x7f0edc043330 0x7f0edc0457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.747+0000 7f0ef9b52700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0edc03cba0 0x7f0edc03f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.747+0000 7f0eea7fc700 1 -- 172.21.15.84:0/1081864692 --> [v2:172.21.15.84:6826/12647,v1:172.21.15.84:6827/12647] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0edc045e50 con 0x7f0edc043330 2020-01-16T05:44:08.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.747+0000 7f0eea7fc700 1 -- 172.21.15.84:0/1081864692 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0eec078c10 con 0x7f0ef408fa70 2020-01-16T05:44:08.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.747+0000 7f0ef9351700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.84:6826/12647,v1:172.21.15.84:6827/12647] conn(0x7f0edc043330 0x7f0edc0457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.747+0000 7f0ef9b52700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0edc03cba0 0x7f0edc03f0b0 crc :-1 s=READY pgs=57 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.747+0000 7f0ef9351700 1 -- 172.21.15.84:0/1081864692 >> [v2:172.21.15.84:6826/12647,v1:172.21.15.84:6827/12647] conn(0x7f0edc043330 msgr2=0x7f0edc0457a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2020-01-16T05:44:08.760 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.747+0000 7f0ef9351700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.84:6826/12647,v1:172.21.15.84:6827/12647] conn(0x7f0edc043330 0x7f0edc0457a0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.760 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.747+0000 7f0eea7fc700 1 -- 172.21.15.84:0/1081864692 <== osd.3 v2:172.21.15.84:6826/12647 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (crc 0 0 0) 0x7f0edc045e50 con 0x7f0edc043330 2020-01-16T05:44:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.767+0000 7f0efa353700 1 -- 172.21.15.84:0/1081864692 --> [v2:172.21.15.84:6826/12647,v1:172.21.15.84:6827/12647] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0ef407cb70 con 0x7f0edc043330 2020-01-16T05:44:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.767+0000 7f0eea7fc700 1 -- 172.21.15.84:0/1081864692 <== osd.3 v2:172.21.15.84:6826/12647 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ef407cb70 con 0x7f0edc043330 2020-01-16T05:44:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.767+0000 7f0efa353700 1 -- 172.21.15.84:0/1081864692 >> [v2:172.21.15.84:6826/12647,v1:172.21.15.84:6827/12647] conn(0x7f0edc043330 msgr2=0x7f0edc0457a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.767+0000 7f0efa353700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.84:6826/12647,v1:172.21.15.84:6827/12647] conn(0x7f0edc043330 0x7f0edc0457a0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.767+0000 7f0efa353700 1 -- 172.21.15.84:0/1081864692 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0edc03cba0 msgr2=0x7f0edc03f0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.767+0000 7f0efa353700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0edc03cba0 0x7f0edc03f0b0 crc :-1 s=READY pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.767+0000 7f0efa353700 1 -- 172.21.15.84:0/1081864692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef408fa70 msgr2=0x7f0ef413d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.767+0000 7f0efa353700 1 --2- 172.21.15.84:0/1081864692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef408fa70 0x7f0ef413d040 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f0eec008c90 tx=0x7f0ef0002ff0).stop 2020-01-16T05:44:08.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.767+0000 7f0efb5b5700 1 -- 172.21.15.84:0/1081864692 reap_dead start 2020-01-16T05:44:08.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.767+0000 7f0efa353700 1 -- 172.21.15.84:0/1081864692 shutdown_connections 2020-01-16T05:44:08.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.767+0000 7f0efa353700 1 -- 172.21.15.84:0/1081864692 shutdown_connections 2020-01-16T05:44:08.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.771+0000 7f0efa353700 1 -- 172.21.15.84:0/1081864692 wait complete. 2020-01-16T05:44:08.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.771+0000 7f0efa353700 1 -- 172.21.15.84:0/1081864692 >> 172.21.15.84:0/1081864692 conn(0x7f0ef40a9b30 msgr2=0x7f0ef40a3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:08.782 INFO:teuthology.orchestra.run.smithi084.stdout:55834574853 2020-01-16T05:44:08.782 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2020-01-16T05:44:08.911 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.899+0000 7f0003d73700 1 Processor -- start 2020-01-16T05:44:08.911 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.899+0000 7f0003d73700 1 -- start start 2020-01-16T05:44:08.911 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.899+0000 7f0003d73700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efffc0a2f60 0x7efffc05b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:08.911 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.899+0000 7f0003d73700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc07cd60 con 0x7efffc0a8ff0 2020-01-16T05:44:08.911 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.899+0000 7f0003d73700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc0a9420 con 0x7efffc08fd80 2020-01-16T05:44:08.911 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.899+0000 7f0003d73700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efffc0a3390 con 0x7efffc0a2f60 2020-01-16T05:44:08.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.899+0000 7f0001b0f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7efffc0a8ff0 0x7efffc07c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51384/0 (socket says 172.21.15.84:51384) 2020-01-16T05:44:08.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.899+0000 7f0001b0f700 1 -- 172.21.15.84:0/3098448890 learned_addr learned my addr 172.21.15.84:0/3098448890 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:08.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.899+0000 7f0002310700 1 --2- 172.21.15.84:0/3098448890 >> v2:172.21.15.142:3300/0 conn(0x7efffc0a2f60 0x7efffc05b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.899+0000 7f000130e700 1 -- 172.21.15.84:0/3098448890 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577913649 0 0) 0x7efffc07cd60 con 0x7efffc0a8ff0 2020-01-16T05:44:08.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.899+0000 7f000130e700 1 -- 172.21.15.84:0/3098448890 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effe8003230 con 0x7efffc0a8ff0 2020-01-16T05:44:08.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f0002310700 1 -- 172.21.15.84:0/3098448890 >> v1:172.21.15.142:6789/0 conn(0x7efffc08fd80 legacy=0x7efffc1503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f0002310700 1 -- 172.21.15.84:0/3098448890 >> v1:172.21.15.84:6789/0 conn(0x7efffc0a8ff0 legacy=0x7efffc07c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.913 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f0002310700 1 -- 172.21.15.84:0/3098448890 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc08f570 con 0x7efffc0a2f60 2020-01-16T05:44:08.913 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f0002310700 1 --2- 172.21.15.84:0/3098448890 >> v2:172.21.15.142:3300/0 conn(0x7efffc0a2f60 0x7efffc05b0f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efff8002f30 tx=0x7efff800fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.913 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f0002310700 1 --2- 172.21.15.84:0/3098448890 >> v2:172.21.15.142:3300/0 conn(0x7efffc0a2f60 0x7efffc05b0f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efff8002f30 tx=0x7efff800fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.913 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f0002310700 1 --2- 172.21.15.84:0/3098448890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efffc0a2f60 0x7efffc05b0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7efff8002f30 tx=0x7efff800fd70).ready entity=mon.1 client_cookie=5d564d28246f6d8c server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.913 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f0002310700 1 --2- 172.21.15.84:0/3098448890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efffc0a2f60 0x7efffc05b0f0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7efff8002f30 tx=0x7efff800fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.913 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f000130e700 1 -- 172.21.15.84:0/3098448890 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efff80115a0 con 0x7efffc0a2f60 2020-01-16T05:44:08.913 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f0002310700 1 --2- 172.21.15.84:0/3098448890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efffc0a2f60 0x7efffc05b0f0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7efff8002f30 tx=0x7efff800fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f0002310700 1 --2- 172.21.15.84:0/3098448890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efffc0a2f60 0x7efffc05b0f0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7efff8002f30 tx=0x7efff800fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f000130e700 1 -- 172.21.15.84:0/3098448890 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff8008d40 con 0x7efffc0a2f60 2020-01-16T05:44:08.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f0003d73700 1 -- 172.21.15.84:0/3098448890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efffc0a2f60 msgr2=0x7efffc05b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f0003d73700 1 --2- 172.21.15.84:0/3098448890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efffc0a2f60 0x7efffc05b0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7efff8002f30 tx=0x7efff800fd70).stop 2020-01-16T05:44:08.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f000130e700 1 -- 172.21.15.84:0/3098448890 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efff8011b80 con 0x7efffc0a2f60 2020-01-16T05:44:08.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f0003d73700 1 -- 172.21.15.84:0/3098448890 shutdown_connections 2020-01-16T05:44:08.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f0003d73700 1 --2- 172.21.15.84:0/3098448890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efffc0a2f60 0x7efffc05b0f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f0003d73700 1 -- 172.21.15.84:0/3098448890 shutdown_connections 2020-01-16T05:44:08.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f0003d73700 1 -- 172.21.15.84:0/3098448890 wait complete. 2020-01-16T05:44:08.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f0003d73700 1 -- 172.21.15.84:0/3098448890 >> 172.21.15.84:0/3098448890 conn(0x7efffc0abc10 msgr2=0x7efffc05a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:08.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f0003d73700 1 Processor -- start 2020-01-16T05:44:08.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.903+0000 7f0003d73700 1 -- start start 2020-01-16T05:44:08.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0003d73700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efffc123990 0x7efffc0a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0003d73700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc123dc0 con 0x7efffc147e00 2020-01-16T05:44:08.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0003d73700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc0a1a90 con 0x7efffc148230 2020-01-16T05:44:08.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0003d73700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efffc132b90 con 0x7efffc123990 2020-01-16T05:44:08.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0001b0f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7efffc147e00 0x7efffc0a01d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51386/0 (socket says 172.21.15.84:51386) 2020-01-16T05:44:08.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0001b0f700 1 -- 172.21.15.84:0/643517397 learned_addr learned my addr 172.21.15.84:0/643517397 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:08.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0002310700 1 --2- 172.21.15.84:0/643517397 >> v2:172.21.15.142:3300/0 conn(0x7efffc123990 0x7efffc0a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494409403 0 0) 0x7efffc123dc0 con 0x7efffc147e00 2020-01-16T05:44:08.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effe4003230 con 0x7efffc147e00 2020-01-16T05:44:08.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2926966728 0 0) 0x7effe4003230 con 0x7efffc147e00 2020-01-16T05:44:08.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efffc123dc0 con 0x7efffc147e00 2020-01-16T05:44:08.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7effec001990 con 0x7efffc147e00 2020-01-16T05:44:08.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 >> v2:172.21.15.142:3300/0 conn(0x7efffc123990 msgr2=0x7efffc0a1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7efff2ffd700 1 --2- 172.21.15.84:0/643517397 >> v2:172.21.15.142:3300/0 conn(0x7efffc123990 0x7efffc0a1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 >> v1:172.21.15.142:6789/0 conn(0x7efffc148230 legacy=0x7efffc139fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 >> v1:172.21.15.84:6789/0 conn(0x7efffc147e00 legacy=0x7efffc0a01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7efff2ffd700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effe4003a20 0x7effe4003e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7efff2ffd700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effe40045a0 0x7effe40049f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7efff2ffd700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effe4005080 0x7effe400b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc132b90 con 0x7effe4005080 2020-01-16T05:44:08.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe400bed0 con 0x7effe4003a20 2020-01-16T05:44:08.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe400c110 con 0x7effe40045a0 2020-01-16T05:44:08.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0002b11700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effe4005080 0x7effe400b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0002310700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effe4003a20 0x7effe4003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0001b0f700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effe40045a0 0x7effe40049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0002310700 1 -- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effe40045a0 msgr2=0x7effe40049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0002310700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effe40045a0 0x7effe40049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0002310700 1 -- 172.21.15.84:0/643517397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effe4005080 msgr2=0x7effe400b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0002310700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effe4005080 0x7effe400b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0002310700 1 -- 172.21.15.84:0/643517397 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc0a09d0 con 0x7effe4003a20 2020-01-16T05:44:08.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0002b11700 1 -- 172.21.15.84:0/643517397 reap_dead start 2020-01-16T05:44:08.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0003d73700 1 -- 172.21.15.84:0/643517397 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efffc13b7f0 con 0x7effe4003a20 2020-01-16T05:44:08.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0002310700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effe4003a20 0x7effe4003e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efff8002f30 tx=0x7efff80116e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0003d73700 1 -- 172.21.15.84:0/643517397 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efffc123bb0 con 0x7effe4003a20 2020-01-16T05:44:08.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0002310700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effe4003a20 0x7effe4003e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efff8002f30 tx=0x7efff80116e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0002310700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effe4003a20 0x7effe4003e90 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7efff8002f30 tx=0x7efff80116e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0002310700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effe4003a20 0x7effe4003e90 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7efff8002f30 tx=0x7efff80116e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efff800f780 con 0x7effe4003a20 2020-01-16T05:44:08.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0002310700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effe4003a20 0x7effe4003e90 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7efff8002f30 tx=0x7efff80116e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0002310700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effe4003a20 0x7effe4003e90 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7efff8002f30 tx=0x7efff80116e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.922 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff80117a0 con 0x7effe4003a20 2020-01-16T05:44:08.922 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efff8007530 con 0x7effe4003a20 2020-01-16T05:44:08.922 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0003d73700 1 -- 172.21.15.84:0/643517397 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7effd80035b0 con 0x7effe4003a20 2020-01-16T05:44:08.922 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.907+0000 7f0002310700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effe4003a20 0x7effe4003e90 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7efff8002f30 tx=0x7efff80116e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.911+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7efff80056c0 con 0x7effe4003a20 2020-01-16T05:44:08.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.911+0000 7f0002310700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effe4003a20 0x7effe4003e90 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7efff8002f30 tx=0x7efff80116e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.911+0000 7f0002310700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effe4003a20 0x7effe4003e90 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7efff8002f30 tx=0x7efff80116e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:08.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.911+0000 7efff2ffd700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7effe4040060 0x7effe4042570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.911+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7efff804d120 con 0x7effe4003a20 2020-01-16T05:44:08.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.911+0000 7f0001b0f700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7effe4040060 0x7effe4042570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.911+0000 7efff2ffd700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:6800/12842,v1:172.21.15.142:6801/12842] conn(0x7effe4046840 0x7effe4048cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:08.925 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.911+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 --> [v2:172.21.15.142:6800/12842,v1:172.21.15.142:6801/12842] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7effe4049360 con 0x7effe4046840 2020-01-16T05:44:08.925 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.911+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7efff804d530 con 0x7effe4003a20 2020-01-16T05:44:08.925 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.911+0000 7f0001b0f700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7effe4040060 0x7effe4042570 crc :-1 s=READY pgs=58 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.925 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.911+0000 7f0002b11700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:6800/12842,v1:172.21.15.142:6801/12842] conn(0x7effe4046840 0x7effe4048cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:08.925 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.911+0000 7f0002b11700 1 -- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:6800/12842,v1:172.21.15.142:6801/12842] conn(0x7effe4046840 msgr2=0x7effe4048cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2020-01-16T05:44:08.925 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.911+0000 7f0002b11700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:6800/12842,v1:172.21.15.142:6801/12842] conn(0x7effe4046840 0x7effe4048cb0 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:08.926 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.911+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 <== osd.4 v2:172.21.15.142:6800/12842 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (crc 0 0 0) 0x7effe4049360 con 0x7effe4046840 2020-01-16T05:44:08.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.935+0000 7f0003d73700 1 -- 172.21.15.84:0/643517397 --> [v2:172.21.15.142:6800/12842,v1:172.21.15.142:6801/12842] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7effd80026e0 con 0x7effe4046840 2020-01-16T05:44:08.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.935+0000 7efff2ffd700 1 -- 172.21.15.84:0/643517397 <== osd.4 v2:172.21.15.142:6800/12842 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7effd80026e0 con 0x7effe4046840 2020-01-16T05:44:08.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.935+0000 7f0003d73700 1 -- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:6800/12842,v1:172.21.15.142:6801/12842] conn(0x7effe4046840 msgr2=0x7effe4048cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.935+0000 7f0003d73700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:6800/12842,v1:172.21.15.142:6801/12842] conn(0x7effe4046840 0x7effe4048cb0 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.935+0000 7f0003d73700 1 -- 172.21.15.84:0/643517397 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7effe4040060 msgr2=0x7effe4042570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.935+0000 7f0003d73700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7effe4040060 0x7effe4042570 crc :-1 s=READY pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.935+0000 7f0003d73700 1 -- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effe4003a20 msgr2=0x7effe4003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.935+0000 7f0003d73700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effe4003a20 0x7effe4003e90 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7efff8002f30 tx=0x7efff80116e0).stop 2020-01-16T05:44:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.935+0000 7f0003d73700 1 -- 172.21.15.84:0/643517397 shutdown_connections 2020-01-16T05:44:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.935+0000 7f0003d73700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7effe4040060 0x7effe4042570 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.935+0000 7f0003d73700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:6800/12842,v1:172.21.15.142:6801/12842] conn(0x7effe4046840 0x7effe4048cb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.935+0000 7f0003d73700 1 --2- 172.21.15.84:0/643517397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effe4003a20 0x7effe4003e90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.935+0000 7f0003d73700 1 -- 172.21.15.84:0/643517397 shutdown_connections 2020-01-16T05:44:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.935+0000 7f0003d73700 1 -- 172.21.15.84:0/643517397 wait complete. 2020-01-16T05:44:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:08.935+0000 7f0003d73700 1 -- 172.21.15.84:0/643517397 >> 172.21.15.84:0/643517397 conn(0x7efffc05a8e0 msgr2=0x7efffc126a30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:08.962 INFO:teuthology.orchestra.run.smithi084.stdout:55834574853 2020-01-16T05:44:08.962 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2020-01-16T05:44:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d7a40700 1 Processor -- start 2020-01-16T05:44:09.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d7a40700 1 -- start start 2020-01-16T05:44:09.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d7a40700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f94d005b0f0 0x7f94d00a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:09.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d7a40700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d008fd80 0x7f94d01503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:09.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d7a40700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d007cd60 con 0x7f94d00a2f60 2020-01-16T05:44:09.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d7a40700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d00a3390 con 0x7f94d005b0f0 2020-01-16T05:44:09.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d7a40700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00905b0 con 0x7f94d008fd80 2020-01-16T05:44:09.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d57dc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f94d005b0f0 0x7f94d00a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d57dc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f94d005b0f0 0x7f94d00a8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34204/0 (socket says 172.21.15.84:34204) 2020-01-16T05:44:09.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d57dc700 1 -- 172.21.15.84:0/3422619468 learned_addr learned my addr 172.21.15.84:0/3422619468 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:09.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d67de700 1 --2- 172.21.15.84:0/3422619468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d008fd80 0x7f94d01503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d57dc700 1 -- 172.21.15.84:0/3422619468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d008fd80 msgr2=0x7f94d01503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:09.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d57dc700 1 --2- 172.21.15.84:0/3422619468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d008fd80 0x7f94d01503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:09.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d57dc700 1 -- 172.21.15.84:0/3422619468 >> v1:172.21.15.142:6789/0 conn(0x7f94d00a2f60 legacy=0x7f94d007c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d57dc700 1 -- 172.21.15.84:0/3422619468 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d005b520 con 0x7f94d005b0f0 2020-01-16T05:44:09.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d57dc700 1 --2- 172.21.15.84:0/3422619468 >> v2:172.21.15.84:3300/0 conn(0x7f94d005b0f0 0x7f94d00a8ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f94d0090770 tx=0x7f94c000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d57dc700 1 --2- 172.21.15.84:0/3422619468 >> v2:172.21.15.84:3300/0 conn(0x7f94d005b0f0 0x7f94d00a8ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f94d0090770 tx=0x7f94c000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d57dc700 1 --2- 172.21.15.84:0/3422619468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94d005b0f0 0x7f94d00a8ff0 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f94d0090770 tx=0x7f94c000feb0).ready entity=mon.0 client_cookie=3db6412e1a0aa74 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:09.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d57dc700 1 --2- 172.21.15.84:0/3422619468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94d005b0f0 0x7f94d00a8ff0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f94d0090770 tx=0x7f94c000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d4fdb700 1 -- 172.21.15.84:0/3422619468 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94c0011720 con 0x7f94d005b0f0 2020-01-16T05:44:09.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d57dc700 1 --2- 172.21.15.84:0/3422619468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94d005b0f0 0x7f94d00a8ff0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f94d0090770 tx=0x7f94c000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d4fdb700 1 -- 172.21.15.84:0/3422619468 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c0008d30 con 0x7f94d005b0f0 2020-01-16T05:44:09.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d57dc700 1 --2- 172.21.15.84:0/3422619468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94d005b0f0 0x7f94d00a8ff0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f94d0090770 tx=0x7f94c000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d4fdb700 1 -- 172.21.15.84:0/3422619468 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94c0011d00 con 0x7f94d005b0f0 2020-01-16T05:44:09.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d7a40700 1 -- 172.21.15.84:0/3422619468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94d005b0f0 msgr2=0x7f94d00a8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.083+0000 7f94d7a40700 1 --2- 172.21.15.84:0/3422619468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94d005b0f0 0x7f94d00a8ff0 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f94d0090770 tx=0x7f94c000feb0).stop 2020-01-16T05:44:09.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.087+0000 7f94d7a40700 1 -- 172.21.15.84:0/3422619468 shutdown_connections 2020-01-16T05:44:09.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.087+0000 7f94d7a40700 1 --2- 172.21.15.84:0/3422619468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d008fd80 0x7f94d01503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:09.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.087+0000 7f94d7a40700 1 --2- 172.21.15.84:0/3422619468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94d005b0f0 0x7f94d00a8ff0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.087+0000 7f94d7a40700 1 -- 172.21.15.84:0/3422619468 shutdown_connections 2020-01-16T05:44:09.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.087+0000 7f94d7a40700 1 -- 172.21.15.84:0/3422619468 wait complete. 2020-01-16T05:44:09.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.087+0000 7f94d7a40700 1 -- 172.21.15.84:0/3422619468 >> 172.21.15.84:0/3422619468 conn(0x7f94d00abc10 msgr2=0x7f94d005a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:09.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.087+0000 7f94d7a40700 1 Processor -- start 2020-01-16T05:44:09.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.087+0000 7f94d7a40700 1 -- start start 2020-01-16T05:44:09.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.087+0000 7f94d7a40700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d0131ad0 0x7f94d0139f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.087+0000 7f94d7a40700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d0080090 con 0x7f94d007c0f0 2020-01-16T05:44:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.087+0000 7f94d7a40700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d007f540 con 0x7f94d01326e0 2020-01-16T05:44:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.087+0000 7f94d7a40700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d01321a0 con 0x7f94d0131ad0 2020-01-16T05:44:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.087+0000 7f94d57dc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f94d007c0f0 0x7f94d007ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51410/0 (socket says 172.21.15.84:51410) 2020-01-16T05:44:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.087+0000 7f94d57dc700 1 -- 172.21.15.84:0/174303952 learned_addr learned my addr 172.21.15.84:0/174303952 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d67de700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d0131ad0 0x7f94d0139f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94c67fc700 1 -- 172.21.15.84:0/174303952 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012024366 0 0) 0x7f94d0080090 con 0x7f94d007c0f0 2020-01-16T05:44:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94c67fc700 1 -- 172.21.15.84:0/174303952 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94b8003230 con 0x7f94d007c0f0 2020-01-16T05:44:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94c67fc700 1 -- 172.21.15.84:0/174303952 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266929137 0 0) 0x7f94d007f540 con 0x7f94d01326e0 2020-01-16T05:44:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94c67fc700 1 -- 172.21.15.84:0/174303952 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94d0080090 con 0x7f94d01326e0 2020-01-16T05:44:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d67de700 1 -- 172.21.15.84:0/174303952 >> v1:172.21.15.142:6789/0 conn(0x7f94d01326e0 legacy=0x7f94d012e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94c67fc700 1 -- 172.21.15.84:0/174303952 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3885960723 0 0) 0x7f94b8003230 con 0x7f94d007c0f0 2020-01-16T05:44:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d67de700 1 -- 172.21.15.84:0/174303952 >> v1:172.21.15.84:6789/0 conn(0x7f94d007c0f0 legacy=0x7f94d007ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d67de700 1 -- 172.21.15.84:0/174303952 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d0146c70 con 0x7f94d0131ad0 2020-01-16T05:44:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d67de700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d0131ad0 0x7f94d0139f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f94c0010300 tx=0x7f94c00103c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d67de700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d0131ad0 0x7f94d0139f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f94c0010300 tx=0x7f94c00103c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d67de700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d0131ad0 0x7f94d0139f30 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f94c0010300 tx=0x7f94c00103c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:09.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d67de700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d0131ad0 0x7f94d0139f30 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f94c0010300 tx=0x7f94c00103c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94c67fc700 1 -- 172.21.15.84:0/174303952 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94c0008d30 con 0x7f94d0131ad0 2020-01-16T05:44:09.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d67de700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d0131ad0 0x7f94d0139f30 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f94c0010300 tx=0x7f94c00103c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d67de700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d0131ad0 0x7f94d0139f30 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f94c0010300 tx=0x7f94c00103c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94c67fc700 1 -- 172.21.15.84:0/174303952 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c0011920 con 0x7f94d0131ad0 2020-01-16T05:44:09.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94c67fc700 1 -- 172.21.15.84:0/174303952 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94c800ecc0 con 0x7f94d0131ad0 2020-01-16T05:44:09.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d7a40700 1 -- 172.21.15.84:0/174303952 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d0066ce0 con 0x7f94d0131ad0 2020-01-16T05:44:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d7a40700 1 -- 172.21.15.84:0/174303952 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d013a480 con 0x7f94d0131ad0 2020-01-16T05:44:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d7a40700 1 -- 172.21.15.84:0/174303952 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f94d005e1c0 con 0x7f94d0131ad0 2020-01-16T05:44:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d67de700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d0131ad0 0x7f94d0139f30 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f94c0010300 tx=0x7f94c00103c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94c67fc700 1 -- 172.21.15.84:0/174303952 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f94c8010140 con 0x7f94d0131ad0 2020-01-16T05:44:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d67de700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d0131ad0 0x7f94d0139f30 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f94c0010300 tx=0x7f94c00103c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94c67fc700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f94b803c9d0 0x7f94b803eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d67de700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d0131ad0 0x7f94d0139f30 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f94c0010300 tx=0x7f94c00103c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94c67fc700 1 -- 172.21.15.84:0/174303952 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f94c804c840 con 0x7f94d0131ad0 2020-01-16T05:44:09.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d5fdd700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f94b803c9d0 0x7f94b803eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94c67fc700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.142:6808/12843,v1:172.21.15.142:6809/12843] conn(0x7f94b8043160 0x7f94b80455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94c67fc700 1 -- 172.21.15.84:0/174303952 --> [v2:172.21.15.142:6808/12843,v1:172.21.15.142:6809/12843] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f94b8045c80 con 0x7f94b8043160 2020-01-16T05:44:09.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94c67fc700 1 -- 172.21.15.84:0/174303952 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94c804dcb0 con 0x7f94d0131ad0 2020-01-16T05:44:09.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d5fdd700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f94b803c9d0 0x7f94b803eee0 crc :-1 s=READY pgs=59 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:09.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.091+0000 7f94d57dc700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.142:6808/12843,v1:172.21.15.142:6809/12843] conn(0x7f94b8043160 0x7f94b80455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.095+0000 7f94d57dc700 1 -- 172.21.15.84:0/174303952 >> [v2:172.21.15.142:6808/12843,v1:172.21.15.142:6809/12843] conn(0x7f94b8043160 msgr2=0x7f94b80455d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2020-01-16T05:44:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.095+0000 7f94d57dc700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.142:6808/12843,v1:172.21.15.142:6809/12843] conn(0x7f94b8043160 0x7f94b80455d0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.095+0000 7f94c67fc700 1 -- 172.21.15.84:0/174303952 <== osd.5 v2:172.21.15.142:6808/12843 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (crc 0 0 0) 0x7f94b8045c80 con 0x7f94b8043160 2020-01-16T05:44:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.119+0000 7f94d7a40700 1 -- 172.21.15.84:0/174303952 --> [v2:172.21.15.142:6808/12843,v1:172.21.15.142:6809/12843] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f94d008f350 con 0x7f94b8043160 2020-01-16T05:44:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.119+0000 7f94c67fc700 1 -- 172.21.15.84:0/174303952 <== osd.5 v2:172.21.15.142:6808/12843 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f94d008f350 con 0x7f94b8043160 2020-01-16T05:44:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.119+0000 7f94d7a40700 1 -- 172.21.15.84:0/174303952 >> [v2:172.21.15.142:6808/12843,v1:172.21.15.142:6809/12843] conn(0x7f94b8043160 msgr2=0x7f94b80455d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.119+0000 7f94d7a40700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.142:6808/12843,v1:172.21.15.142:6809/12843] conn(0x7f94b8043160 0x7f94b80455d0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.119+0000 7f94d7a40700 1 -- 172.21.15.84:0/174303952 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f94b803c9d0 msgr2=0x7f94b803eee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.119+0000 7f94d7a40700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f94b803c9d0 0x7f94b803eee0 crc :-1 s=READY pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.119+0000 7f94d7a40700 1 -- 172.21.15.84:0/174303952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d0131ad0 msgr2=0x7f94d0139f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.119+0000 7f94d7a40700 1 --2- 172.21.15.84:0/174303952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d0131ad0 0x7f94d0139f30 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f94c0010300 tx=0x7f94c00103c0).stop 2020-01-16T05:44:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.119+0000 7f94d67de700 1 -- 172.21.15.84:0/174303952 reap_dead start 2020-01-16T05:44:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.119+0000 7f94d7a40700 1 -- 172.21.15.84:0/174303952 shutdown_connections 2020-01-16T05:44:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.119+0000 7f94d7a40700 1 -- 172.21.15.84:0/174303952 shutdown_connections 2020-01-16T05:44:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.119+0000 7f94d7a40700 1 -- 172.21.15.84:0/174303952 wait complete. 2020-01-16T05:44:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.119+0000 7f94d7a40700 1 -- 172.21.15.84:0/174303952 >> 172.21.15.84:0/174303952 conn(0x7f94d00abc10 msgr2=0x7f94d008fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:09.138 INFO:teuthology.orchestra.run.smithi084.stdout:60129542149 2020-01-16T05:44:09.138 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2020-01-16T05:44:09.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07ea61a700 1 Processor -- start 2020-01-16T05:44:09.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07ea61a700 1 -- start start 2020-01-16T05:44:09.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07ea61a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07e407ff10 0x7f07e40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:09.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07ea61a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e4066880 con 0x7f07e40a4250 2020-01-16T05:44:09.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07ea61a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e4066ab0 con 0x7f07e40a9b30 2020-01-16T05:44:09.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07ea61a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e40a4830 con 0x7f07e407ff10 2020-01-16T05:44:09.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07eb87c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f07e40a4250 0x7f07e414fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51422/0 (socket says 172.21.15.84:51422) 2020-01-16T05:44:09.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07eb87c700 1 -- 172.21.15.84:0/3253162291 learned_addr learned my addr 172.21.15.84:0/3253162291 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:09.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e9618700 1 --2- 172.21.15.84:0/3253162291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07e407ff10 0x7f07e40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 -- 172.21.15.84:0/3253162291 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140730077 0 0) 0x7f07e4066880 con 0x7f07e40a4250 2020-01-16T05:44:09.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 -- 172.21.15.84:0/3253162291 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07d0003230 con 0x7f07e40a4250 2020-01-16T05:44:09.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 -- 172.21.15.84:0/3253162291 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291367212 0 0) 0x7f07e4066ab0 con 0x7f07e40a9b30 2020-01-16T05:44:09.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 -- 172.21.15.84:0/3253162291 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e4066880 con 0x7f07e40a9b30 2020-01-16T05:44:09.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 -- 172.21.15.84:0/3253162291 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2966553981 0 0) 0x7f07d0003230 con 0x7f07e40a4250 2020-01-16T05:44:09.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 -- 172.21.15.84:0/3253162291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07e407ff10 msgr2=0x7f07e40abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:09.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 --2- 172.21.15.84:0/3253162291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07e407ff10 0x7f07e40abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:09.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 -- 172.21.15.84:0/3253162291 >> v1:172.21.15.142:6789/0 conn(0x7f07e40a9b30 legacy=0x7f07e40a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 -- 172.21.15.84:0/3253162291 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e4066ce0 con 0x7f07e40a4250 2020-01-16T05:44:09.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 -- 172.21.15.84:0/3253162291 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f07dc001ad0 con 0x7f07e40a4250 2020-01-16T05:44:09.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e9618700 1 --2- 172.21.15.84:0/3253162291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07e407ff10 0x7f07e40abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:09.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 -- 172.21.15.84:0/3253162291 >> v1:172.21.15.84:6789/0 conn(0x7f07e40a4250 legacy=0x7f07e414fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 --2- 172.21.15.84:0/3253162291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07d0003ac0 0x7f07d0003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:09.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 --2- 172.21.15.84:0/3253162291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07d00045a0 0x7f07d00049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:09.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 --2- 172.21.15.84:0/3253162291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d0004fb0 0x7f07d004f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:09.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 -- 172.21.15.84:0/3253162291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e40a4830 con 0x7f07d0004fb0 2020-01-16T05:44:09.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 -- 172.21.15.84:0/3253162291 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d004fde0 con 0x7f07d0003ac0 2020-01-16T05:44:09.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 -- 172.21.15.84:0/3253162291 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d004fff0 con 0x7f07d00045a0 2020-01-16T05:44:09.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07eb87c700 1 --2- 172.21.15.84:0/3253162291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d0004fb0 0x7f07d004f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e9e19700 1 --2- 172.21.15.84:0/3253162291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07d0003ac0 0x7f07d0003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e9618700 1 --2- 172.21.15.84:0/3253162291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07d00045a0 0x7f07d00049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07eb87c700 1 -- 172.21.15.84:0/3253162291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07d00045a0 msgr2=0x7f07d00049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:09.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07eb87c700 1 --2- 172.21.15.84:0/3253162291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07d00045a0 0x7f07d00049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:09.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07eb87c700 1 -- 172.21.15.84:0/3253162291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07d0003ac0 msgr2=0x7f07d0003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:09.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07eb87c700 1 --2- 172.21.15.84:0/3253162291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07d0003ac0 0x7f07d0003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:09.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07eb87c700 1 -- 172.21.15.84:0/3253162291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d00502f0 con 0x7f07d0004fb0 2020-01-16T05:44:09.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07eb87c700 1 --2- 172.21.15.84:0/3253162291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d0004fb0 0x7f07d004f800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f07d0005570 tx=0x7f07dc00c690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07eb87c700 1 --2- 172.21.15.84:0/3253162291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d0004fb0 0x7f07d004f800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f07d0005570 tx=0x7f07dc00c690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07eb87c700 1 --2- 172.21.15.84:0/3253162291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d0004fb0 0x7f07d004f800 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f07d0005570 tx=0x7f07dc00c690).ready entity=mon.0 client_cookie=e46bdfc9bab6892f server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:09.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07eb87c700 1 --2- 172.21.15.84:0/3253162291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d0004fb0 0x7f07d004f800 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f07d0005570 tx=0x7f07dc00c690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 -- 172.21.15.84:0/3253162291 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07dc005d40 con 0x7f07d0004fb0 2020-01-16T05:44:09.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07eb87c700 1 --2- 172.21.15.84:0/3253162291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d0004fb0 0x7f07d004f800 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f07d0005570 tx=0x7f07dc00c690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07eb87c700 1 --2- 172.21.15.84:0/3253162291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d0004fb0 0x7f07d004f800 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f07d0005570 tx=0x7f07dc00c690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 -- 172.21.15.84:0/3253162291 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07dc005960 con 0x7f07d0004fb0 2020-01-16T05:44:09.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07e8e17700 1 -- 172.21.15.84:0/3253162291 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07dc005100 con 0x7f07d0004fb0 2020-01-16T05:44:09.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07ea61a700 1 -- 172.21.15.84:0/3253162291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d0004fb0 msgr2=0x7f07d004f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07ea61a700 1 --2- 172.21.15.84:0/3253162291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07d0004fb0 0x7f07d004f800 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f07d0005570 tx=0x7f07dc00c690).stop 2020-01-16T05:44:09.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.255+0000 7f07eb87c700 1 -- 172.21.15.84:0/3253162291 reap_dead start 2020-01-16T05:44:09.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.259+0000 7f07ea61a700 1 -- 172.21.15.84:0/3253162291 shutdown_connections 2020-01-16T05:44:09.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.259+0000 7f07ea61a700 1 -- 172.21.15.84:0/3253162291 shutdown_connections 2020-01-16T05:44:09.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.259+0000 7f07ea61a700 1 -- 172.21.15.84:0/3253162291 wait complete. 2020-01-16T05:44:09.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.259+0000 7f07ea61a700 1 -- 172.21.15.84:0/3253162291 >> 172.21.15.84:0/3253162291 conn(0x7f07e40acfc0 msgr2=0x7f07e40a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:09.275 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.259+0000 7f07ea61a700 1 Processor -- start 2020-01-16T05:44:09.275 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.259+0000 7f07ea61a700 1 -- start start 2020-01-16T05:44:09.275 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.259+0000 7f07ea61a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f07e4065890 0x7f07e40a55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.275 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.259+0000 7f07ea61a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f07e409eac0 0x7f07e409eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.275 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.259+0000 7f07ea61a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e407f120 con 0x7f07e4126ce0 2020-01-16T05:44:09.275 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.259+0000 7f07ea61a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e4127330 con 0x7f07e4065890 2020-01-16T05:44:09.275 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.259+0000 7f07ea61a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e41275d0 con 0x7f07e409eac0 2020-01-16T05:44:09.276 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.259+0000 7f07e9e19700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f07e4065890 0x7f07e40a55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.276 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.259+0000 7f07e9e19700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f07e4065890 0x7f07e40a55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34230/0 (socket says 172.21.15.84:34230) 2020-01-16T05:44:09.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.259+0000 7f07e9e19700 1 -- 172.21.15.84:0/3243034264 learned_addr learned my addr 172.21.15.84:0/3243034264 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:09.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07eb87c700 1 --2- 172.21.15.84:0/3243034264 >> v2:172.21.15.142:3300/0 conn(0x7f07e409eac0 0x7f07e409eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07e9e19700 1 -- 172.21.15.84:0/3243034264 >> v2:172.21.15.142:3300/0 conn(0x7f07e409eac0 msgr2=0x7f07e409eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07e9e19700 1 --2- 172.21.15.84:0/3243034264 >> v2:172.21.15.142:3300/0 conn(0x7f07e409eac0 0x7f07e409eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07e9e19700 1 -- 172.21.15.84:0/3243034264 >> v1:172.21.15.142:6789/0 conn(0x7f07e4126ce0 legacy=0x7f07e407e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07e9e19700 1 -- 172.21.15.84:0/3243034264 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e409f440 con 0x7f07e4065890 2020-01-16T05:44:09.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07e9e19700 1 --2- 172.21.15.84:0/3243034264 >> v2:172.21.15.84:3300/0 conn(0x7f07e4065890 0x7f07e40a55e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f07e41274f0 tx=0x7f07d8010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07e9e19700 1 --2- 172.21.15.84:0/3243034264 >> v2:172.21.15.84:3300/0 conn(0x7f07e4065890 0x7f07e40a55e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f07e41274f0 tx=0x7f07d8010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07e9e19700 1 --2- 172.21.15.84:0/3243034264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e4065890 0x7f07e40a55e0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f07e41274f0 tx=0x7f07d8010d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:09.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07e9e19700 1 --2- 172.21.15.84:0/3243034264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e4065890 0x7f07e40a55e0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f07e41274f0 tx=0x7f07d8010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07d67fc700 1 -- 172.21.15.84:0/3243034264 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07d8003540 con 0x7f07e4065890 2020-01-16T05:44:09.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07e9e19700 1 --2- 172.21.15.84:0/3243034264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e4065890 0x7f07e40a55e0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f07e41274f0 tx=0x7f07d8010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07e9e19700 1 --2- 172.21.15.84:0/3243034264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e4065890 0x7f07e40a55e0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f07e41274f0 tx=0x7f07d8010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.281 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07d67fc700 1 -- 172.21.15.84:0/3243034264 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d8003160 con 0x7f07e4065890 2020-01-16T05:44:09.281 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07d67fc700 1 -- 172.21.15.84:0/3243034264 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07d8003b20 con 0x7f07e4065890 2020-01-16T05:44:09.281 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07ea61a700 1 -- 172.21.15.84:0/3243034264 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e409f770 con 0x7f07e4065890 2020-01-16T05:44:09.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07ea61a700 1 -- 172.21.15.84:0/3243034264 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e413f450 con 0x7f07e4065890 2020-01-16T05:44:09.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07ea61a700 1 -- 172.21.15.84:0/3243034264 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f07e405e1c0 con 0x7f07e4065890 2020-01-16T05:44:09.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07e9e19700 1 --2- 172.21.15.84:0/3243034264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e4065890 0x7f07e40a55e0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f07e41274f0 tx=0x7f07d8010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07d67fc700 1 -- 172.21.15.84:0/3243034264 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f07d80064e0 con 0x7f07e4065890 2020-01-16T05:44:09.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07e9e19700 1 --2- 172.21.15.84:0/3243034264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e4065890 0x7f07e40a55e0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f07e41274f0 tx=0x7f07d8010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07e9e19700 1 --2- 172.21.15.84:0/3243034264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e4065890 0x7f07e40a55e0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f07e41274f0 tx=0x7f07d8010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07d67fc700 1 --2- 172.21.15.84:0/3243034264 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f07cc03c240 0x7f07cc03e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07d67fc700 1 -- 172.21.15.84:0/3243034264 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f07d804cc30 con 0x7f07e4065890 2020-01-16T05:44:09.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07d67fc700 1 --2- 172.21.15.84:0/3243034264 >> [v2:172.21.15.142:6816/12844,v1:172.21.15.142:6818/12844] conn(0x7f07cc042af0 0x7f07cc044f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07d67fc700 1 -- 172.21.15.84:0/3243034264 --> [v2:172.21.15.142:6816/12844,v1:172.21.15.142:6818/12844] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f07cc045610 con 0x7f07cc042af0 2020-01-16T05:44:09.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07d67fc700 1 -- 172.21.15.84:0/3243034264 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07d804d0c0 con 0x7f07e4065890 2020-01-16T05:44:09.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.263+0000 7f07e9618700 1 --2- 172.21.15.84:0/3243034264 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f07cc03c240 0x7f07cc03e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.267+0000 7f07eb87c700 1 --2- 172.21.15.84:0/3243034264 >> [v2:172.21.15.142:6816/12844,v1:172.21.15.142:6818/12844] conn(0x7f07cc042af0 0x7f07cc044f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.267+0000 7f07e9618700 1 --2- 172.21.15.84:0/3243034264 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f07cc03c240 0x7f07cc03e750 crc :-1 s=READY pgs=60 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:09.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.267+0000 7f07eb87c700 1 -- 172.21.15.84:0/3243034264 >> [v2:172.21.15.142:6816/12844,v1:172.21.15.142:6818/12844] conn(0x7f07cc042af0 msgr2=0x7f07cc044f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2020-01-16T05:44:09.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.267+0000 7f07eb87c700 1 --2- 172.21.15.84:0/3243034264 >> [v2:172.21.15.142:6816/12844,v1:172.21.15.142:6818/12844] conn(0x7f07cc042af0 0x7f07cc044f60 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:09.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.267+0000 7f07d67fc700 1 -- 172.21.15.84:0/3243034264 <== osd.6 v2:172.21.15.142:6816/12844 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (crc 0 0 0) 0x7f07cc045610 con 0x7f07cc042af0 2020-01-16T05:44:09.287 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.287+0000 7f07ea61a700 1 -- 172.21.15.84:0/3243034264 --> [v2:172.21.15.142:6816/12844,v1:172.21.15.142:6818/12844] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f07e40554d0 con 0x7f07cc042af0 2020-01-16T05:44:09.288 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.287+0000 7f07d67fc700 1 -- 172.21.15.84:0/3243034264 <== osd.6 v2:172.21.15.142:6816/12844 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f07e40554d0 con 0x7f07cc042af0 2020-01-16T05:44:09.289 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.287+0000 7f07ea61a700 1 -- 172.21.15.84:0/3243034264 >> [v2:172.21.15.142:6816/12844,v1:172.21.15.142:6818/12844] conn(0x7f07cc042af0 msgr2=0x7f07cc044f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.290 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.287+0000 7f07ea61a700 1 --2- 172.21.15.84:0/3243034264 >> [v2:172.21.15.142:6816/12844,v1:172.21.15.142:6818/12844] conn(0x7f07cc042af0 0x7f07cc044f60 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.290 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.287+0000 7f07ea61a700 1 -- 172.21.15.84:0/3243034264 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f07cc03c240 msgr2=0x7f07cc03e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.290 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.287+0000 7f07ea61a700 1 --2- 172.21.15.84:0/3243034264 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f07cc03c240 0x7f07cc03e750 crc :-1 s=READY pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.290 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.287+0000 7f07ea61a700 1 -- 172.21.15.84:0/3243034264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e4065890 msgr2=0x7f07e40a55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.290 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.287+0000 7f07ea61a700 1 --2- 172.21.15.84:0/3243034264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e4065890 0x7f07e40a55e0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f07e41274f0 tx=0x7f07d8010d30).stop 2020-01-16T05:44:09.290 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.287+0000 7f07eb87c700 1 -- 172.21.15.84:0/3243034264 reap_dead start 2020-01-16T05:44:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.287+0000 7f07ea61a700 1 -- 172.21.15.84:0/3243034264 shutdown_connections 2020-01-16T05:44:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.287+0000 7f07ea61a700 1 --2- 172.21.15.84:0/3243034264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e4065890 0x7f07e40a55e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.287+0000 7f07ea61a700 1 -- 172.21.15.84:0/3243034264 shutdown_connections 2020-01-16T05:44:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.287+0000 7f07ea61a700 1 -- 172.21.15.84:0/3243034264 wait complete. 2020-01-16T05:44:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.287+0000 7f07ea61a700 1 -- 172.21.15.84:0/3243034264 >> 172.21.15.84:0/3243034264 conn(0x7f07e40a9b30 msgr2=0x7f07e405e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:09.302 INFO:teuthology.orchestra.run.smithi084.stdout:55834574853 2020-01-16T05:44:09.303 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2020-01-16T05:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.415+0000 7f26cd166700 1 Processor -- start 2020-01-16T05:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.415+0000 7f26cd166700 1 -- start start 2020-01-16T05:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cd166700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26c80a8ff0 0x7f26c808fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cd166700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c80902d0 con 0x7f26c80a2f60 2020-01-16T05:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cd166700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c807cd60 con 0x7f26c805b0f0 2020-01-16T05:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cd166700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c80a3390 con 0x7f26c80a8ff0 2020-01-16T05:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26c759e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f26c80a2f60 0x7f26c807c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51442/0 (socket says 172.21.15.84:51442) 2020-01-16T05:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26c759e700 1 -- 172.21.15.84:0/701727646 learned_addr learned my addr 172.21.15.84:0/701727646 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cc965700 1 --2- 172.21.15.84:0/701727646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26c80a8ff0 0x7f26c808fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26c659c700 1 -- 172.21.15.84:0/701727646 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989002855 0 0) 0x7f26c0001450 con 0x7f26c80a2f60 2020-01-16T05:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26c659c700 1 -- 172.21.15.84:0/701727646 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26b4003230 con 0x7f26c80a2f60 2020-01-16T05:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cc965700 1 -- 172.21.15.84:0/701727646 >> v1:172.21.15.142:6789/0 conn(0x7f26c805b0f0 legacy=0x7f26c814e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26c659c700 1 -- 172.21.15.84:0/701727646 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510211723 0 0) 0x7f26c807cd60 con 0x7f26c805b0f0 2020-01-16T05:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cc965700 1 -- 172.21.15.84:0/701727646 >> v1:172.21.15.84:6789/0 conn(0x7f26c80a2f60 legacy=0x7f26c807c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cc965700 1 -- 172.21.15.84:0/701727646 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c805b520 con 0x7f26c80a8ff0 2020-01-16T05:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cc965700 1 --2- 172.21.15.84:0/701727646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26c80a8ff0 0x7f26c808fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f26c0001ec0 tx=0x7f26b0001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cc965700 1 --2- 172.21.15.84:0/701727646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26c80a8ff0 0x7f26c808fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f26c0001ec0 tx=0x7f26b0001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cc965700 1 --2- 172.21.15.84:0/701727646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26c80a8ff0 0x7f26c808fd80 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f26c0001ec0 tx=0x7f26b0001150).ready entity=mon.2 client_cookie=4c6290fb84aff026 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cc965700 1 --2- 172.21.15.84:0/701727646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26c80a8ff0 0x7f26c808fd80 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f26c0001ec0 tx=0x7f26b0001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26c659c700 1 -- 172.21.15.84:0/701727646 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26c0001c80 con 0x7f26c80a8ff0 2020-01-16T05:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cc965700 1 --2- 172.21.15.84:0/701727646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26c80a8ff0 0x7f26c808fd80 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f26c0001ec0 tx=0x7f26b0001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cc965700 1 --2- 172.21.15.84:0/701727646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26c80a8ff0 0x7f26c808fd80 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f26c0001ec0 tx=0x7f26b0001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26c659c700 1 -- 172.21.15.84:0/701727646 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c0001a90 con 0x7f26c80a8ff0 2020-01-16T05:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26c659c700 1 -- 172.21.15.84:0/701727646 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26b80114e0 con 0x7f26c80a8ff0 2020-01-16T05:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cd166700 1 -- 172.21.15.84:0/701727646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26c80a8ff0 msgr2=0x7f26c808fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cd166700 1 --2- 172.21.15.84:0/701727646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26c80a8ff0 0x7f26c808fd80 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f26c0001ec0 tx=0x7f26b0001150).stop 2020-01-16T05:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cd166700 1 -- 172.21.15.84:0/701727646 shutdown_connections 2020-01-16T05:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cd166700 1 --2- 172.21.15.84:0/701727646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26c80a8ff0 0x7f26c808fd80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cd166700 1 -- 172.21.15.84:0/701727646 shutdown_connections 2020-01-16T05:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cd166700 1 -- 172.21.15.84:0/701727646 wait complete. 2020-01-16T05:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.419+0000 7f26cd166700 1 -- 172.21.15.84:0/701727646 >> 172.21.15.84:0/701727646 conn(0x7f26c80abc10 msgr2=0x7f26c805a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.423+0000 7f26cd166700 1 Processor -- start 2020-01-16T05:44:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.423+0000 7f26cd166700 1 -- start start 2020-01-16T05:44:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cd166700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f26c809e360 0x7f26c809eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cd166700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c8150d60 con 0x7f26c809f540 2020-01-16T05:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cd166700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c809fe30 con 0x7f26c80a44e0 2020-01-16T05:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cd166700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c80a0250 con 0x7f26c809e360 2020-01-16T05:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26c6d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f26c809f540 0x7f26c8150560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51448/0 (socket says 172.21.15.84:51448) 2020-01-16T05:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26c6d9d700 1 -- 172.21.15.84:0/1246097802 learned_addr learned my addr 172.21.15.84:0/1246097802 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26c759e700 1 --2- 172.21.15.84:0/1246097802 >> v2:172.21.15.142:3300/0 conn(0x7f26c809e360 0x7f26c809eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798257421 0 0) 0x7f26c8150d60 con 0x7f26c809f540 2020-01-16T05:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26ac003230 con 0x7f26c809f540 2020-01-16T05:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208976884 0 0) 0x7f26c809fe30 con 0x7f26c80a44e0 2020-01-16T05:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26c8150d60 con 0x7f26c80a44e0 2020-01-16T05:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3157881853 0 0) 0x7f26ac003230 con 0x7f26c809f540 2020-01-16T05:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f26c809fe30 con 0x7f26c809f540 2020-01-16T05:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f26b0001aa0 con 0x7f26c809f540 2020-01-16T05:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 >> v2:172.21.15.142:3300/0 conn(0x7f26c809e360 msgr2=0x7f26c809eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 --2- 172.21.15.84:0/1246097802 >> v2:172.21.15.142:3300/0 conn(0x7f26c809e360 0x7f26c809eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 >> v1:172.21.15.142:6789/0 conn(0x7f26c80a44e0 legacy=0x7f26c80a4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 >> v1:172.21.15.84:6789/0 conn(0x7f26c809f540 legacy=0x7f26c8150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26ac003c80 0x7f26ac0045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26ac004af0 0x7f26ac004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26ac0097e0 0x7f26ac00bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c80a0250 con 0x7f26ac0097e0 2020-01-16T05:44:09.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac00c170 con 0x7f26ac004af0 2020-01-16T05:44:09.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac00c330 con 0x7f26ac003c80 2020-01-16T05:44:09.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26c759e700 1 --2- 172.21.15.84:0/1246097802 >> v2:172.21.15.142:3300/0 conn(0x7f26c809e360 0x7f26c809eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:09.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cc965700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26ac0097e0 0x7f26ac00bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26c6d9d700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26ac004af0 0x7f26ac004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26c759e700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26ac003c80 0x7f26ac0045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cc965700 1 -- 172.21.15.84:0/1246097802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26ac003c80 msgr2=0x7f26ac0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cc965700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26ac003c80 0x7f26ac0045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cc965700 1 -- 172.21.15.84:0/1246097802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26ac004af0 msgr2=0x7f26ac004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cc965700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26ac004af0 0x7f26ac004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cc965700 1 -- 172.21.15.84:0/1246097802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c8134930 con 0x7f26ac0097e0 2020-01-16T05:44:09.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cd166700 1 -- 172.21.15.84:0/1246097802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c80a6340 con 0x7f26ac0097e0 2020-01-16T05:44:09.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cc965700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26ac0097e0 0x7f26ac00bc20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26b8007fd0 tx=0x7f26b8011830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cc965700 1 -- 172.21.15.84:0/1246097802 reap_dead start 2020-01-16T05:44:09.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cd166700 1 -- 172.21.15.84:0/1246097802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c80a65b0 con 0x7f26ac0097e0 2020-01-16T05:44:09.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cc965700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26ac0097e0 0x7f26ac00bc20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26b8007fd0 tx=0x7f26b8011830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cc965700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26ac0097e0 0x7f26ac00bc20 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f26b8007fd0 tx=0x7f26b8011830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:09.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cc965700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26ac0097e0 0x7f26ac00bc20 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f26b8007fd0 tx=0x7f26b8011830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cc965700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26ac0097e0 0x7f26ac00bc20 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f26b8007fd0 tx=0x7f26b8011830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cc965700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26ac0097e0 0x7f26ac00bc20 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f26b8007fd0 tx=0x7f26b8011830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26b8007700 con 0x7f26ac0097e0 2020-01-16T05:44:09.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cc965700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26ac0097e0 0x7f26ac00bc20 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f26b8007fd0 tx=0x7f26b8011830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b8008d00 con 0x7f26ac0097e0 2020-01-16T05:44:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26b80056c0 con 0x7f26ac0097e0 2020-01-16T05:44:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.427+0000 7f26cd166700 1 -- 172.21.15.84:0/1246097802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f26c80a0060 con 0x7f26ac0097e0 2020-01-16T05:44:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.431+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f26b8005980 con 0x7f26ac0097e0 2020-01-16T05:44:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.431+0000 7f26cc965700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26ac0097e0 0x7f26ac00bc20 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f26b8007fd0 tx=0x7f26b8011830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.431+0000 7f26cc965700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26ac0097e0 0x7f26ac00bc20 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f26b8007fd0 tx=0x7f26b8011830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.442 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.431+0000 7f26bffff700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f26ac040170 0x7f26ac042680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.442 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.431+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f26b804f230 con 0x7f26ac0097e0 2020-01-16T05:44:09.443 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.431+0000 7f26c759e700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f26ac040170 0x7f26ac042680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.443 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.431+0000 7f26bffff700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.142:6817/12845,v1:172.21.15.142:6819/12845] conn(0x7f26ac0469f0 0x7f26ac048e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.443 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.431+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 --> [v2:172.21.15.142:6817/12845,v1:172.21.15.142:6819/12845] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f26ac049510 con 0x7f26ac0469f0 2020-01-16T05:44:09.443 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.431+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26b80506c0 con 0x7f26ac0097e0 2020-01-16T05:44:09.444 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.431+0000 7f26c6d9d700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.142:6817/12845,v1:172.21.15.142:6819/12845] conn(0x7f26ac0469f0 0x7f26ac048e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.444 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.431+0000 7f26c759e700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f26ac040170 0x7f26ac042680 crc :-1 s=READY pgs=61 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:09.444 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.431+0000 7f26c6d9d700 1 -- 172.21.15.84:0/1246097802 >> [v2:172.21.15.142:6817/12845,v1:172.21.15.142:6819/12845] conn(0x7f26ac0469f0 msgr2=0x7f26ac048e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2020-01-16T05:44:09.444 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.431+0000 7f26c6d9d700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.142:6817/12845,v1:172.21.15.142:6819/12845] conn(0x7f26ac0469f0 0x7f26ac048e60 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:09.445 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.431+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 <== osd.7 v2:172.21.15.142:6817/12845 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (crc 0 0 0) 0x7f26ac049510 con 0x7f26ac0469f0 2020-01-16T05:44:09.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.451+0000 7f26cd166700 1 -- 172.21.15.84:0/1246097802 --> [v2:172.21.15.142:6817/12845,v1:172.21.15.142:6819/12845] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f26c805e1c0 con 0x7f26ac0469f0 2020-01-16T05:44:09.455 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.455+0000 7f26bffff700 1 -- 172.21.15.84:0/1246097802 <== osd.7 v2:172.21.15.142:6817/12845 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f26c805e1c0 con 0x7f26ac0469f0 2020-01-16T05:44:09.457 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.455+0000 7f26cd166700 1 -- 172.21.15.84:0/1246097802 >> [v2:172.21.15.142:6817/12845,v1:172.21.15.142:6819/12845] conn(0x7f26ac0469f0 msgr2=0x7f26ac048e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.458 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.455+0000 7f26cd166700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.142:6817/12845,v1:172.21.15.142:6819/12845] conn(0x7f26ac0469f0 0x7f26ac048e60 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.458 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.455+0000 7f26cd166700 1 -- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f26ac040170 msgr2=0x7f26ac042680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.458 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.455+0000 7f26cd166700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f26ac040170 0x7f26ac042680 crc :-1 s=READY pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.458 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.455+0000 7f26cd166700 1 -- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26ac0097e0 msgr2=0x7f26ac00bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.455+0000 7f26cd166700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26ac0097e0 0x7f26ac00bc20 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f26b8007fd0 tx=0x7f26b8011830).stop 2020-01-16T05:44:09.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.455+0000 7f26cd166700 1 -- 172.21.15.84:0/1246097802 shutdown_connections 2020-01-16T05:44:09.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.455+0000 7f26cd166700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.142:6817/12845,v1:172.21.15.142:6819/12845] conn(0x7f26ac0469f0 0x7f26ac048e60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.455+0000 7f26cd166700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f26ac040170 0x7f26ac042680 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.455+0000 7f26cd166700 1 --2- 172.21.15.84:0/1246097802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26ac0097e0 0x7f26ac00bc20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.455+0000 7f26cd166700 1 -- 172.21.15.84:0/1246097802 shutdown_connections 2020-01-16T05:44:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.455+0000 7f26cd166700 1 -- 172.21.15.84:0/1246097802 wait complete. 2020-01-16T05:44:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.455+0000 7f26cd166700 1 -- 172.21.15.84:0/1246097802 >> 172.21.15.84:0/1246097802 conn(0x7f26c80a86a0 msgr2=0x7f26c809b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:09.478 INFO:teuthology.orchestra.run.smithi084.stdout:60129542150 2020-01-16T05:44:09.479 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-01-16T05:44:09.604 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.595+0000 7fe1cc81d700 1 Processor -- start 2020-01-16T05:44:09.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.595+0000 7fe1cc81d700 1 -- start start 2020-01-16T05:44:09.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1cc81d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe1c80a9b30 0x7fe1c80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:09.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1cc81d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1c807ff10 0x7fe1c8066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:09.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1cc81d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c8066dd0 con 0x7fe1c80a4250 2020-01-16T05:44:09.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1cc81d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c80a4830 con 0x7fe1c80a9b30 2020-01-16T05:44:09.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1cc81d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c807f9d0 con 0x7fe1c807ff10 2020-01-16T05:44:09.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1cd01e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe1c80a4250 0x7fe1c80a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51466/0 (socket says 172.21.15.84:51466) 2020-01-16T05:44:09.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1cd01e700 1 -- 172.21.15.84:0/3668289559 learned_addr learned my addr 172.21.15.84:0/3668289559 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:09.607 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1c6d9d700 1 --2- 172.21.15.84:0/3668289559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1c807ff10 0x7fe1c8066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.607 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1c759e700 1 --2- 172.21.15.84:0/3668289559 >> v2:172.21.15.142:3300/0 conn(0x7fe1c80a9b30 0x7fe1c80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.607 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1c659c700 1 -- 172.21.15.84:0/3668289559 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918267417 0 0) 0x7fe1c8066dd0 con 0x7fe1c80a4250 2020-01-16T05:44:09.607 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1c659c700 1 -- 172.21.15.84:0/3668289559 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1b4003230 con 0x7fe1c80a4250 2020-01-16T05:44:09.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1c759e700 1 -- 172.21.15.84:0/3668289559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1c807ff10 msgr2=0x7fe1c8066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:09.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1c759e700 1 --2- 172.21.15.84:0/3668289559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1c807ff10 0x7fe1c8066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:09.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1c759e700 1 -- 172.21.15.84:0/3668289559 >> v1:172.21.15.84:6789/0 conn(0x7fe1c80a4250 legacy=0x7fe1c80a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1c759e700 1 -- 172.21.15.84:0/3668289559 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c8150ce0 con 0x7fe1c80a9b30 2020-01-16T05:44:09.609 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1c759e700 1 --2- 172.21.15.84:0/3668289559 >> v2:172.21.15.142:3300/0 conn(0x7fe1c80a9b30 0x7fe1c80abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe1c0008c90 tx=0x7fe1c0010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.609 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1c759e700 1 --2- 172.21.15.84:0/3668289559 >> v2:172.21.15.142:3300/0 conn(0x7fe1c80a9b30 0x7fe1c80abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe1c0008c90 tx=0x7fe1c0010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.609 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1c759e700 1 --2- 172.21.15.84:0/3668289559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1c80a9b30 0x7fe1c80abdd0 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fe1c0008c90 tx=0x7fe1c0010170).ready entity=mon.1 client_cookie=73b8133fa510cdcc server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:09.609 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1c759e700 1 --2- 172.21.15.84:0/3668289559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1c80a9b30 0x7fe1c80abdd0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fe1c0008c90 tx=0x7fe1c0010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1c659c700 1 -- 172.21.15.84:0/3668289559 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1c000a160 con 0x7fe1c80a9b30 2020-01-16T05:44:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1c759e700 1 --2- 172.21.15.84:0/3668289559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1c80a9b30 0x7fe1c80abdd0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fe1c0008c90 tx=0x7fe1c0010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1c659c700 1 -- 172.21.15.84:0/3668289559 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c0011af0 con 0x7fe1c80a9b30 2020-01-16T05:44:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1c759e700 1 --2- 172.21.15.84:0/3668289559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1c80a9b30 0x7fe1c80abdd0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fe1c0008c90 tx=0x7fe1c0010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.611 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1c659c700 1 -- 172.21.15.84:0/3668289559 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1c000a740 con 0x7fe1c80a9b30 2020-01-16T05:44:09.611 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1cc81d700 1 -- 172.21.15.84:0/3668289559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1c80a9b30 msgr2=0x7fe1c80abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.611 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1cc81d700 1 --2- 172.21.15.84:0/3668289559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1c80a9b30 0x7fe1c80abdd0 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fe1c0008c90 tx=0x7fe1c0010170).stop 2020-01-16T05:44:09.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1cc81d700 1 -- 172.21.15.84:0/3668289559 shutdown_connections 2020-01-16T05:44:09.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1cc81d700 1 --2- 172.21.15.84:0/3668289559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1c80a9b30 0x7fe1c80abdd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1cc81d700 1 --2- 172.21.15.84:0/3668289559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1c807ff10 0x7fe1c8066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:09.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1cc81d700 1 -- 172.21.15.84:0/3668289559 shutdown_connections 2020-01-16T05:44:09.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1cc81d700 1 -- 172.21.15.84:0/3668289559 wait complete. 2020-01-16T05:44:09.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.599+0000 7fe1cc81d700 1 -- 172.21.15.84:0/3668289559 >> 172.21.15.84:0/3668289559 conn(0x7fe1c80acfc0 msgr2=0x7fe1c80a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:09.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.603+0000 7fe1cc81d700 1 Processor -- start 2020-01-16T05:44:09.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.603+0000 7fe1cc81d700 1 -- start start 2020-01-16T05:44:09.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.603+0000 7fe1cc81d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe1c807bd40 0x7fe1c813e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.603+0000 7fe1cc81d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c8066220 con 0x7fe1c807c440 2020-01-16T05:44:09.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.603+0000 7fe1cc81d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c813f6f0 con 0x7fe1c807ae30 2020-01-16T05:44:09.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.603+0000 7fe1cc81d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c8125870 con 0x7fe1c807bd40 2020-01-16T05:44:09.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.603+0000 7fe1c759e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe1c807c440 0x7fe1c809f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51468/0 (socket says 172.21.15.84:51468) 2020-01-16T05:44:09.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.603+0000 7fe1c759e700 1 -- 172.21.15.84:0/1763541075 learned_addr learned my addr 172.21.15.84:0/1763541075 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:09.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.603+0000 7fe1cd01e700 1 --2- 172.21.15.84:0/1763541075 >> v2:172.21.15.142:3300/0 conn(0x7fe1c807bd40 0x7fe1c813e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.603+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851469445 0 0) 0x7fe1c8066220 con 0x7fe1c807c440 2020-01-16T05:44:09.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.603+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1ac003230 con 0x7fe1c807c440 2020-01-16T05:44:09.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727951802 0 0) 0x7fe1c813f6f0 con 0x7fe1c807ae30 2020-01-16T05:44:09.650 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1c8066220 con 0x7fe1c807ae30 2020-01-16T05:44:09.650 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3646086717 0 0) 0x7fe1ac003230 con 0x7fe1c807c440 2020-01-16T05:44:09.650 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe1c813f6f0 con 0x7fe1c807c440 2020-01-16T05:44:09.650 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7fe1c000a160 con 0x7fe1c807c440 2020-01-16T05:44:09.650 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 >> v2:172.21.15.142:3300/0 conn(0x7fe1c807bd40 msgr2=0x7fe1c813e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.650 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 --2- 172.21.15.84:0/1763541075 >> v2:172.21.15.142:3300/0 conn(0x7fe1c807bd40 0x7fe1c813e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.650 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 >> v1:172.21.15.142:6789/0 conn(0x7fe1c807ae30 legacy=0x7fe1c807b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.651 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 >> v1:172.21.15.84:6789/0 conn(0x7fe1c807c440 legacy=0x7fe1c809f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.651 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1ac003c30 0x7fe1ac0045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.651 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1ac004af0 0x7fe1ac004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.651 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0097e0 0x7fe1ac00bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.651 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8125870 con 0x7fe1ac0097e0 2020-01-16T05:44:09.651 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac00c170 con 0x7fe1ac003c30 2020-01-16T05:44:09.651 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac00c330 con 0x7fe1ac004af0 2020-01-16T05:44:09.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1cd01e700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0097e0 0x7fe1ac00bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1c759e700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1ac003c30 0x7fe1ac0045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1c6d9d700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1ac004af0 0x7fe1ac004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1cd01e700 1 -- 172.21.15.84:0/1763541075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1ac004af0 msgr2=0x7fe1ac004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1cd01e700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1ac004af0 0x7fe1ac004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1cd01e700 1 -- 172.21.15.84:0/1763541075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1ac003c30 msgr2=0x7fe1ac0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1cd01e700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1ac003c30 0x7fe1ac0045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1cd01e700 1 -- 172.21.15.84:0/1763541075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c80ab090 con 0x7fe1ac0097e0 2020-01-16T05:44:09.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1cc81d700 1 -- 172.21.15.84:0/1763541075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c813e6e0 con 0x7fe1ac0097e0 2020-01-16T05:44:09.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1cd01e700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0097e0 0x7fe1ac00bc20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe1b8004520 tx=0x7fe1b8010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1cc81d700 1 -- 172.21.15.84:0/1763541075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c813ebb0 con 0x7fe1ac0097e0 2020-01-16T05:44:09.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1cd01e700 1 -- 172.21.15.84:0/1763541075 reap_dead start 2020-01-16T05:44:09.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1cd01e700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0097e0 0x7fe1ac00bc20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe1b8004520 tx=0x7fe1b8010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1cd01e700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0097e0 0x7fe1ac00bc20 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7fe1b8004520 tx=0x7fe1b8010d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:09.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1cd01e700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0097e0 0x7fe1ac00bc20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fe1b8004520 tx=0x7fe1b8010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1b800cd10 con 0x7fe1ac0097e0 2020-01-16T05:44:09.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1cd01e700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0097e0 0x7fe1ac00bc20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fe1b8004520 tx=0x7fe1b8010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b800c930 con 0x7fe1ac0097e0 2020-01-16T05:44:09.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1cd01e700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0097e0 0x7fe1ac00bc20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fe1b8004520 tx=0x7fe1b8010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1b8004990 con 0x7fe1ac0097e0 2020-01-16T05:44:09.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1cd01e700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0097e0 0x7fe1ac00bc20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fe1b8004520 tx=0x7fe1b8010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1cc81d700 1 -- 172.21.15.84:0/1763541075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a0003360 con 0x7fe1ac0097e0 2020-01-16T05:44:09.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fe1b8004b90 con 0x7fe1ac0097e0 2020-01-16T05:44:09.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1cd01e700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0097e0 0x7fe1ac00bc20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fe1b8004520 tx=0x7fe1b8010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe1ac040110 0x7fe1ac042620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7fe1b804c2b0 con 0x7fe1ac0097e0 2020-01-16T05:44:09.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.607+0000 7fe1c759e700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe1ac040110 0x7fe1ac042620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.611+0000 7fe1c759e700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe1ac040110 0x7fe1ac042620 crc :-1 s=READY pgs=62 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:09.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.615+0000 7fe1cd01e700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0097e0 0x7fe1ac00bc20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fe1b8004520 tx=0x7fe1b8010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.615+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fe1b80328b0 con 0x7fe1ac0097e0 2020-01-16T05:44:09.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.731+0000 7fe1cc81d700 1 -- 172.21.15.84:0/1763541075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe1a00021f0 con 0x7fe1ac0097e0 2020-01-16T05:44:09.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.731+0000 7fe1cd01e700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0097e0 0x7fe1ac00bc20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fe1b8004520 tx=0x7fe1b8010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.739 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.731+0000 7fe1bffff700 1 -- 172.21.15.84:0/1763541075 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe1b8032b10 con 0x7fe1ac0097e0 2020-01-16T05:44:09.739 INFO:teuthology.orchestra.run.smithi084.stdout:60129542150 2020-01-16T05:44:09.740 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.731+0000 7fe1cc81d700 1 -- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe1ac040110 msgr2=0x7fe1ac042620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.740 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.731+0000 7fe1cc81d700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe1ac040110 0x7fe1ac042620 crc :-1 s=READY pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.740 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.731+0000 7fe1cc81d700 1 -- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0097e0 msgr2=0x7fe1ac00bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.740 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.731+0000 7fe1cc81d700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0097e0 0x7fe1ac00bc20 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7fe1b8004520 tx=0x7fe1b8010d90).stop 2020-01-16T05:44:09.740 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.731+0000 7fe1cc81d700 1 -- 172.21.15.84:0/1763541075 shutdown_connections 2020-01-16T05:44:09.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.731+0000 7fe1cc81d700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe1ac040110 0x7fe1ac042620 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.731+0000 7fe1cc81d700 1 --2- 172.21.15.84:0/1763541075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0097e0 0x7fe1ac00bc20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.731+0000 7fe1cc81d700 1 -- 172.21.15.84:0/1763541075 shutdown_connections 2020-01-16T05:44:09.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.731+0000 7fe1cc81d700 1 -- 172.21.15.84:0/1763541075 wait complete. 2020-01-16T05:44:09.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.731+0000 7fe1cc81d700 1 -- 172.21.15.84:0/1763541075 >> 172.21.15.84:0/1763541075 conn(0x7fe1c80acfc0 msgr2=0x7fe1c80a3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:09.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2020-01-16T05:44:09.745 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2020-01-16T05:44:09.863 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.855+0000 7f0afd85c700 1 Processor -- start 2020-01-16T05:44:09.863 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.855+0000 7f0afd85c700 1 -- start start 2020-01-16T05:44:09.863 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afd85c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0af80a9b30 0x7f0af80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:09.863 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afd85c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0af80a4250 0x7f0af8066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:09.863 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afd85c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af8066dd0 con 0x7f0af807ff10 2020-01-16T05:44:09.864 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afd85c700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af80a4830 con 0x7f0af80a9b30 2020-01-16T05:44:09.864 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afd85c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af807f9d0 con 0x7f0af80a4250 2020-01-16T05:44:09.870 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afc85a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0af807ff10 0x7f0af80a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51484/0 (socket says 172.21.15.84:51484) 2020-01-16T05:44:09.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afc85a700 1 -- 172.21.15.84:0/3812598976 learned_addr learned my addr 172.21.15.84:0/3812598976 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:09.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afd05b700 1 --2- 172.21.15.84:0/3812598976 >> v2:172.21.15.142:3300/0 conn(0x7f0af80a9b30 0x7f0af80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afeabe700 1 --2- 172.21.15.84:0/3812598976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0af80a4250 0x7f0af8066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0af7fff700 1 -- 172.21.15.84:0/3812598976 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495202215 0 0) 0x7f0af8066dd0 con 0x7f0af807ff10 2020-01-16T05:44:09.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0af7fff700 1 -- 172.21.15.84:0/3812598976 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ae0003230 con 0x7f0af807ff10 2020-01-16T05:44:09.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afc85a700 1 -- 172.21.15.84:0/3812598976 >> v1:172.21.15.84:6789/0 conn(0x7f0af807ff10 legacy=0x7f0af80a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2020-01-16T05:44:09.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afc85a700 1 -- 172.21.15.84:0/3812598976 >> v1:172.21.15.84:6789/0 conn(0x7f0af807ff10 legacy=0x7f0af80a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-01-16T05:44:09.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afc85a700 1 --1- 172.21.15.84:0/3812598976 >> v1:172.21.15.84:6789/0 conn(0x7f0af807ff10 0x7f0af80a4ad0 :-1 s=OPENED pgs=141 cs=1 l=1).handle_message read tag failed 2020-01-16T05:44:09.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afc85a700 1 --1- 172.21.15.84:0/3812598976 >> v1:172.21.15.84:6789/0 conn(0x7f0af807ff10 0x7f0af80a4ad0 :-1 s=OPENED pgs=141 cs=1 l=1).fault on lossy channel, failing 2020-01-16T05:44:09.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afeabe700 1 -- 172.21.15.84:0/3812598976 >> v2:172.21.15.142:3300/0 conn(0x7f0af80a9b30 msgr2=0x7f0af80abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:09.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afeabe700 1 --2- 172.21.15.84:0/3812598976 >> v2:172.21.15.142:3300/0 conn(0x7f0af80a9b30 0x7f0af80abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:09.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afeabe700 1 -- 172.21.15.84:0/3812598976 >> v1:172.21.15.84:6789/0 conn(0x7f0af807ff10 legacy=0x7f0af80a4ad0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-01-16T05:44:09.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afeabe700 1 -- 172.21.15.84:0/3812598976 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af8150ce0 con 0x7f0af80a4250 2020-01-16T05:44:09.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afd05b700 1 --2- 172.21.15.84:0/3812598976 >> v2:172.21.15.142:3300/0 conn(0x7f0af80a9b30 0x7f0af80abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:09.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afeabe700 1 --2- 172.21.15.84:0/3812598976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0af80a4250 0x7f0af8066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0af0002f30 tx=0x7f0af000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afeabe700 1 --2- 172.21.15.84:0/3812598976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0af80a4250 0x7f0af8066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0af0002f30 tx=0x7f0af000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afeabe700 1 --2- 172.21.15.84:0/3812598976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0af80a4250 0x7f0af8066880 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f0af0002f30 tx=0x7f0af000fdf0).ready entity=mon.2 client_cookie=189891ea2ec5882b server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:09.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afeabe700 1 --2- 172.21.15.84:0/3812598976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0af80a4250 0x7f0af8066880 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f0af0002f30 tx=0x7f0af000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0af7fff700 1 -- 172.21.15.84:0/3812598976 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0af0011620 con 0x7f0af80a4250 2020-01-16T05:44:09.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afeabe700 1 --2- 172.21.15.84:0/3812598976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0af80a4250 0x7f0af8066880 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f0af0002f30 tx=0x7f0af000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0af7fff700 1 -- 172.21.15.84:0/3812598976 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af0008c50 con 0x7f0af80a4250 2020-01-16T05:44:09.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afeabe700 1 --2- 172.21.15.84:0/3812598976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0af80a4250 0x7f0af8066880 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f0af0002f30 tx=0x7f0af000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afd85c700 1 -- 172.21.15.84:0/3812598976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0af80a4250 msgr2=0x7f0af8066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0af7fff700 1 -- 172.21.15.84:0/3812598976 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0af0011c00 con 0x7f0af80a4250 2020-01-16T05:44:09.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afd85c700 1 --2- 172.21.15.84:0/3812598976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0af80a4250 0x7f0af8066880 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f0af0002f30 tx=0x7f0af000fdf0).stop 2020-01-16T05:44:09.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afd85c700 1 -- 172.21.15.84:0/3812598976 shutdown_connections 2020-01-16T05:44:09.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afd85c700 1 --2- 172.21.15.84:0/3812598976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0af80a4250 0x7f0af8066880 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afd85c700 1 --2- 172.21.15.84:0/3812598976 >> v2:172.21.15.142:3300/0 conn(0x7f0af80a9b30 0x7f0af80abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:09.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afd85c700 1 -- 172.21.15.84:0/3812598976 shutdown_connections 2020-01-16T05:44:09.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afd85c700 1 -- 172.21.15.84:0/3812598976 wait complete. 2020-01-16T05:44:09.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.859+0000 7f0afd85c700 1 -- 172.21.15.84:0/3812598976 >> 172.21.15.84:0/3812598976 conn(0x7f0af80acfc0 msgr2=0x7f0af80a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:09.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.863+0000 7f0afd85c700 1 Processor -- start 2020-01-16T05:44:09.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.863+0000 7f0afd85c700 1 -- start start 2020-01-16T05:44:09.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.863+0000 7f0afd85c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0af8138910 0x7f0af8140570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.863+0000 7f0afd85c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af807e2c0 con 0x7f0af8065810 2020-01-16T05:44:09.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.863+0000 7f0afd85c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af8024ee0 con 0x7f0af80a9b30 2020-01-16T05:44:09.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.863+0000 7f0afd85c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af80a5600 con 0x7f0af8138910 2020-01-16T05:44:09.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.863+0000 7f0afc85a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0af8065810 0x7f0af8138110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51490/0 (socket says 172.21.15.84:51490) 2020-01-16T05:44:09.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.863+0000 7f0afc85a700 1 -- 172.21.15.84:0/750062812 learned_addr learned my addr 172.21.15.84:0/750062812 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:09.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.863+0000 7f0afeabe700 1 --2- 172.21.15.84:0/750062812 >> v2:172.21.15.84:3300/0 conn(0x7f0af8138910 0x7f0af8140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.863+0000 7f0af5ffb700 1 -- 172.21.15.84:0/750062812 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287033368 0 0) 0x7f0af807e2c0 con 0x7f0af8065810 2020-01-16T05:44:09.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.863+0000 7f0af5ffb700 1 -- 172.21.15.84:0/750062812 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ad8003230 con 0x7f0af8065810 2020-01-16T05:44:09.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.863+0000 7f0afeabe700 1 -- 172.21.15.84:0/750062812 >> v1:172.21.15.142:6789/0 conn(0x7f0af80a9b30 legacy=0x7f0af809f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.863+0000 7f0af5ffb700 1 -- 172.21.15.84:0/750062812 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135047526 0 0) 0x7f0af8024ee0 con 0x7f0af80a9b30 2020-01-16T05:44:09.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.863+0000 7f0afeabe700 1 -- 172.21.15.84:0/750062812 >> v1:172.21.15.84:6789/0 conn(0x7f0af8065810 legacy=0x7f0af8138110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.863+0000 7f0afeabe700 1 -- 172.21.15.84:0/750062812 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af809fbd0 con 0x7f0af8138910 2020-01-16T05:44:09.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.863+0000 7f0afeabe700 1 --2- 172.21.15.84:0/750062812 >> v2:172.21.15.84:3300/0 conn(0x7f0af8138910 0x7f0af8140570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0af0002f30 tx=0x7f0af0008e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.863+0000 7f0afeabe700 1 --2- 172.21.15.84:0/750062812 >> v2:172.21.15.84:3300/0 conn(0x7f0af8138910 0x7f0af8140570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0af0002f30 tx=0x7f0af0008e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.863+0000 7f0afeabe700 1 --2- 172.21.15.84:0/750062812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af8138910 0x7f0af8140570 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f0af0002f30 tx=0x7f0af0008e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:09.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.867+0000 7f0afeabe700 1 --2- 172.21.15.84:0/750062812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af8138910 0x7f0af8140570 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f0af0002f30 tx=0x7f0af0008e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.867+0000 7f0af5ffb700 1 -- 172.21.15.84:0/750062812 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0af0007340 con 0x7f0af8138910 2020-01-16T05:44:09.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.867+0000 7f0afeabe700 1 --2- 172.21.15.84:0/750062812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af8138910 0x7f0af8140570 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f0af0002f30 tx=0x7f0af0008e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.867+0000 7f0afeabe700 1 --2- 172.21.15.84:0/750062812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af8138910 0x7f0af8140570 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f0af0002f30 tx=0x7f0af0008e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.867+0000 7f0af5ffb700 1 -- 172.21.15.84:0/750062812 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af0011820 con 0x7f0af8138910 2020-01-16T05:44:09.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.867+0000 7f0afd85c700 1 -- 172.21.15.84:0/750062812 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af80a6020 con 0x7f0af8138910 2020-01-16T05:44:09.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.867+0000 7f0af5ffb700 1 -- 172.21.15.84:0/750062812 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0af000f550 con 0x7f0af8138910 2020-01-16T05:44:09.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.867+0000 7f0afd85c700 1 -- 172.21.15.84:0/750062812 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af8140ac0 con 0x7f0af8138910 2020-01-16T05:44:09.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.867+0000 7f0afeabe700 1 --2- 172.21.15.84:0/750062812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af8138910 0x7f0af8140570 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f0af0002f30 tx=0x7f0af0008e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.867+0000 7f0af5ffb700 1 -- 172.21.15.84:0/750062812 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f0af00056c0 con 0x7f0af8138910 2020-01-16T05:44:09.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.867+0000 7f0afeabe700 1 --2- 172.21.15.84:0/750062812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af8138910 0x7f0af8140570 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f0af0002f30 tx=0x7f0af0008e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.867+0000 7f0afd85c700 1 -- 172.21.15.84:0/750062812 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af805e1c0 con 0x7f0af8138910 2020-01-16T05:44:09.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.867+0000 7f0af5ffb700 1 --2- 172.21.15.84:0/750062812 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0ad803c7d0 0x7f0ad803ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:09.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.867+0000 7f0af5ffb700 1 -- 172.21.15.84:0/750062812 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f0af00909b0 con 0x7f0af8138910 2020-01-16T05:44:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.867+0000 7f0afd05b700 1 --2- 172.21.15.84:0/750062812 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0ad803c7d0 0x7f0ad803ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.867+0000 7f0afd05b700 1 --2- 172.21.15.84:0/750062812 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0ad803c7d0 0x7f0ad803ece0 crc :-1 s=READY pgs=63 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.875+0000 7f0afeabe700 1 --2- 172.21.15.84:0/750062812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af8138910 0x7f0af8140570 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f0af0002f30 tx=0x7f0af0008e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.875+0000 7f0af5ffb700 1 -- 172.21.15.84:0/750062812 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f0af0076fd0 con 0x7f0af8138910 2020-01-16T05:44:09.994 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.991+0000 7f0afd85c700 1 -- 172.21.15.84:0/750062812 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0af80a9170 con 0x7f0af8138910 2020-01-16T05:44:09.995 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.995+0000 7f0afeabe700 1 --2- 172.21.15.84:0/750062812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af8138910 0x7f0af8140570 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f0af0002f30 tx=0x7f0af0008e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:09.995 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.995+0000 7f0af5ffb700 1 -- 172.21.15.84:0/750062812 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0af00080d0 con 0x7f0af8138910 2020-01-16T05:44:09.995 INFO:teuthology.orchestra.run.smithi084.stdout:60129542148 2020-01-16T05:44:09.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.995+0000 7f0afd85c700 1 -- 172.21.15.84:0/750062812 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0ad803c7d0 msgr2=0x7f0ad803ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.995+0000 7f0afd85c700 1 --2- 172.21.15.84:0/750062812 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0ad803c7d0 0x7f0ad803ece0 crc :-1 s=READY pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.995+0000 7f0afd85c700 1 -- 172.21.15.84:0/750062812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af8138910 msgr2=0x7f0af8140570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:09.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.995+0000 7f0afd85c700 1 --2- 172.21.15.84:0/750062812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af8138910 0x7f0af8140570 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f0af0002f30 tx=0x7f0af0008e80).stop 2020-01-16T05:44:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.995+0000 7f0afd85c700 1 -- 172.21.15.84:0/750062812 shutdown_connections 2020-01-16T05:44:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.995+0000 7f0afd85c700 1 --2- 172.21.15.84:0/750062812 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0ad803c7d0 0x7f0ad803ece0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.995+0000 7f0afd85c700 1 --2- 172.21.15.84:0/750062812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af8138910 0x7f0af8140570 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.995+0000 7f0afd85c700 1 -- 172.21.15.84:0/750062812 shutdown_connections 2020-01-16T05:44:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.995+0000 7f0afd85c700 1 -- 172.21.15.84:0/750062812 wait complete. 2020-01-16T05:44:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:09.995+0000 7f0afd85c700 1 -- 172.21.15.84:0/750062812 >> 172.21.15.84:0/750062812 conn(0x7f0af8066c20 msgr2=0x7f0af80246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:10.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2020-01-16T05:44:10.008 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2020-01-16T05:44:10.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f8343e2d700 1 Processor -- start 2020-01-16T05:44:10.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f8343e2d700 1 -- start start 2020-01-16T05:44:10.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f8343e2d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f833c0a2f60 0x7f833c05b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:10.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f8343e2d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f833c0a8ff0 0x7f833c08fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:10.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f8343e2d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833c0902d0 con 0x7f833c07c560 2020-01-16T05:44:10.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f8343e2d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f833c0a3390 con 0x7f833c0a2f60 2020-01-16T05:44:10.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f8343e2d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f833c0905b0 con 0x7f833c0a8ff0 2020-01-16T05:44:10.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f83423ca700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f833c0a2f60 0x7f833c05b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:10.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f83423ca700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f833c0a2f60 0x7f833c05b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34296/0 (socket says 172.21.15.84:34296) 2020-01-16T05:44:10.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f83423ca700 1 -- 172.21.15.84:0/1580597959 learned_addr learned my addr 172.21.15.84:0/1580597959 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:10.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f8341bc9700 1 --2- 172.21.15.84:0/1580597959 >> v2:172.21.15.142:3300/0 conn(0x7f833c0a8ff0 0x7f833c08fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:10.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f83423ca700 1 -- 172.21.15.84:0/1580597959 >> v2:172.21.15.142:3300/0 conn(0x7f833c0a8ff0 msgr2=0x7f833c08fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:10.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f83423ca700 1 --2- 172.21.15.84:0/1580597959 >> v2:172.21.15.142:3300/0 conn(0x7f833c0a8ff0 0x7f833c08fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:10.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f83423ca700 1 -- 172.21.15.84:0/1580597959 >> v1:172.21.15.142:6789/0 conn(0x7f833c07c560 legacy=0x7f833c149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:10.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f83423ca700 1 -- 172.21.15.84:0/1580597959 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c0a9420 con 0x7f833c0a2f60 2020-01-16T05:44:10.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f83423ca700 1 --2- 172.21.15.84:0/1580597959 >> v2:172.21.15.84:3300/0 conn(0x7f833c0a2f60 0x7f833c05b0f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f833c090770 tx=0x7f8338010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f83423ca700 1 --2- 172.21.15.84:0/1580597959 >> v2:172.21.15.84:3300/0 conn(0x7f833c0a2f60 0x7f833c05b0f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f833c090770 tx=0x7f8338010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f83423ca700 1 --2- 172.21.15.84:0/1580597959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f833c0a2f60 0x7f833c05b0f0 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7f833c090770 tx=0x7f8338010230).ready entity=mon.0 client_cookie=14e5ce14a2e26683 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f83423ca700 1 --2- 172.21.15.84:0/1580597959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f833c0a2f60 0x7f833c05b0f0 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f833c090770 tx=0x7f8338010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f83413c8700 1 -- 172.21.15.84:0/1580597959 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f833800a160 con 0x7f833c0a2f60 2020-01-16T05:44:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f83423ca700 1 --2- 172.21.15.84:0/1580597959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f833c0a2f60 0x7f833c05b0f0 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f833c090770 tx=0x7f8338010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f83423ca700 1 --2- 172.21.15.84:0/1580597959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f833c0a2f60 0x7f833c05b0f0 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f833c090770 tx=0x7f8338010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f83413c8700 1 -- 172.21.15.84:0/1580597959 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8338011b70 con 0x7f833c0a2f60 2020-01-16T05:44:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f83413c8700 1 -- 172.21.15.84:0/1580597959 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f833800a740 con 0x7f833c0a2f60 2020-01-16T05:44:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f8343e2d700 1 -- 172.21.15.84:0/1580597959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f833c0a2f60 msgr2=0x7f833c05b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f8343e2d700 1 --2- 172.21.15.84:0/1580597959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f833c0a2f60 0x7f833c05b0f0 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7f833c090770 tx=0x7f8338010230).stop 2020-01-16T05:44:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f8343e2d700 1 -- 172.21.15.84:0/1580597959 shutdown_connections 2020-01-16T05:44:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f8343e2d700 1 --2- 172.21.15.84:0/1580597959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f833c0a2f60 0x7f833c05b0f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f8343e2d700 1 --2- 172.21.15.84:0/1580597959 >> v2:172.21.15.142:3300/0 conn(0x7f833c0a8ff0 0x7f833c08fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f8343e2d700 1 -- 172.21.15.84:0/1580597959 shutdown_connections 2020-01-16T05:44:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f8343e2d700 1 -- 172.21.15.84:0/1580597959 wait complete. 2020-01-16T05:44:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.115+0000 7f8343e2d700 1 -- 172.21.15.84:0/1580597959 >> 172.21.15.84:0/1580597959 conn(0x7f833c0abc10 msgr2=0x7f833c05a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:10.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8343e2d700 1 Processor -- start 2020-01-16T05:44:10.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8343e2d700 1 -- start start 2020-01-16T05:44:10.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8343e2d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f833c09dd80 0x7f833c129b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:10.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8343e2d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f833c0a1590 0x7f833c0a6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:10.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8343e2d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833c098ad0 con 0x7f833c0a40d0 2020-01-16T05:44:10.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8343e2d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f833c0a38f0 con 0x7f833c0a1590 2020-01-16T05:44:10.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8343e2d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f833c0a3b90 con 0x7f833c09dd80 2020-01-16T05:44:10.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8342bcb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f833c0a1590 0x7f833c0a6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:10.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8342bcb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f833c0a1590 0x7f833c0a6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34306/0 (socket says 172.21.15.84:34306) 2020-01-16T05:44:10.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8342bcb700 1 -- 172.21.15.84:0/3349637007 learned_addr learned my addr 172.21.15.84:0/3349637007 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:10.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f83423ca700 1 --2- 172.21.15.84:0/3349637007 >> v2:172.21.15.142:3300/0 conn(0x7f833c09dd80 0x7f833c129b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:10.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8342bcb700 1 -- 172.21.15.84:0/3349637007 >> v2:172.21.15.142:3300/0 conn(0x7f833c09dd80 msgr2=0x7f833c129b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:10.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8342bcb700 1 --2- 172.21.15.84:0/3349637007 >> v2:172.21.15.142:3300/0 conn(0x7f833c09dd80 0x7f833c129b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:10.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8342bcb700 1 -- 172.21.15.84:0/3349637007 >> v1:172.21.15.142:6789/0 conn(0x7f833c0a40d0 legacy=0x7f833c0a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:10.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8342bcb700 1 -- 172.21.15.84:0/3349637007 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c0a7090 con 0x7f833c0a1590 2020-01-16T05:44:10.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8342bcb700 1 --2- 172.21.15.84:0/3349637007 >> v2:172.21.15.84:3300/0 conn(0x7f833c0a1590 0x7f833c0a6b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8334002ef0 tx=0x7f8334010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:10.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8342bcb700 1 --2- 172.21.15.84:0/3349637007 >> v2:172.21.15.84:3300/0 conn(0x7f833c0a1590 0x7f833c0a6b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8334002ef0 tx=0x7f8334010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:10.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8342bcb700 1 --2- 172.21.15.84:0/3349637007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f833c0a1590 0x7f833c0a6b40 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f8334002ef0 tx=0x7f8334010950).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:10.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8342bcb700 1 --2- 172.21.15.84:0/3349637007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f833c0a1590 0x7f833c0a6b40 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8334002ef0 tx=0x7f8334010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:10.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8342bcb700 1 --2- 172.21.15.84:0/3349637007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f833c0a1590 0x7f833c0a6b40 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8334002ef0 tx=0x7f8334010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:10.131 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8332ffd700 1 -- 172.21.15.84:0/3349637007 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8334008c00 con 0x7f833c0a1590 2020-01-16T05:44:10.131 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8342bcb700 1 --2- 172.21.15.84:0/3349637007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f833c0a1590 0x7f833c0a6b40 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8334002ef0 tx=0x7f8334010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:10.131 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8332ffd700 1 -- 172.21.15.84:0/3349637007 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8334008820 con 0x7f833c0a1590 2020-01-16T05:44:10.131 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8343e2d700 1 -- 172.21.15.84:0/3349637007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833c0a4500 con 0x7f833c0a1590 2020-01-16T05:44:10.131 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.119+0000 7f8332ffd700 1 -- 172.21.15.84:0/3349637007 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8334008e00 con 0x7f833c0a1590 2020-01-16T05:44:10.131 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.123+0000 7f8343e2d700 1 -- 172.21.15.84:0/3349637007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833c0a19c0 con 0x7f833c0a1590 2020-01-16T05:44:10.131 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.123+0000 7f8342bcb700 1 --2- 172.21.15.84:0/3349637007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f833c0a1590 0x7f833c0a6b40 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8334002ef0 tx=0x7f8334010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:10.131 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.123+0000 7f8343e2d700 1 -- 172.21.15.84:0/3349637007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833c05e1c0 con 0x7f833c0a1590 2020-01-16T05:44:10.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.123+0000 7f8332ffd700 1 -- 172.21.15.84:0/3349637007 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f8334012610 con 0x7f833c0a1590 2020-01-16T05:44:10.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.123+0000 7f8342bcb700 1 --2- 172.21.15.84:0/3349637007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f833c0a1590 0x7f833c0a6b40 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8334002ef0 tx=0x7f8334010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:10.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.123+0000 7f8332ffd700 1 --2- 172.21.15.84:0/3349637007 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f832403c2a0 0x7f832403e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:10.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.123+0000 7f8332ffd700 1 -- 172.21.15.84:0/3349637007 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f833404c540 con 0x7f833c0a1590 2020-01-16T05:44:10.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.123+0000 7f83423ca700 1 --2- 172.21.15.84:0/3349637007 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f832403c2a0 0x7f832403e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:10.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.123+0000 7f83423ca700 1 --2- 172.21.15.84:0/3349637007 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f832403c2a0 0x7f832403e7b0 crc :-1 s=READY pgs=64 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:10.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.131+0000 7f8342bcb700 1 --2- 172.21.15.84:0/3349637007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f833c0a1590 0x7f833c0a6b40 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8334002ef0 tx=0x7f8334010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:10.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.131+0000 7f8332ffd700 1 -- 172.21.15.84:0/3349637007 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f8334032b60 con 0x7f833c0a1590 2020-01-16T05:44:10.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.247+0000 7f8343e2d700 1 -- 172.21.15.84:0/3349637007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f833c08f350 con 0x7f833c0a1590 2020-01-16T05:44:10.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.247+0000 7f8342bcb700 1 --2- 172.21.15.84:0/3349637007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f833c0a1590 0x7f833c0a6b40 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8334002ef0 tx=0x7f8334010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:10.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.247+0000 7f8332ffd700 1 -- 172.21.15.84:0/3349637007 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8334032dc0 con 0x7f833c0a1590 2020-01-16T05:44:10.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.251+0000 7f8343e2d700 1 -- 172.21.15.84:0/3349637007 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f832403c2a0 msgr2=0x7f832403e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:10.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.251+0000 7f8343e2d700 1 --2- 172.21.15.84:0/3349637007 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f832403c2a0 0x7f832403e7b0 crc :-1 s=READY pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:10.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.251+0000 7f8343e2d700 1 -- 172.21.15.84:0/3349637007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f833c0a1590 msgr2=0x7f833c0a6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:10.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.251+0000 7f8343e2d700 1 --2- 172.21.15.84:0/3349637007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f833c0a1590 0x7f833c0a6b40 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f8334002ef0 tx=0x7f8334010950).stop 2020-01-16T05:44:10.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.251+0000 7f8343e2d700 1 -- 172.21.15.84:0/3349637007 shutdown_connections 2020-01-16T05:44:10.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.251+0000 7f8343e2d700 1 --2- 172.21.15.84:0/3349637007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f833c0a1590 0x7f833c0a6b40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:10.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.251+0000 7f8343e2d700 1 --2- 172.21.15.84:0/3349637007 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f832403c2a0 0x7f832403e7b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:10.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.251+0000 7f8343e2d700 1 --2- 172.21.15.84:0/3349637007 >> v2:172.21.15.142:3300/0 conn(0x7f833c09dd80 0x7f833c129b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:10.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.251+0000 7f8343e2d700 1 -- 172.21.15.84:0/3349637007 shutdown_connections 2020-01-16T05:44:10.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.251+0000 7f8343e2d700 1 -- 172.21.15.84:0/3349637007 wait complete. 2020-01-16T05:44:10.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:10.251+0000 7f8343e2d700 1 -- 172.21.15.84:0/3349637007 >> 172.21.15.84:0/3349637007 conn(0x7f833c0a86a0 msgr2=0x7f833c0789e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:10.257 INFO:teuthology.orchestra.run.smithi084.stdout:60129542147 2020-01-16T05:44:10.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.2 2020-01-16T05:44:11.264 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2020-01-16T05:44:11.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.379+0000 7f6f6c928700 1 Processor -- start 2020-01-16T05:44:11.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6c928700 1 -- start start 2020-01-16T05:44:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6c928700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f680a9b30 0x7f6f680abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6c928700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f6807ff10 0x7f6f68066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6c928700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6f680a4250 0x7f6f680a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6c928700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f680a4830 con 0x7f6f680a4250 2020-01-16T05:44:11.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6c928700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6807f9d0 con 0x7f6f6807ff10 2020-01-16T05:44:11.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6c928700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6807fc70 con 0x7f6f680a9b30 2020-01-16T05:44:11.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6db8a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6f680a4250 0x7f6f680a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:11.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f67fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f680a9b30 0x7f6f680abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:11.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6db8a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6f680a4250 0x7f6f680a4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34318/0 (socket says 172.21.15.84:34318) 2020-01-16T05:44:11.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6db8a700 1 -- 172.21.15.84:0/1716411245 learned_addr learned my addr 172.21.15.84:0/1716411245 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:11.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f677fe700 1 --2- 172.21.15.84:0/1716411245 >> v2:172.21.15.142:3300/0 conn(0x7f6f6807ff10 0x7f6f68066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:11.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6db8a700 1 -- 172.21.15.84:0/1716411245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f680a9b30 msgr2=0x7f6f680abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:11.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/1716411245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f680a9b30 0x7f6f680abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:11.396 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6db8a700 1 -- 172.21.15.84:0/1716411245 >> v2:172.21.15.142:3300/0 conn(0x7f6f6807ff10 msgr2=0x7f6f68066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:11.396 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/1716411245 >> v2:172.21.15.142:3300/0 conn(0x7f6f6807ff10 0x7f6f68066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:11.396 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6db8a700 1 -- 172.21.15.84:0/1716411245 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f68066dd0 con 0x7f6f680a4250 2020-01-16T05:44:11.396 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f67fff700 1 --2- 172.21.15.84:0/1716411245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f680a9b30 0x7f6f680abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/1716411245 >> v2:172.21.15.84:3300/0 conn(0x7f6f680a4250 0x7f6f680a4ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6f680a49f0 tx=0x7f6f600102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/1716411245 >> v2:172.21.15.84:3300/0 conn(0x7f6f680a4250 0x7f6f680a4ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6f680a49f0 tx=0x7f6f600102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/1716411245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f680a4250 0x7f6f680a4ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f6f680a49f0 tx=0x7f6f600102b0).ready entity=mon.0 client_cookie=ce8ebc24bf8c746a server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/1716411245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f680a4250 0x7f6f680a4ad0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f6f680a49f0 tx=0x7f6f600102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f66ffd700 1 -- 172.21.15.84:0/1716411245 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6000a160 con 0x7f6f680a4250 2020-01-16T05:44:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/1716411245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f680a4250 0x7f6f680a4ad0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f6f680a49f0 tx=0x7f6f600102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/1716411245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f680a4250 0x7f6f680a4ad0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f6f680a49f0 tx=0x7f6f600102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f66ffd700 1 -- 172.21.15.84:0/1716411245 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f60011bf0 con 0x7f6f680a4250 2020-01-16T05:44:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f66ffd700 1 -- 172.21.15.84:0/1716411245 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6000a740 con 0x7f6f680a4250 2020-01-16T05:44:11.399 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6c928700 1 -- 172.21.15.84:0/1716411245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f680a4250 msgr2=0x7f6f680a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.399 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6c928700 1 --2- 172.21.15.84:0/1716411245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f680a4250 0x7f6f680a4ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f6f680a49f0 tx=0x7f6f600102b0).stop 2020-01-16T05:44:11.399 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6c928700 1 -- 172.21.15.84:0/1716411245 shutdown_connections 2020-01-16T05:44:11.399 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6c928700 1 --2- 172.21.15.84:0/1716411245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f680a4250 0x7f6f680a4ad0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:11.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6c928700 1 --2- 172.21.15.84:0/1716411245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f680a9b30 0x7f6f680abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:11.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6c928700 1 --2- 172.21.15.84:0/1716411245 >> v2:172.21.15.142:3300/0 conn(0x7f6f6807ff10 0x7f6f68066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:11.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.383+0000 7f6f6c928700 1 -- 172.21.15.84:0/1716411245 shutdown_connections 2020-01-16T05:44:11.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.387+0000 7f6f6c928700 1 -- 172.21.15.84:0/1716411245 wait complete. 2020-01-16T05:44:11.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.387+0000 7f6f6c928700 1 -- 172.21.15.84:0/1716411245 >> 172.21.15.84:0/1716411245 conn(0x7f6f680acfc0 msgr2=0x7f6f680a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:11.401 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.387+0000 7f6f6c928700 1 Processor -- start 2020-01-16T05:44:11.401 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.387+0000 7f6f6c928700 1 -- start start 2020-01-16T05:44:11.401 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.387+0000 7f6f6c928700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f68135330 0x7f6f68126470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:11.401 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.387+0000 7f6f6c928700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f68125240 0x7f6f6813f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:11.402 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.387+0000 7f6f6c928700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f68124a30 con 0x7f6f6809f890 2020-01-16T05:44:11.402 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.387+0000 7f6f6c928700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f68065580 con 0x7f6f68125240 2020-01-16T05:44:11.402 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.387+0000 7f6f6c928700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68065820 con 0x7f6f68135330 2020-01-16T05:44:11.402 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.387+0000 7f6f67fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6f6809f890 0x7f6f68134b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51520/0 (socket says 172.21.15.84:51520) 2020-01-16T05:44:11.402 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.387+0000 7f6f67fff700 1 -- 172.21.15.84:0/3238761531 learned_addr learned my addr 172.21.15.84:0/3238761531 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:11.403 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.387+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/3238761531 >> v2:172.21.15.142:3300/0 conn(0x7f6f68125240 0x7f6f6813f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:11.403 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.387+0000 7f6f677fe700 1 --2- 172.21.15.84:0/3238761531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f68135330 0x7f6f68126470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:11.403 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.387+0000 7f6f64ff9700 1 -- 172.21.15.84:0/3238761531 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470942348 0 0) 0x7f6f68124a30 con 0x7f6f6809f890 2020-01-16T05:44:11.403 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.387+0000 7f6f64ff9700 1 -- 172.21.15.84:0/3238761531 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f48003230 con 0x7f6f6809f890 2020-01-16T05:44:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f6db8a700 1 -- 172.21.15.84:0/3238761531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f68135330 msgr2=0x7f6f68126470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/3238761531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f68135330 0x7f6f68126470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f6db8a700 1 -- 172.21.15.84:0/3238761531 >> v1:172.21.15.84:6789/0 conn(0x7f6f6809f890 legacy=0x7f6f68134b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f64ff9700 1 -- 172.21.15.84:0/3238761531 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1301153189 0 0) 0x7f6f48003230 con 0x7f6f6809f890 2020-01-16T05:44:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f6db8a700 1 -- 172.21.15.84:0/3238761531 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f680ab090 con 0x7f6f68125240 2020-01-16T05:44:11.405 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/3238761531 >> v2:172.21.15.142:3300/0 conn(0x7f6f68125240 0x7f6f6813f3c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f68065740 tx=0x7f6f60011bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.405 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/3238761531 >> v2:172.21.15.142:3300/0 conn(0x7f6f68125240 0x7f6f6813f3c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f68065740 tx=0x7f6f60011bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.405 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/3238761531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f68125240 0x7f6f6813f3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f6f68065740 tx=0x7f6f60011bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:11.405 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/3238761531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f68125240 0x7f6f6813f3c0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f6f68065740 tx=0x7f6f60011bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.406 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f64ff9700 1 -- 172.21.15.84:0/3238761531 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6000ac40 con 0x7f6f68125240 2020-01-16T05:44:11.406 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/3238761531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f68125240 0x7f6f6813f3c0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f6f68065740 tx=0x7f6f60011bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.406 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f6c928700 1 -- 172.21.15.84:0/3238761531 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f680661c0 con 0x7f6f68125240 2020-01-16T05:44:11.406 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/3238761531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f68125240 0x7f6f6813f3c0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f6f68065740 tx=0x7f6f60011bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.406 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f64ff9700 1 -- 172.21.15.84:0/3238761531 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6000a360 con 0x7f6f68125240 2020-01-16T05:44:11.407 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f64ff9700 1 -- 172.21.15.84:0/3238761531 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f60007150 con 0x7f6f68125240 2020-01-16T05:44:11.407 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f6c928700 1 -- 172.21.15.84:0/3238761531 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f68125670 con 0x7f6f68125240 2020-01-16T05:44:11.407 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/3238761531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f68125240 0x7f6f6813f3c0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f6f68065740 tx=0x7f6f60011bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.412 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f6c928700 1 -- 172.21.15.84:0/3238761531 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6805e1c0 con 0x7f6f68125240 2020-01-16T05:44:11.412 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f64ff9700 1 -- 172.21.15.84:0/3238761531 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f6f600073f0 con 0x7f6f68125240 2020-01-16T05:44:11.412 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/3238761531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f68125240 0x7f6f6813f3c0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f6f68065740 tx=0x7f6f60011bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.412 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f64ff9700 1 --2- 172.21.15.84:0/3238761531 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6f4803c750 0x7f6f4803ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:11.412 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f64ff9700 1 -- 172.21.15.84:0/3238761531 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f6f60091010 con 0x7f6f68125240 2020-01-16T05:44:11.413 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f67fff700 1 --2- 172.21.15.84:0/3238761531 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6f4803c750 0x7f6f4803ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:11.413 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.391+0000 7f6f67fff700 1 --2- 172.21.15.84:0/3238761531 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6f4803c750 0x7f6f4803ec60 crc :-1 s=READY pgs=65 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:11.413 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.399+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/3238761531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f68125240 0x7f6f6813f3c0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f6f68065740 tx=0x7f6f60011bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.413 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.399+0000 7f6f64ff9700 1 -- 172.21.15.84:0/3238761531 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f6f60077610 con 0x7f6f68125240 2020-01-16T05:44:11.522 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.519+0000 7f6f6c928700 1 -- 172.21.15.84:0/3238761531 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6f6809fcc0 con 0x7f6f68125240 2020-01-16T05:44:11.523 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.523+0000 7f6f6db8a700 1 --2- 172.21.15.84:0/3238761531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f68125240 0x7f6f6813f3c0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f6f68065740 tx=0x7f6f60011bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.523 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.523+0000 7f6f64ff9700 1 -- 172.21.15.84:0/3238761531 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f60077870 con 0x7f6f68125240 2020-01-16T05:44:11.523 INFO:teuthology.orchestra.run.smithi084.stdout:60129542148 2020-01-16T05:44:11.527 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.527+0000 7f6f6c928700 1 -- 172.21.15.84:0/3238761531 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6f4803c750 msgr2=0x7f6f4803ec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.527 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.527+0000 7f6f6c928700 1 --2- 172.21.15.84:0/3238761531 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6f4803c750 0x7f6f4803ec60 crc :-1 s=READY pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:11.529 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.527+0000 7f6f6c928700 1 -- 172.21.15.84:0/3238761531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f68125240 msgr2=0x7f6f6813f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.529 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.527+0000 7f6f6c928700 1 --2- 172.21.15.84:0/3238761531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f68125240 0x7f6f6813f3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f6f68065740 tx=0x7f6f60011bf0).stop 2020-01-16T05:44:11.530 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.527+0000 7f6f6c928700 1 -- 172.21.15.84:0/3238761531 shutdown_connections 2020-01-16T05:44:11.530 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.527+0000 7f6f6c928700 1 --2- 172.21.15.84:0/3238761531 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6f4803c750 0x7f6f4803ec60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:11.530 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.527+0000 7f6f6c928700 1 --2- 172.21.15.84:0/3238761531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f68125240 0x7f6f6813f3c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:11.530 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.527+0000 7f6f6c928700 1 --2- 172.21.15.84:0/3238761531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f68135330 0x7f6f68126470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:11.530 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.527+0000 7f6f6c928700 1 -- 172.21.15.84:0/3238761531 shutdown_connections 2020-01-16T05:44:11.530 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.527+0000 7f6f6c928700 1 -- 172.21.15.84:0/3238761531 wait complete. 2020-01-16T05:44:11.530 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.527+0000 7f6f6c928700 1 -- 172.21.15.84:0/3238761531 >> 172.21.15.84:0/3238761531 conn(0x7f6f6805ee80 msgr2=0x7f6f680246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:11.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.2 2020-01-16T05:44:11.543 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2020-01-16T05:44:11.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4ffff700 1 Processor -- start 2020-01-16T05:44:11.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4ffff700 1 -- start start 2020-01-16T05:44:11.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4f500a9b30 0x7f4f500abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:11.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4ffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f50066880 con 0x7f4f500a4250 2020-01-16T05:44:11.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4ffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f50066ab0 con 0x7f4f5007ff10 2020-01-16T05:44:11.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f500a4830 con 0x7f4f500a9b30 2020-01-16T05:44:11.657 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f558a4700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4f500a4250 0x7f4f5014fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51530/0 (socket says 172.21.15.84:51530) 2020-01-16T05:44:11.657 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f558a4700 1 -- 172.21.15.84:0/1495841696 learned_addr learned my addr 172.21.15.84:0/1495841696 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:11.658 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4f7fe700 1 --2- 172.21.15.84:0/1495841696 >> v2:172.21.15.142:3300/0 conn(0x7f4f500a9b30 0x7f4f500abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:11.658 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4e7fc700 1 -- 172.21.15.84:0/1495841696 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453123167 0 0) 0x7f4f50066880 con 0x7f4f500a4250 2020-01-16T05:44:11.658 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4e7fc700 1 -- 172.21.15.84:0/1495841696 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f3c003230 con 0x7f4f500a4250 2020-01-16T05:44:11.658 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4f7fe700 1 -- 172.21.15.84:0/1495841696 >> v1:172.21.15.142:6789/0 conn(0x7f4f5007ff10 legacy=0x7f4f500a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.658 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4f7fe700 1 -- 172.21.15.84:0/1495841696 >> v1:172.21.15.84:6789/0 conn(0x7f4f500a4250 legacy=0x7f4f5014fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4f7fe700 1 -- 172.21.15.84:0/1495841696 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f50066ce0 con 0x7f4f500a9b30 2020-01-16T05:44:11.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4f7fe700 1 --2- 172.21.15.84:0/1495841696 >> v2:172.21.15.142:3300/0 conn(0x7f4f500a9b30 0x7f4f500abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4f48008910 tx=0x7f4f4800fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4f7fe700 1 --2- 172.21.15.84:0/1495841696 >> v2:172.21.15.142:3300/0 conn(0x7f4f500a9b30 0x7f4f500abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4f48008910 tx=0x7f4f4800fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4f7fe700 1 --2- 172.21.15.84:0/1495841696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f500a9b30 0x7f4f500abdd0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f4f48008910 tx=0x7f4f4800fd70).ready entity=mon.1 client_cookie=88edddae4d34764b server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:11.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4f7fe700 1 --2- 172.21.15.84:0/1495841696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f500a9b30 0x7f4f500abdd0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f4f48008910 tx=0x7f4f4800fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4e7fc700 1 -- 172.21.15.84:0/1495841696 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f480115e0 con 0x7f4f500a9b30 2020-01-16T05:44:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4f7fe700 1 --2- 172.21.15.84:0/1495841696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f500a9b30 0x7f4f500abdd0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f4f48008910 tx=0x7f4f4800fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4e7fc700 1 -- 172.21.15.84:0/1495841696 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f48008d40 con 0x7f4f500a9b30 2020-01-16T05:44:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4f7fe700 1 --2- 172.21.15.84:0/1495841696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f500a9b30 0x7f4f500abdd0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f4f48008910 tx=0x7f4f4800fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4e7fc700 1 -- 172.21.15.84:0/1495841696 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f48011bc0 con 0x7f4f500a9b30 2020-01-16T05:44:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4ffff700 1 -- 172.21.15.84:0/1495841696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f500a9b30 msgr2=0x7f4f500abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.651+0000 7f4f4ffff700 1 --2- 172.21.15.84:0/1495841696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f500a9b30 0x7f4f500abdd0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f4f48008910 tx=0x7f4f4800fd70).stop 2020-01-16T05:44:11.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f4ffff700 1 -- 172.21.15.84:0/1495841696 shutdown_connections 2020-01-16T05:44:11.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f4ffff700 1 --2- 172.21.15.84:0/1495841696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f500a9b30 0x7f4f500abdd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:11.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f4ffff700 1 -- 172.21.15.84:0/1495841696 shutdown_connections 2020-01-16T05:44:11.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f4ffff700 1 -- 172.21.15.84:0/1495841696 wait complete. 2020-01-16T05:44:11.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f4ffff700 1 -- 172.21.15.84:0/1495841696 >> 172.21.15.84:0/1495841696 conn(0x7f4f500acfc0 msgr2=0x7f4f500a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:11.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f4ffff700 1 Processor -- start 2020-01-16T05:44:11.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f4ffff700 1 -- start start 2020-01-16T05:44:11.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f4ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4f5009f670 0x7f4f5013e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:11.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f4ffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f50062550 con 0x7f4f500a2910 2020-01-16T05:44:11.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f4ffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f500908b0 con 0x7f4f50062120 2020-01-16T05:44:11.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f4ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f500900d0 con 0x7f4f5009f670 2020-01-16T05:44:11.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f4f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4f500a2910 0x7f4f500911e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51534/0 (socket says 172.21.15.84:51534) 2020-01-16T05:44:11.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f4f7fe700 1 -- 172.21.15.84:0/317042257 learned_addr learned my addr 172.21.15.84:0/317042257 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:11.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f47fff700 1 -- 172.21.15.84:0/317042257 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085995466 0 0) 0x7f4f50062550 con 0x7f4f500a2910 2020-01-16T05:44:11.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f47fff700 1 -- 172.21.15.84:0/317042257 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f34003230 con 0x7f4f500a2910 2020-01-16T05:44:11.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f558a4700 1 --2- 172.21.15.84:0/317042257 >> v2:172.21.15.142:3300/0 conn(0x7f4f5009f670 0x7f4f5013e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:11.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f47fff700 1 -- 172.21.15.84:0/317042257 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1719906230 0 0) 0x7f4f34003230 con 0x7f4f500a2910 2020-01-16T05:44:11.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f47fff700 1 -- 172.21.15.84:0/317042257 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4f50062550 con 0x7f4f500a2910 2020-01-16T05:44:11.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f47fff700 1 -- 172.21.15.84:0/317042257 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f4f48008d40 con 0x7f4f500a2910 2020-01-16T05:44:11.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f47fff700 1 -- 172.21.15.84:0/317042257 >> v2:172.21.15.142:3300/0 conn(0x7f4f5009f670 msgr2=0x7f4f5013e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f47fff700 1 --2- 172.21.15.84:0/317042257 >> v2:172.21.15.142:3300/0 conn(0x7f4f5009f670 0x7f4f5013e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:11.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f47fff700 1 -- 172.21.15.84:0/317042257 >> v1:172.21.15.142:6789/0 conn(0x7f4f50062120 legacy=0x7f4f5009ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f47fff700 1 -- 172.21.15.84:0/317042257 >> v1:172.21.15.84:6789/0 conn(0x7f4f500a2910 legacy=0x7f4f500911e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f47fff700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f34003a20 0x7f4f34003e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:11.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f47fff700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f340045a0 0x7f4f340049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:11.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f47fff700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f34005010 0x7f4f3400b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:11.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f47fff700 1 -- 172.21.15.84:0/317042257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f500900d0 con 0x7f4f34005010 2020-01-16T05:44:11.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f47fff700 1 -- 172.21.15.84:0/317042257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3400bda0 con 0x7f4f340045a0 2020-01-16T05:44:11.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f47fff700 1 -- 172.21.15.84:0/317042257 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3400bfe0 con 0x7f4f34003a20 2020-01-16T05:44:11.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f558a4700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f34005010 0x7f4f3400b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:11.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f4effd700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f340045a0 0x7f4f340049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:11.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f4f7fe700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f34003a20 0x7f4f34003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:11.670 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f558a4700 1 -- 172.21.15.84:0/317042257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f34003a20 msgr2=0x7f4f34003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.670 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f558a4700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f34003a20 0x7f4f34003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:11.670 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f558a4700 1 -- 172.21.15.84:0/317042257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f340045a0 msgr2=0x7f4f340049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.670 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f558a4700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f340045a0 0x7f4f340049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:11.670 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f558a4700 1 -- 172.21.15.84:0/317042257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f500919e0 con 0x7f4f34005010 2020-01-16T05:44:11.671 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.655+0000 7f4f4ffff700 1 -- 172.21.15.84:0/317042257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f50090d60 con 0x7f4f34005010 2020-01-16T05:44:11.671 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f558a4700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f34005010 0x7f4f3400b7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4f400048a0 tx=0x7f4f40011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.671 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f4ffff700 1 -- 172.21.15.84:0/317042257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5009faa0 con 0x7f4f34005010 2020-01-16T05:44:11.671 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f558a4700 1 -- 172.21.15.84:0/317042257 reap_dead start 2020-01-16T05:44:11.672 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f558a4700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f34005010 0x7f4f3400b7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4f400048a0 tx=0x7f4f40011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.672 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f558a4700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f34005010 0x7f4f3400b7f0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f4f400048a0 tx=0x7f4f40011110).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:11.672 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f558a4700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f34005010 0x7f4f3400b7f0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f4f400048a0 tx=0x7f4f40011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.673 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f558a4700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f34005010 0x7f4f3400b7f0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f4f400048a0 tx=0x7f4f40011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.673 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f558a4700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f34005010 0x7f4f3400b7f0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f4f400048a0 tx=0x7f4f40011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.673 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f47fff700 1 -- 172.21.15.84:0/317042257 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f40004b20 con 0x7f4f34005010 2020-01-16T05:44:11.673 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f47fff700 1 -- 172.21.15.84:0/317042257 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4000ccb0 con 0x7f4f34005010 2020-01-16T05:44:11.673 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f47fff700 1 -- 172.21.15.84:0/317042257 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f40006370 con 0x7f4f34005010 2020-01-16T05:44:11.673 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f558a4700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f34005010 0x7f4f3400b7f0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f4f400048a0 tx=0x7f4f40011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f4ffff700 1 -- 172.21.15.84:0/317042257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f28003360 con 0x7f4f34005010 2020-01-16T05:44:11.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f47fff700 1 -- 172.21.15.84:0/317042257 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f4f40006570 con 0x7f4f34005010 2020-01-16T05:44:11.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f558a4700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f34005010 0x7f4f3400b7f0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f4f400048a0 tx=0x7f4f40011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f47fff700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4f3403fe40 0x7f4f34042350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:11.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f47fff700 1 -- 172.21.15.84:0/317042257 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f4f4004c670 con 0x7f4f34005010 2020-01-16T05:44:11.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f4f7fe700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4f3403fe40 0x7f4f34042350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:11.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.659+0000 7f4f4f7fe700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4f3403fe40 0x7f4f34042350 crc :-1 s=READY pgs=67 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:11.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.667+0000 7f4f558a4700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f34005010 0x7f4f3400b7f0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f4f400048a0 tx=0x7f4f40011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.667+0000 7f4f47fff700 1 -- 172.21.15.84:0/317042257 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f4f40006dd0 con 0x7f4f34005010 2020-01-16T05:44:11.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.779+0000 7f4f4ffff700 1 -- 172.21.15.84:0/317042257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4f280021f0 con 0x7f4f34005010 2020-01-16T05:44:11.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.779+0000 7f4f558a4700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f34005010 0x7f4f3400b7f0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f4f400048a0 tx=0x7f4f40011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.779+0000 7f4f47fff700 1 -- 172.21.15.84:0/317042257 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f400019b0 con 0x7f4f34005010 2020-01-16T05:44:11.781 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2020-01-16T05:44:11.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.779+0000 7f4f4ffff700 1 -- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4f3403fe40 msgr2=0x7f4f34042350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.779+0000 7f4f4ffff700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4f3403fe40 0x7f4f34042350 crc :-1 s=READY pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:11.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.779+0000 7f4f4ffff700 1 -- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f34005010 msgr2=0x7f4f3400b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.779+0000 7f4f4ffff700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f34005010 0x7f4f3400b7f0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f4f400048a0 tx=0x7f4f40011110).stop 2020-01-16T05:44:11.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.779+0000 7f4f4ffff700 1 -- 172.21.15.84:0/317042257 shutdown_connections 2020-01-16T05:44:11.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.779+0000 7f4f4ffff700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4f3403fe40 0x7f4f34042350 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:11.788 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.779+0000 7f4f4ffff700 1 --2- 172.21.15.84:0/317042257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f34005010 0x7f4f3400b7f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:11.788 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.779+0000 7f4f4ffff700 1 -- 172.21.15.84:0/317042257 shutdown_connections 2020-01-16T05:44:11.788 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.779+0000 7f4f4ffff700 1 -- 172.21.15.84:0/317042257 wait complete. 2020-01-16T05:44:11.789 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.779+0000 7f4f4ffff700 1 -- 172.21.15.84:0/317042257 >> 172.21.15.84:0/317042257 conn(0x7f4f5005f370 msgr2=0x7f4f500246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:11.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.3 2020-01-16T05:44:11.793 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2020-01-16T05:44:11.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.903+0000 7f71ad22a700 1 Processor -- start 2020-01-16T05:44:11.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.903+0000 7f71ad22a700 1 -- start start 2020-01-16T05:44:11.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.903+0000 7f71ad22a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a80a2f60 0x7f71a805b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:11.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.903+0000 7f71ad22a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f71a80a8ff0 0x7f71a808fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:11.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.903+0000 7f71ad22a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a80902d0 con 0x7f71a807c560 2020-01-16T05:44:11.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71ad22a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a80a3390 con 0x7f71a80a8ff0 2020-01-16T05:44:11.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71ad22a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a80905b0 con 0x7f71a80a2f60 2020-01-16T05:44:11.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71a759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a80a2f60 0x7f71a805b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:11.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71a6d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f71a80a8ff0 0x7f71a808fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:11.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71a759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a80a2f60 0x7f71a805b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:46596/0 (socket says 172.21.15.84:46596) 2020-01-16T05:44:11.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71a759e700 1 -- 172.21.15.84:0/1299305698 learned_addr learned my addr 172.21.15.84:0/1299305698 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:11.922 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71a759e700 1 -- 172.21.15.84:0/1299305698 >> v2:172.21.15.142:3300/0 conn(0x7f71a80a8ff0 msgr2=0x7f71a808fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:11.922 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71a759e700 1 --2- 172.21.15.84:0/1299305698 >> v2:172.21.15.142:3300/0 conn(0x7f71a80a8ff0 0x7f71a808fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:11.922 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71a759e700 1 -- 172.21.15.84:0/1299305698 >> v1:172.21.15.142:6789/0 conn(0x7f71a807c560 legacy=0x7f71a8149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.922 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71a759e700 1 -- 172.21.15.84:0/1299305698 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a80a9420 con 0x7f71a80a2f60 2020-01-16T05:44:11.923 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71a6d9d700 1 --2- 172.21.15.84:0/1299305698 >> v2:172.21.15.142:3300/0 conn(0x7f71a80a8ff0 0x7f71a808fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:11.923 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71a759e700 1 --2- 172.21.15.84:0/1299305698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a80a2f60 0x7f71a805b0f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f71a0008c90 tx=0x7f71a0010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.923 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71a759e700 1 --2- 172.21.15.84:0/1299305698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a80a2f60 0x7f71a805b0f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f71a0008c90 tx=0x7f71a0010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.923 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71a759e700 1 --2- 172.21.15.84:0/1299305698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a80a2f60 0x7f71a805b0f0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f71a0008c90 tx=0x7f71a0010230).ready entity=mon.2 client_cookie=3287dd3aa17b998a server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71a759e700 1 --2- 172.21.15.84:0/1299305698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a80a2f60 0x7f71a805b0f0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f71a0008c90 tx=0x7f71a0010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71a659c700 1 -- 172.21.15.84:0/1299305698 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71a000a160 con 0x7f71a80a2f60 2020-01-16T05:44:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71a759e700 1 --2- 172.21.15.84:0/1299305698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a80a2f60 0x7f71a805b0f0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f71a0008c90 tx=0x7f71a0010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71a759e700 1 --2- 172.21.15.84:0/1299305698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a80a2f60 0x7f71a805b0f0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f71a0008c90 tx=0x7f71a0010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71a659c700 1 -- 172.21.15.84:0/1299305698 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a0011bb0 con 0x7f71a80a2f60 2020-01-16T05:44:11.925 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71a659c700 1 -- 172.21.15.84:0/1299305698 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71a000a740 con 0x7f71a80a2f60 2020-01-16T05:44:11.925 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71ad22a700 1 -- 172.21.15.84:0/1299305698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a80a2f60 msgr2=0x7f71a805b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.925 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71ad22a700 1 --2- 172.21.15.84:0/1299305698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a80a2f60 0x7f71a805b0f0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f71a0008c90 tx=0x7f71a0010230).stop 2020-01-16T05:44:11.925 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71ad22a700 1 -- 172.21.15.84:0/1299305698 shutdown_connections 2020-01-16T05:44:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71ad22a700 1 --2- 172.21.15.84:0/1299305698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71a80a2f60 0x7f71a805b0f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71ad22a700 1 --2- 172.21.15.84:0/1299305698 >> v2:172.21.15.142:3300/0 conn(0x7f71a80a8ff0 0x7f71a808fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71ad22a700 1 -- 172.21.15.84:0/1299305698 shutdown_connections 2020-01-16T05:44:11.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71ad22a700 1 -- 172.21.15.84:0/1299305698 wait complete. 2020-01-16T05:44:11.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.907+0000 7f71ad22a700 1 -- 172.21.15.84:0/1299305698 >> 172.21.15.84:0/1299305698 conn(0x7f71a80abc10 msgr2=0x7f71a805a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:11.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71ad22a700 1 Processor -- start 2020-01-16T05:44:11.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71ad22a700 1 -- start start 2020-01-16T05:44:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71ad22a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f71a8078750 0x7f71a809f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71ad22a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f71a8149700 0x7f71a80a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71ad22a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a8080000 con 0x7f71a8149b30 2020-01-16T05:44:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71ad22a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a809f450 con 0x7f71a8149700 2020-01-16T05:44:11.929 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71ad22a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a809fc40 con 0x7f71a8078750 2020-01-16T05:44:11.929 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71a6d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f71a8149700 0x7f71a80a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:11.930 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71a759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f71a8078750 0x7f71a809f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:11.930 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71a6d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f71a8149700 0x7f71a80a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34358/0 (socket says 172.21.15.84:34358) 2020-01-16T05:44:11.930 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71a6d9d700 1 -- 172.21.15.84:0/2219425665 learned_addr learned my addr 172.21.15.84:0/2219425665 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71a6d9d700 1 -- 172.21.15.84:0/2219425665 >> v2:172.21.15.142:3300/0 conn(0x7f71a8078750 msgr2=0x7f71a809f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71a6d9d700 1 --2- 172.21.15.84:0/2219425665 >> v2:172.21.15.142:3300/0 conn(0x7f71a8078750 0x7f71a809f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71a6d9d700 1 -- 172.21.15.84:0/2219425665 >> v1:172.21.15.142:6789/0 conn(0x7f71a8149b30 legacy=0x7f71a80a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71a6d9d700 1 -- 172.21.15.84:0/2219425665 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a80a1b90 con 0x7f71a8149700 2020-01-16T05:44:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71a6d9d700 1 --2- 172.21.15.84:0/2219425665 >> v2:172.21.15.84:3300/0 conn(0x7f71a8149700 0x7f71a80a0600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7190002ef0 tx=0x7f7190010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71a6d9d700 1 --2- 172.21.15.84:0/2219425665 >> v2:172.21.15.84:3300/0 conn(0x7f71a8149700 0x7f71a80a0600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7190002ef0 tx=0x7f7190010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71a6d9d700 1 --2- 172.21.15.84:0/2219425665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71a8149700 0x7f71a80a0600 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f7190002ef0 tx=0x7f7190010e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71a6d9d700 1 --2- 172.21.15.84:0/2219425665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71a8149700 0x7f71a80a0600 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f7190002ef0 tx=0x7f7190010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f719ffff700 1 -- 172.21.15.84:0/2219425665 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71900129f0 con 0x7f71a8149700 2020-01-16T05:44:11.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71a6d9d700 1 --2- 172.21.15.84:0/2219425665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71a8149700 0x7f71a80a0600 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f7190002ef0 tx=0x7f7190010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f719ffff700 1 -- 172.21.15.84:0/2219425665 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719000e160 con 0x7f71a8149700 2020-01-16T05:44:11.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71a6d9d700 1 --2- 172.21.15.84:0/2219425665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71a8149700 0x7f71a80a0600 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f7190002ef0 tx=0x7f7190010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71ad22a700 1 -- 172.21.15.84:0/2219425665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a8132ed0 con 0x7f71a8149700 2020-01-16T05:44:11.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f719ffff700 1 -- 172.21.15.84:0/2219425665 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71900058b0 con 0x7f71a8149700 2020-01-16T05:44:11.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.911+0000 7f71ad22a700 1 -- 172.21.15.84:0/2219425665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a81333d0 con 0x7f71a8149700 2020-01-16T05:44:11.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.915+0000 7f71a6d9d700 1 --2- 172.21.15.84:0/2219425665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71a8149700 0x7f71a80a0600 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f7190002ef0 tx=0x7f7190010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.915+0000 7f719ffff700 1 -- 172.21.15.84:0/2219425665 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f7190005c10 con 0x7f71a8149700 2020-01-16T05:44:11.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.915+0000 7f71ad22a700 1 -- 172.21.15.84:0/2219425665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a805e1c0 con 0x7f71a8149700 2020-01-16T05:44:11.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.915+0000 7f71a6d9d700 1 --2- 172.21.15.84:0/2219425665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71a8149700 0x7f71a80a0600 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f7190002ef0 tx=0x7f7190010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.940 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.915+0000 7f719ffff700 1 --2- 172.21.15.84:0/2219425665 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f718c03c250 0x7f718c03e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:11.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.915+0000 7f719ffff700 1 -- 172.21.15.84:0/2219425665 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f719004c9c0 con 0x7f71a8149700 2020-01-16T05:44:11.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.915+0000 7f71a759e700 1 --2- 172.21.15.84:0/2219425665 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f718c03c250 0x7f718c03e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:11.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.915+0000 7f71a759e700 1 --2- 172.21.15.84:0/2219425665 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f718c03c250 0x7f718c03e760 crc :-1 s=READY pgs=68 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:11.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.919+0000 7f71a6d9d700 1 --2- 172.21.15.84:0/2219425665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71a8149700 0x7f71a80a0600 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f7190002ef0 tx=0x7f7190010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:11.944 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:11.919+0000 7f719ffff700 1 -- 172.21.15.84:0/2219425665 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f7190032fc0 con 0x7f71a8149700 2020-01-16T05:44:12.040 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.039+0000 7f71ad22a700 1 -- 172.21.15.84:0/2219425665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f71a808f350 con 0x7f71a8149700 2020-01-16T05:44:12.041 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.039+0000 7f71a6d9d700 1 --2- 172.21.15.84:0/2219425665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71a8149700 0x7f71a80a0600 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f7190002ef0 tx=0x7f7190010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.041 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.039+0000 7f719ffff700 1 -- 172.21.15.84:0/2219425665 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7190033220 con 0x7f71a8149700 2020-01-16T05:44:12.041 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2020-01-16T05:44:12.043 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.039+0000 7f71ad22a700 1 -- 172.21.15.84:0/2219425665 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f718c03c250 msgr2=0x7f718c03e760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.044 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.039+0000 7f71ad22a700 1 --2- 172.21.15.84:0/2219425665 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f718c03c250 0x7f718c03e760 crc :-1 s=READY pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.044 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.039+0000 7f71ad22a700 1 -- 172.21.15.84:0/2219425665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71a8149700 msgr2=0x7f71a80a0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.044 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.039+0000 7f71ad22a700 1 --2- 172.21.15.84:0/2219425665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71a8149700 0x7f71a80a0600 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f7190002ef0 tx=0x7f7190010e80).stop 2020-01-16T05:44:12.044 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.039+0000 7f71ad22a700 1 -- 172.21.15.84:0/2219425665 shutdown_connections 2020-01-16T05:44:12.045 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.039+0000 7f71ad22a700 1 --2- 172.21.15.84:0/2219425665 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f718c03c250 0x7f718c03e760 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.039+0000 7f71ad22a700 1 --2- 172.21.15.84:0/2219425665 >> v2:172.21.15.142:3300/0 conn(0x7f71a8078750 0x7f71a809f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.039+0000 7f71ad22a700 1 --2- 172.21.15.84:0/2219425665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71a8149700 0x7f71a80a0600 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.039+0000 7f71ad22a700 1 -- 172.21.15.84:0/2219425665 shutdown_connections 2020-01-16T05:44:12.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.039+0000 7f71ad22a700 1 -- 172.21.15.84:0/2219425665 wait complete. 2020-01-16T05:44:12.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.039+0000 7f71ad22a700 1 -- 172.21.15.84:0/2219425665 >> 172.21.15.84:0/2219425665 conn(0x7f71a808fc30 msgr2=0x7f71a809dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:12.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.4 2020-01-16T05:44:12.055 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2020-01-16T05:44:12.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d1f60700 1 Processor -- start 2020-01-16T05:44:12.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d1f60700 1 -- start start 2020-01-16T05:44:12.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d1f60700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa9cc0a9b30 0x7fa9cc0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:12.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d1f60700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa9cc07ff10 0x7fa9cc066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:12.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d1f60700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9cc0a4250 0x7fa9cc0a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:12.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d1f60700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9cc0a4830 con 0x7fa9cc07ff10 2020-01-16T05:44:12.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d1f60700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9cc07f9d0 con 0x7fa9cc0a9b30 2020-01-16T05:44:12.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d1f60700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc07fc70 con 0x7fa9cc0a4250 2020-01-16T05:44:12.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d0f5e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa9cc07ff10 0x7fa9cc066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d0f5e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa9cc07ff10 0x7fa9cc066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34364/0 (socket says 172.21.15.84:34364) 2020-01-16T05:44:12.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d0f5e700 1 -- 172.21.15.84:0/3772454410 learned_addr learned my addr 172.21.15.84:0/3772454410 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:12.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d31c2700 1 --2- 172.21.15.84:0/3772454410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9cc0a4250 0x7fa9cc0a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d175f700 1 --2- 172.21.15.84:0/3772454410 >> v2:172.21.15.142:3300/0 conn(0x7fa9cc0a9b30 0x7fa9cc0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d0f5e700 1 -- 172.21.15.84:0/3772454410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9cc0a4250 msgr2=0x7fa9cc0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:12.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d0f5e700 1 --2- 172.21.15.84:0/3772454410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9cc0a4250 0x7fa9cc0a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:12.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d0f5e700 1 -- 172.21.15.84:0/3772454410 >> v2:172.21.15.142:3300/0 conn(0x7fa9cc0a9b30 msgr2=0x7fa9cc0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d0f5e700 1 --2- 172.21.15.84:0/3772454410 >> v2:172.21.15.142:3300/0 conn(0x7fa9cc0a9b30 0x7fa9cc0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d0f5e700 1 -- 172.21.15.84:0/3772454410 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc066dd0 con 0x7fa9cc07ff10 2020-01-16T05:44:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d175f700 1 --2- 172.21.15.84:0/3772454410 >> v2:172.21.15.142:3300/0 conn(0x7fa9cc0a9b30 0x7fa9cc0abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-01-16T05:44:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d0f5e700 1 --2- 172.21.15.84:0/3772454410 >> v2:172.21.15.84:3300/0 conn(0x7fa9cc07ff10 0x7fa9cc066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa9cc0a49f0 tx=0x7fa9bc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d0f5e700 1 --2- 172.21.15.84:0/3772454410 >> v2:172.21.15.84:3300/0 conn(0x7fa9cc07ff10 0x7fa9cc066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa9cc0a49f0 tx=0x7fa9bc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d0f5e700 1 --2- 172.21.15.84:0/3772454410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9cc07ff10 0x7fa9cc066880 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7fa9cc0a49f0 tx=0x7fa9bc00ff30).ready entity=mon.0 client_cookie=190fc1cecebb4e32 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9d0f5e700 1 --2- 172.21.15.84:0/3772454410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9cc07ff10 0x7fa9cc066880 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fa9cc0a49f0 tx=0x7fa9bc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.163+0000 7fa9c3fff700 1 -- 172.21.15.84:0/3772454410 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9bc011760 con 0x7fa9cc07ff10 2020-01-16T05:44:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.167+0000 7fa9d0f5e700 1 --2- 172.21.15.84:0/3772454410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9cc07ff10 0x7fa9cc066880 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fa9cc0a49f0 tx=0x7fa9bc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.167+0000 7fa9d0f5e700 1 --2- 172.21.15.84:0/3772454410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9cc07ff10 0x7fa9cc066880 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fa9cc0a49f0 tx=0x7fa9bc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.167+0000 7fa9c3fff700 1 -- 172.21.15.84:0/3772454410 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9bc008d30 con 0x7fa9cc07ff10 2020-01-16T05:44:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.167+0000 7fa9c3fff700 1 -- 172.21.15.84:0/3772454410 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9bc011d40 con 0x7fa9cc07ff10 2020-01-16T05:44:12.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.167+0000 7fa9d1f60700 1 -- 172.21.15.84:0/3772454410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9cc07ff10 msgr2=0x7fa9cc066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.167+0000 7fa9d1f60700 1 --2- 172.21.15.84:0/3772454410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9cc07ff10 0x7fa9cc066880 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7fa9cc0a49f0 tx=0x7fa9bc00ff30).stop 2020-01-16T05:44:12.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.167+0000 7fa9d1f60700 1 -- 172.21.15.84:0/3772454410 shutdown_connections 2020-01-16T05:44:12.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.167+0000 7fa9d1f60700 1 --2- 172.21.15.84:0/3772454410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9cc0a4250 0x7fa9cc0a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:12.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.167+0000 7fa9d1f60700 1 --2- 172.21.15.84:0/3772454410 >> v2:172.21.15.142:3300/0 conn(0x7fa9cc0a9b30 0x7fa9cc0abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:12.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.167+0000 7fa9d1f60700 1 --2- 172.21.15.84:0/3772454410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9cc07ff10 0x7fa9cc066880 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.167+0000 7fa9d1f60700 1 -- 172.21.15.84:0/3772454410 shutdown_connections 2020-01-16T05:44:12.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.167+0000 7fa9d1f60700 1 -- 172.21.15.84:0/3772454410 wait complete. 2020-01-16T05:44:12.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.167+0000 7fa9d1f60700 1 -- 172.21.15.84:0/3772454410 >> 172.21.15.84:0/3772454410 conn(0x7fa9cc0acfc0 msgr2=0x7fa9cc0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:12.183 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.167+0000 7fa9d1f60700 1 Processor -- start 2020-01-16T05:44:12.184 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.167+0000 7fa9d1f60700 1 -- start start 2020-01-16T05:44:12.184 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d1f60700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa9cc09f9f0 0x7fa9cc124590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:12.184 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d1f60700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa9cc0654d0 0x7fa9cc126240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:12.184 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d1f60700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9cc126790 0x7fa9cc123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:12.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d1f60700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9cc124ae0 con 0x7fa9cc09f9f0 2020-01-16T05:44:12.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d1f60700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9cc126cb0 con 0x7fa9cc0654d0 2020-01-16T05:44:12.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d1f60700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc0921c0 con 0x7fa9cc126790 2020-01-16T05:44:12.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d175f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa9cc09f9f0 0x7fa9cc124590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d175f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa9cc09f9f0 0x7fa9cc124590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34368/0 (socket says 172.21.15.84:34368) 2020-01-16T05:44:12.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d31c2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9cc126790 0x7fa9cc123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d175f700 1 -- 172.21.15.84:0/908199473 learned_addr learned my addr 172.21.15.84:0/908199473 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:12.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d0f5e700 1 --2- 172.21.15.84:0/908199473 >> v2:172.21.15.142:3300/0 conn(0x7fa9cc0654d0 0x7fa9cc126240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d175f700 1 -- 172.21.15.84:0/908199473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9cc126790 msgr2=0x7fa9cc123210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d175f700 1 --2- 172.21.15.84:0/908199473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9cc126790 0x7fa9cc123210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d175f700 1 -- 172.21.15.84:0/908199473 >> v2:172.21.15.142:3300/0 conn(0x7fa9cc0654d0 msgr2=0x7fa9cc126240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.188 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d175f700 1 --2- 172.21.15.84:0/908199473 >> v2:172.21.15.142:3300/0 conn(0x7fa9cc0654d0 0x7fa9cc126240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.188 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d175f700 1 -- 172.21.15.84:0/908199473 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc065900 con 0x7fa9cc09f9f0 2020-01-16T05:44:12.188 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d31c2700 1 --2- 172.21.15.84:0/908199473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9cc126790 0x7fa9cc123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:12.189 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d175f700 1 --2- 172.21.15.84:0/908199473 >> v2:172.21.15.84:3300/0 conn(0x7fa9cc09f9f0 0x7fa9cc124590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa9c8002f30 tx=0x7fa9c8010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.189 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d175f700 1 --2- 172.21.15.84:0/908199473 >> v2:172.21.15.84:3300/0 conn(0x7fa9cc09f9f0 0x7fa9cc124590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa9c8002f30 tx=0x7fa9c8010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.189 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d175f700 1 --2- 172.21.15.84:0/908199473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9cc09f9f0 0x7fa9cc124590 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7fa9c8002f30 tx=0x7fa9c8010b10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:12.189 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d175f700 1 --2- 172.21.15.84:0/908199473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9cc09f9f0 0x7fa9cc124590 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fa9c8002f30 tx=0x7fa9c8010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9c1ffb700 1 -- 172.21.15.84:0/908199473 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c8013060 con 0x7fa9cc09f9f0 2020-01-16T05:44:12.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d175f700 1 --2- 172.21.15.84:0/908199473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9cc09f9f0 0x7fa9cc124590 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fa9c8002f30 tx=0x7fa9c8010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d175f700 1 --2- 172.21.15.84:0/908199473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9cc09f9f0 0x7fa9cc124590 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fa9c8002f30 tx=0x7fa9c8010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9c1ffb700 1 -- 172.21.15.84:0/908199473 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c8007160 con 0x7fa9cc09f9f0 2020-01-16T05:44:12.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d1f60700 1 -- 172.21.15.84:0/908199473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9cc123760 con 0x7fa9cc09f9f0 2020-01-16T05:44:12.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9c1ffb700 1 -- 172.21.15.84:0/908199473 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c8005da0 con 0x7fa9cc09f9f0 2020-01-16T05:44:12.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d1f60700 1 -- 172.21.15.84:0/908199473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9cc0a4ad0 con 0x7fa9cc09f9f0 2020-01-16T05:44:12.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.171+0000 7fa9d175f700 1 --2- 172.21.15.84:0/908199473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9cc09f9f0 0x7fa9cc124590 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fa9c8002f30 tx=0x7fa9c8010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.175+0000 7fa9d1f60700 1 -- 172.21.15.84:0/908199473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9cc05e1c0 con 0x7fa9cc09f9f0 2020-01-16T05:44:12.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.175+0000 7fa9c1ffb700 1 -- 172.21.15.84:0/908199473 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fa9c8008980 con 0x7fa9cc09f9f0 2020-01-16T05:44:12.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.175+0000 7fa9d175f700 1 --2- 172.21.15.84:0/908199473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9cc09f9f0 0x7fa9cc124590 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fa9c8002f30 tx=0x7fa9c8010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.175+0000 7fa9c1ffb700 1 --2- 172.21.15.84:0/908199473 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa9ac03c2c0 0x7fa9ac03e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:12.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.175+0000 7fa9c1ffb700 1 -- 172.21.15.84:0/908199473 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7fa9c804c780 con 0x7fa9cc09f9f0 2020-01-16T05:44:12.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.175+0000 7fa9d0f5e700 1 --2- 172.21.15.84:0/908199473 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa9ac03c2c0 0x7fa9ac03e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.193 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.175+0000 7fa9d0f5e700 1 --2- 172.21.15.84:0/908199473 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa9ac03c2c0 0x7fa9ac03e7d0 crc :-1 s=READY pgs=69 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:12.193 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.179+0000 7fa9d175f700 1 --2- 172.21.15.84:0/908199473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9cc09f9f0 0x7fa9cc124590 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fa9c8002f30 tx=0x7fa9c8010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.193 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.179+0000 7fa9c1ffb700 1 -- 172.21.15.84:0/908199473 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fa9c8032da0 con 0x7fa9cc09f9f0 2020-01-16T05:44:12.298 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.295+0000 7fa9d1f60700 1 -- 172.21.15.84:0/908199473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa9cc127f00 con 0x7fa9cc09f9f0 2020-01-16T05:44:12.298 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.295+0000 7fa9d175f700 1 --2- 172.21.15.84:0/908199473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9cc09f9f0 0x7fa9cc124590 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fa9c8002f30 tx=0x7fa9c8010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.298 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.299+0000 7fa9c1ffb700 1 -- 172.21.15.84:0/908199473 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa9c8033000 con 0x7fa9cc09f9f0 2020-01-16T05:44:12.299 INFO:teuthology.orchestra.run.smithi084.stdout:60129542149 2020-01-16T05:44:12.299 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.299+0000 7fa9d1f60700 1 -- 172.21.15.84:0/908199473 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa9ac03c2c0 msgr2=0x7fa9ac03e7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.300 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.299+0000 7fa9d1f60700 1 --2- 172.21.15.84:0/908199473 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa9ac03c2c0 0x7fa9ac03e7d0 crc :-1 s=READY pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.300 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.299+0000 7fa9d1f60700 1 -- 172.21.15.84:0/908199473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9cc09f9f0 msgr2=0x7fa9cc124590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.300 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.299+0000 7fa9d1f60700 1 --2- 172.21.15.84:0/908199473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9cc09f9f0 0x7fa9cc124590 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7fa9c8002f30 tx=0x7fa9c8010b10).stop 2020-01-16T05:44:12.301 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.299+0000 7fa9d1f60700 1 -- 172.21.15.84:0/908199473 shutdown_connections 2020-01-16T05:44:12.301 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.299+0000 7fa9d1f60700 1 --2- 172.21.15.84:0/908199473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9cc126790 0x7fa9cc123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.301 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.299+0000 7fa9d1f60700 1 --2- 172.21.15.84:0/908199473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9cc09f9f0 0x7fa9cc124590 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.302 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.299+0000 7fa9d1f60700 1 --2- 172.21.15.84:0/908199473 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa9ac03c2c0 0x7fa9ac03e7d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.302 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.299+0000 7fa9d1f60700 1 --2- 172.21.15.84:0/908199473 >> v2:172.21.15.142:3300/0 conn(0x7fa9cc0654d0 0x7fa9cc126240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.302 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.299+0000 7fa9d1f60700 1 -- 172.21.15.84:0/908199473 shutdown_connections 2020-01-16T05:44:12.302 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.299+0000 7fa9d1f60700 1 -- 172.21.15.84:0/908199473 wait complete. 2020-01-16T05:44:12.302 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.299+0000 7fa9d1f60700 1 -- 172.21.15.84:0/908199473 >> 172.21.15.84:0/908199473 conn(0x7fa9cc07e070 msgr2=0x7fa9cc0a5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:12.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2020-01-16T05:44:12.311 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2020-01-16T05:44:12.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.423+0000 7efff2f09700 1 Processor -- start 2020-01-16T05:44:12.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.423+0000 7efff2f09700 1 -- start start 2020-01-16T05:44:12.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2f09700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7effec0a9b30 0x7effec0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:12.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2f09700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7effec0a4250 0x7effec066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:12.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2f09700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec066dd0 con 0x7effec07ff10 2020-01-16T05:44:12.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2f09700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec0a4830 con 0x7effec0a9b30 2020-01-16T05:44:12.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2f09700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec07f9d0 con 0x7effec0a4250 2020-01-16T05:44:12.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2708700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7effec0a9b30 0x7effec0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2708700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7effec0a9b30 0x7effec0abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34376/0 (socket says 172.21.15.84:34376) 2020-01-16T05:44:12.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2708700 1 -- 172.21.15.84:0/4023281103 learned_addr learned my addr 172.21.15.84:0/4023281103 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:12.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff416b700 1 --2- 172.21.15.84:0/4023281103 >> v2:172.21.15.142:3300/0 conn(0x7effec0a4250 0x7effec066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2708700 1 -- 172.21.15.84:0/4023281103 >> v2:172.21.15.142:3300/0 conn(0x7effec0a4250 msgr2=0x7effec066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:12.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2708700 1 --2- 172.21.15.84:0/4023281103 >> v2:172.21.15.142:3300/0 conn(0x7effec0a4250 0x7effec066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:12.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2708700 1 -- 172.21.15.84:0/4023281103 >> v1:172.21.15.142:6789/0 conn(0x7effec07ff10 legacy=0x7effec0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:12.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2708700 1 -- 172.21.15.84:0/4023281103 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec150ce0 con 0x7effec0a9b30 2020-01-16T05:44:12.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2708700 1 --2- 172.21.15.84:0/4023281103 >> v2:172.21.15.84:3300/0 conn(0x7effec0a9b30 0x7effec0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7effec0a49f0 tx=0x7effe8010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2708700 1 --2- 172.21.15.84:0/4023281103 >> v2:172.21.15.84:3300/0 conn(0x7effec0a9b30 0x7effec0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7effec0a49f0 tx=0x7effe8010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2708700 1 --2- 172.21.15.84:0/4023281103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effec0a9b30 0x7effec0abdd0 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7effec0a49f0 tx=0x7effe8010230).ready entity=mon.0 client_cookie=d483863fbbbaf8fa server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:12.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2708700 1 --2- 172.21.15.84:0/4023281103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effec0a9b30 0x7effec0abdd0 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7effec0a49f0 tx=0x7effe8010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff1706700 1 -- 172.21.15.84:0/4023281103 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effe800a160 con 0x7effec0a9b30 2020-01-16T05:44:12.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2708700 1 --2- 172.21.15.84:0/4023281103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effec0a9b30 0x7effec0abdd0 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7effec0a49f0 tx=0x7effe8010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2708700 1 --2- 172.21.15.84:0/4023281103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effec0a9b30 0x7effec0abdd0 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7effec0a49f0 tx=0x7effe8010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff1706700 1 -- 172.21.15.84:0/4023281103 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe8011b70 con 0x7effec0a9b30 2020-01-16T05:44:12.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff1706700 1 -- 172.21.15.84:0/4023281103 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effe800a740 con 0x7effec0a9b30 2020-01-16T05:44:12.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2f09700 1 -- 172.21.15.84:0/4023281103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effec0a9b30 msgr2=0x7effec0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2f09700 1 --2- 172.21.15.84:0/4023281103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effec0a9b30 0x7effec0abdd0 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7effec0a49f0 tx=0x7effe8010230).stop 2020-01-16T05:44:12.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2f09700 1 -- 172.21.15.84:0/4023281103 shutdown_connections 2020-01-16T05:44:12.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2f09700 1 --2- 172.21.15.84:0/4023281103 >> v2:172.21.15.142:3300/0 conn(0x7effec0a4250 0x7effec066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:12.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2f09700 1 --2- 172.21.15.84:0/4023281103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effec0a9b30 0x7effec0abdd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2f09700 1 -- 172.21.15.84:0/4023281103 shutdown_connections 2020-01-16T05:44:12.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2f09700 1 -- 172.21.15.84:0/4023281103 wait complete. 2020-01-16T05:44:12.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.427+0000 7efff2f09700 1 -- 172.21.15.84:0/4023281103 >> 172.21.15.84:0/4023281103 conn(0x7effec0acfc0 msgr2=0x7effec0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:12.441 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff2f09700 1 Processor -- start 2020-01-16T05:44:12.441 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff2f09700 1 -- start start 2020-01-16T05:44:12.441 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff2f09700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7effec090a20 0x7effec0915d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:12.441 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff2f09700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec091b20 con 0x7effec077ec0 2020-01-16T05:44:12.442 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff2f09700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec077610 con 0x7effec0a40f0 2020-01-16T05:44:12.442 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff2f09700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec077980 con 0x7effec090a20 2020-01-16T05:44:12.443 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff1f07700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7effec077ec0 0x7effec090220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51582/0 (socket says 172.21.15.84:51582) 2020-01-16T05:44:12.443 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff1f07700 1 -- 172.21.15.84:0/1673799937 learned_addr learned my addr 172.21.15.84:0/1673799937 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:12.443 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff416b700 1 --2- 172.21.15.84:0/1673799937 >> v2:172.21.15.84:3300/0 conn(0x7effec090a20 0x7effec0915d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.443 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7effe2ffd700 1 -- 172.21.15.84:0/1673799937 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200537281 0 0) 0x7effec066dd0 con 0x7effec077ec0 2020-01-16T05:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7effe2ffd700 1 -- 172.21.15.84:0/1673799937 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effd4003230 con 0x7effec077ec0 2020-01-16T05:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7effe2ffd700 1 -- 172.21.15.84:0/1673799937 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996759400 0 0) 0x7effec077610 con 0x7effec0a40f0 2020-01-16T05:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7effe2ffd700 1 -- 172.21.15.84:0/1673799937 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effec066dd0 con 0x7effec0a40f0 2020-01-16T05:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff416b700 1 -- 172.21.15.84:0/1673799937 >> v1:172.21.15.142:6789/0 conn(0x7effec0a40f0 legacy=0x7effec131980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff416b700 1 -- 172.21.15.84:0/1673799937 >> v1:172.21.15.84:6789/0 conn(0x7effec077ec0 legacy=0x7effec090220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff416b700 1 -- 172.21.15.84:0/1673799937 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec090e50 con 0x7effec090a20 2020-01-16T05:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff416b700 1 --2- 172.21.15.84:0/1673799937 >> v2:172.21.15.84:3300/0 conn(0x7effec090a20 0x7effec0915d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7effe4002f30 tx=0x7effe4010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff416b700 1 --2- 172.21.15.84:0/1673799937 >> v2:172.21.15.84:3300/0 conn(0x7effec090a20 0x7effec0915d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7effe4002f30 tx=0x7effe4010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.446 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff416b700 1 --2- 172.21.15.84:0/1673799937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effec090a20 0x7effec0915d0 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7effe4002f30 tx=0x7effe4010ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:12.446 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff416b700 1 --2- 172.21.15.84:0/1673799937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effec090a20 0x7effec0915d0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7effe4002f30 tx=0x7effe4010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.446 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7effe2ffd700 1 -- 172.21.15.84:0/1673799937 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effe40056c0 con 0x7effec090a20 2020-01-16T05:44:12.447 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff416b700 1 --2- 172.21.15.84:0/1673799937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effec090a20 0x7effec0915d0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7effe4002f30 tx=0x7effe4010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.447 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff416b700 1 --2- 172.21.15.84:0/1673799937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effec090a20 0x7effec0915d0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7effe4002f30 tx=0x7effe4010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.447 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7effe2ffd700 1 -- 172.21.15.84:0/1673799937 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe4007150 con 0x7effec090a20 2020-01-16T05:44:12.447 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff2f09700 1 -- 172.21.15.84:0/1673799937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effec13d3a0 con 0x7effec090a20 2020-01-16T05:44:12.448 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7effe2ffd700 1 -- 172.21.15.84:0/1673799937 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effe4005cc0 con 0x7effec090a20 2020-01-16T05:44:12.448 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.431+0000 7efff2f09700 1 -- 172.21.15.84:0/1673799937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec13d8f0 con 0x7effec090a20 2020-01-16T05:44:12.448 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.435+0000 7efff416b700 1 --2- 172.21.15.84:0/1673799937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effec090a20 0x7effec0915d0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7effe4002f30 tx=0x7effe4010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.448 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.435+0000 7efff416b700 1 --2- 172.21.15.84:0/1673799937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effec090a20 0x7effec0915d0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7effe4002f30 tx=0x7effe4010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.449 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.435+0000 7effe2ffd700 1 -- 172.21.15.84:0/1673799937 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7effe4012660 con 0x7effec090a20 2020-01-16T05:44:12.449 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.435+0000 7efff2f09700 1 -- 172.21.15.84:0/1673799937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effec05e1c0 con 0x7effec090a20 2020-01-16T05:44:12.449 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.435+0000 7effe2ffd700 1 --2- 172.21.15.84:0/1673799937 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7effd403c9f0 0x7effd403ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:12.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.435+0000 7effe2ffd700 1 -- 172.21.15.84:0/1673799937 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7effe404cb60 con 0x7effec090a20 2020-01-16T05:44:12.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.435+0000 7efff2708700 1 --2- 172.21.15.84:0/1673799937 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7effd403c9f0 0x7effd403ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.435+0000 7efff2708700 1 --2- 172.21.15.84:0/1673799937 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7effd403c9f0 0x7effd403ef00 crc :-1 s=READY pgs=70 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:12.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.443+0000 7efff416b700 1 --2- 172.21.15.84:0/1673799937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effec090a20 0x7effec0915d0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7effe4002f30 tx=0x7effe4010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.443+0000 7effe2ffd700 1 -- 172.21.15.84:0/1673799937 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7effe4033140 con 0x7effec090a20 2020-01-16T05:44:12.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.563+0000 7efff2f09700 1 -- 172.21.15.84:0/1673799937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7effec09fce0 con 0x7effec090a20 2020-01-16T05:44:12.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.563+0000 7efff416b700 1 --2- 172.21.15.84:0/1673799937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effec090a20 0x7effec0915d0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7effe4002f30 tx=0x7effe4010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.563+0000 7effe2ffd700 1 -- 172.21.15.84:0/1673799937 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7effe40333a0 con 0x7effec090a20 2020-01-16T05:44:12.565 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2020-01-16T05:44:12.567 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.563+0000 7efff2f09700 1 -- 172.21.15.84:0/1673799937 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7effd403c9f0 msgr2=0x7effd403ef00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.567 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.563+0000 7efff2f09700 1 --2- 172.21.15.84:0/1673799937 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7effd403c9f0 0x7effd403ef00 crc :-1 s=READY pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.568 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.563+0000 7efff2f09700 1 -- 172.21.15.84:0/1673799937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effec090a20 msgr2=0x7effec0915d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.568 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.563+0000 7efff2f09700 1 --2- 172.21.15.84:0/1673799937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effec090a20 0x7effec0915d0 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7effe4002f30 tx=0x7effe4010ae0).stop 2020-01-16T05:44:12.568 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.563+0000 7efff2f09700 1 -- 172.21.15.84:0/1673799937 shutdown_connections 2020-01-16T05:44:12.568 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.563+0000 7efff2f09700 1 --2- 172.21.15.84:0/1673799937 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7effd403c9f0 0x7effd403ef00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.569 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.563+0000 7efff2f09700 1 --2- 172.21.15.84:0/1673799937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effec090a20 0x7effec0915d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.577 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.563+0000 7efff2f09700 1 -- 172.21.15.84:0/1673799937 shutdown_connections 2020-01-16T05:44:12.577 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.563+0000 7efff2f09700 1 -- 172.21.15.84:0/1673799937 wait complete. 2020-01-16T05:44:12.577 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.563+0000 7efff2f09700 1 -- 172.21.15.84:0/1673799937 >> 172.21.15.84:0/1673799937 conn(0x7effec0a4c30 msgr2=0x7effec0a5320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:12.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2020-01-16T05:44:12.578 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2020-01-16T05:44:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e1dc9700 1 Processor -- start 2020-01-16T05:44:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e1dc9700 1 -- start start 2020-01-16T05:44:12.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e1dc9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f26dc0a4250 0x7f26dc0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:12.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e1dc9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26dc066880 con 0x7f26dc07ff10 2020-01-16T05:44:12.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e1dc9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26dc066ab0 con 0x7f26dc0a9b30 2020-01-16T05:44:12.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e1dc9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26dc0a4830 con 0x7f26dc0a4250 2020-01-16T05:44:12.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e0dc7700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f26dc07ff10 0x7f26dc14dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51590/0 (socket says 172.21.15.84:51590) 2020-01-16T05:44:12.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e0dc7700 1 -- 172.21.15.84:0/3659096833 learned_addr learned my addr 172.21.15.84:0/3659096833 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e302b700 1 --2- 172.21.15.84:0/3659096833 >> v2:172.21.15.142:3300/0 conn(0x7f26dc0a4250 0x7f26dc0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26cffff700 1 -- 172.21.15.84:0/3659096833 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199657414 0 0) 0x7f26dc066880 con 0x7f26dc07ff10 2020-01-16T05:44:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26cffff700 1 -- 172.21.15.84:0/3659096833 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26c8003230 con 0x7f26dc07ff10 2020-01-16T05:44:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26cffff700 1 -- 172.21.15.84:0/3659096833 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2653350439 0 0) 0x7f26c8003230 con 0x7f26dc07ff10 2020-01-16T05:44:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26cffff700 1 -- 172.21.15.84:0/3659096833 >> v2:172.21.15.142:3300/0 conn(0x7f26dc0a4250 msgr2=0x7f26dc0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26cffff700 1 --2- 172.21.15.84:0/3659096833 >> v2:172.21.15.142:3300/0 conn(0x7f26dc0a4250 0x7f26dc0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26cffff700 1 -- 172.21.15.84:0/3659096833 >> v1:172.21.15.142:6789/0 conn(0x7f26dc0a9b30 legacy=0x7f26dc0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.704 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26cffff700 1 -- 172.21.15.84:0/3659096833 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc066ce0 con 0x7f26dc07ff10 2020-01-16T05:44:12.704 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26cffff700 1 -- 172.21.15.84:0/3659096833 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f26d8001750 con 0x7f26dc07ff10 2020-01-16T05:44:12.704 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26cffff700 1 -- 172.21.15.84:0/3659096833 >> v1:172.21.15.84:6789/0 conn(0x7f26dc07ff10 legacy=0x7f26dc14dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.704 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26cffff700 1 --2- 172.21.15.84:0/3659096833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26c8003860 0x7f26c8003cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:12.704 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26cffff700 1 --2- 172.21.15.84:0/3659096833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26c80045a0 0x7f26c80049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:12.704 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26cffff700 1 --2- 172.21.15.84:0/3659096833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26c8004f20 0x7f26c800b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:12.704 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26cffff700 1 -- 172.21.15.84:0/3659096833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc0a4830 con 0x7f26c8004f20 2020-01-16T05:44:12.705 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26cffff700 1 -- 172.21.15.84:0/3659096833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c804fde0 con 0x7f26c80045a0 2020-01-16T05:44:12.705 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26cffff700 1 -- 172.21.15.84:0/3659096833 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c8050020 con 0x7f26c8003860 2020-01-16T05:44:12.705 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e302b700 1 --2- 172.21.15.84:0/3659096833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26c8004f20 0x7f26c800b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.705 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e0dc7700 1 --2- 172.21.15.84:0/3659096833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26c80045a0 0x7f26c80049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.705 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e15c8700 1 --2- 172.21.15.84:0/3659096833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26c8003860 0x7f26c8003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.705 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e302b700 1 -- 172.21.15.84:0/3659096833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26c8003860 msgr2=0x7f26c8003cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:12.705 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e302b700 1 --2- 172.21.15.84:0/3659096833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26c8003860 0x7f26c8003cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e302b700 1 -- 172.21.15.84:0/3659096833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26c80045a0 msgr2=0x7f26c80049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e302b700 1 --2- 172.21.15.84:0/3659096833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26c80045a0 0x7f26c80049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e302b700 1 -- 172.21.15.84:0/3659096833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c8050320 con 0x7f26c8004f20 2020-01-16T05:44:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e15c8700 1 --2- 172.21.15.84:0/3659096833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26c8003860 0x7f26c8003cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-01-16T05:44:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e302b700 1 --2- 172.21.15.84:0/3659096833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26c8004f20 0x7f26c800b7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f26d40032b0 tx=0x7f26d40104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e302b700 1 -- 172.21.15.84:0/3659096833 reap_dead start 2020-01-16T05:44:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e302b700 1 --2- 172.21.15.84:0/3659096833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26c8004f20 0x7f26c800b7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f26d40032b0 tx=0x7f26d40104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.707 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e302b700 1 --2- 172.21.15.84:0/3659096833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26c8004f20 0x7f26c800b7f0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f26d40032b0 tx=0x7f26d40104b0).ready entity=mon.0 client_cookie=a2a13cbf84b690c server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:12.707 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e302b700 1 --2- 172.21.15.84:0/3659096833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26c8004f20 0x7f26c800b7f0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f26d40032b0 tx=0x7f26d40104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.707 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26cffff700 1 -- 172.21.15.84:0/3659096833 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26d4010e00 con 0x7f26c8004f20 2020-01-16T05:44:12.707 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e302b700 1 --2- 172.21.15.84:0/3659096833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26c8004f20 0x7f26c800b7f0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f26d40032b0 tx=0x7f26d40104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.707 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e302b700 1 --2- 172.21.15.84:0/3659096833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26c8004f20 0x7f26c800b7f0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f26d40032b0 tx=0x7f26d40104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.707 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26cffff700 1 -- 172.21.15.84:0/3659096833 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d4005c30 con 0x7f26c8004f20 2020-01-16T05:44:12.707 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26cffff700 1 -- 172.21.15.84:0/3659096833 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26d40114a0 con 0x7f26c8004f20 2020-01-16T05:44:12.707 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e1dc9700 1 -- 172.21.15.84:0/3659096833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26c8004f20 msgr2=0x7f26c800b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.708 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.695+0000 7f26e1dc9700 1 --2- 172.21.15.84:0/3659096833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26c8004f20 0x7f26c800b7f0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f26d40032b0 tx=0x7f26d40104b0).stop 2020-01-16T05:44:12.708 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.699+0000 7f26e1dc9700 1 -- 172.21.15.84:0/3659096833 shutdown_connections 2020-01-16T05:44:12.708 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.699+0000 7f26e1dc9700 1 --2- 172.21.15.84:0/3659096833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26c8004f20 0x7f26c800b7f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.708 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.699+0000 7f26e1dc9700 1 -- 172.21.15.84:0/3659096833 shutdown_connections 2020-01-16T05:44:12.708 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.699+0000 7f26e1dc9700 1 -- 172.21.15.84:0/3659096833 wait complete. 2020-01-16T05:44:12.709 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.699+0000 7f26e1dc9700 1 -- 172.21.15.84:0/3659096833 >> 172.21.15.84:0/3659096833 conn(0x7f26dc0acfc0 msgr2=0x7f26dc0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:12.709 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.699+0000 7f26e1dc9700 1 Processor -- start 2020-01-16T05:44:12.709 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.699+0000 7f26e1dc9700 1 -- start start 2020-01-16T05:44:12.714 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.699+0000 7f26e1dc9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26dc124610 0x7f26dc0a7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:12.714 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.699+0000 7f26e1dc9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26dc0a79a0 0x7f26dc09f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:12.714 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.699+0000 7f26e1dc9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26dc09fca0 con 0x7f26dc09f870 2020-01-16T05:44:12.714 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.699+0000 7f26e1dc9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26dc125b20 con 0x7f26dc124610 2020-01-16T05:44:12.715 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.699+0000 7f26e1dc9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc0a8c00 con 0x7f26dc0a79a0 2020-01-16T05:44:12.715 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.699+0000 7f26e15c8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26dc124610 0x7f26dc0a7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.715 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.699+0000 7f26e15c8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26dc124610 0x7f26dc0a7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34402/0 (socket says 172.21.15.84:34402) 2020-01-16T05:44:12.715 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.699+0000 7f26e0dc7700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26dc0a79a0 0x7f26dc09f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.715 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.699+0000 7f26e15c8700 1 -- 172.21.15.84:0/327606007 learned_addr learned my addr 172.21.15.84:0/327606007 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:12.716 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26cdffb700 1 -- 172.21.15.84:0/327606007 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578559620 0 0) 0x7f26dc09fca0 con 0x7f26dc09f870 2020-01-16T05:44:12.716 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26cdffb700 1 -- 172.21.15.84:0/327606007 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26bc003230 con 0x7f26dc09f870 2020-01-16T05:44:12.716 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26e15c8700 1 -- 172.21.15.84:0/327606007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26dc0a79a0 msgr2=0x7f26dc09f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.716 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26e15c8700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26dc0a79a0 0x7f26dc09f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.716 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26e15c8700 1 -- 172.21.15.84:0/327606007 >> v1:172.21.15.142:6789/0 conn(0x7f26dc09f870 legacy=0x7f26dc135060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.717 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26e15c8700 1 -- 172.21.15.84:0/327606007 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc0a9140 con 0x7f26dc124610 2020-01-16T05:44:12.717 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26e0dc7700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26dc0a79a0 0x7f26dc09f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:12.717 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26e15c8700 1 --2- 172.21.15.84:0/327606007 >> v2:172.21.15.84:3300/0 conn(0x7f26dc124610 0x7f26dc0a7450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26d0000ed0 tx=0x7f26d000c4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.717 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26e15c8700 1 --2- 172.21.15.84:0/327606007 >> v2:172.21.15.84:3300/0 conn(0x7f26dc124610 0x7f26dc0a7450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26d0000ed0 tx=0x7f26d000c4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.717 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26e15c8700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26dc124610 0x7f26dc0a7450 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f26d0000ed0 tx=0x7f26d000c4c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:12.718 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26e15c8700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26dc124610 0x7f26dc0a7450 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f26d0000ed0 tx=0x7f26d000c4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.718 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26cdffb700 1 -- 172.21.15.84:0/327606007 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26d000cc20 con 0x7f26dc124610 2020-01-16T05:44:12.718 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26e15c8700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26dc124610 0x7f26dc0a7450 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f26d0000ed0 tx=0x7f26d000c4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.718 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26cdffb700 1 -- 172.21.15.84:0/327606007 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d000c840 con 0x7f26dc124610 2020-01-16T05:44:12.718 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26e15c8700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26dc124610 0x7f26dc0a7450 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f26d0000ed0 tx=0x7f26d000c4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.718 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26cdffb700 1 -- 172.21.15.84:0/327606007 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26d00124c0 con 0x7f26dc124610 2020-01-16T05:44:12.718 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26e1dc9700 1 -- 172.21.15.84:0/327606007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26dc066220 con 0x7f26dc124610 2020-01-16T05:44:12.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26e1dc9700 1 -- 172.21.15.84:0/327606007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26dc0a6ff0 con 0x7f26dc124610 2020-01-16T05:44:12.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26e15c8700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26dc124610 0x7f26dc0a7450 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f26d0000ed0 tx=0x7f26d000c4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26cdffb700 1 -- 172.21.15.84:0/327606007 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f26d00127a0 con 0x7f26dc124610 2020-01-16T05:44:12.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26e15c8700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26dc124610 0x7f26dc0a7450 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f26d0000ed0 tx=0x7f26d000c4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26cdffb700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f26bc03c800 0x7f26bc03ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:12.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26cdffb700 1 -- 172.21.15.84:0/327606007 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f26d004c720 con 0x7f26dc124610 2020-01-16T05:44:12.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26e1dc9700 1 -- 172.21.15.84:0/327606007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26dc025440 con 0x7f26dc124610 2020-01-16T05:44:12.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26e0dc7700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f26bc03c800 0x7f26bc03ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.703+0000 7f26e0dc7700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f26bc03c800 0x7f26bc03ed10 crc :-1 s=READY pgs=71 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:12.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.707+0000 7f26e15c8700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26dc124610 0x7f26dc0a7450 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f26d0000ed0 tx=0x7f26d000c4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.707+0000 7f26cdffb700 1 -- 172.21.15.84:0/327606007 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f26d0032d20 con 0x7f26dc124610 2020-01-16T05:44:12.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.827+0000 7f26e1dc9700 1 -- 172.21.15.84:0/327606007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f26dc05e1c0 con 0x7f26dc124610 2020-01-16T05:44:12.831 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.831+0000 7f26e15c8700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26dc124610 0x7f26dc0a7450 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f26d0000ed0 tx=0x7f26d000c4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.831 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.831+0000 7f26cdffb700 1 -- 172.21.15.84:0/327606007 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f26d0032f80 con 0x7f26dc124610 2020-01-16T05:44:12.831 INFO:teuthology.orchestra.run.smithi084.stdout:60129542152 2020-01-16T05:44:12.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.831+0000 7f26e1dc9700 1 -- 172.21.15.84:0/327606007 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f26bc03c800 msgr2=0x7f26bc03ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.833 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.831+0000 7f26e1dc9700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f26bc03c800 0x7f26bc03ed10 crc :-1 s=READY pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.833 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.831+0000 7f26e1dc9700 1 -- 172.21.15.84:0/327606007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26dc124610 msgr2=0x7f26dc0a7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.833 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.831+0000 7f26e1dc9700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26dc124610 0x7f26dc0a7450 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f26d0000ed0 tx=0x7f26d000c4c0).stop 2020-01-16T05:44:12.833 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.831+0000 7f26e1dc9700 1 -- 172.21.15.84:0/327606007 shutdown_connections 2020-01-16T05:44:12.834 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.831+0000 7f26e1dc9700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f26bc03c800 0x7f26bc03ed10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.834 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.831+0000 7f26e1dc9700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26dc124610 0x7f26dc0a7450 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.834 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.831+0000 7f26e1dc9700 1 --2- 172.21.15.84:0/327606007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26dc0a79a0 0x7f26dc09f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.834 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.831+0000 7f26e1dc9700 1 -- 172.21.15.84:0/327606007 shutdown_connections 2020-01-16T05:44:12.834 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.831+0000 7f26e1dc9700 1 -- 172.21.15.84:0/327606007 wait complete. 2020-01-16T05:44:12.834 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.831+0000 7f26e1dc9700 1 -- 172.21.15.84:0/327606007 >> 172.21.15.84:0/327606007 conn(0x7f26dc0a9b30 msgr2=0x7f26dc126f20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:12.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542152 for osd.7 2020-01-16T05:44:12.845 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-01-16T05:44:12.845 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-01-16T05:44:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e60cb8700 1 Processor -- start 2020-01-16T05:44:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e60cb8700 1 -- start start 2020-01-16T05:44:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e60cb8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3e5c0a9b30 0x7f3e5c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e60cb8700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3e5c07ff10 0x7f3e5c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e60cb8700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5c066dd0 con 0x7f3e5c0a4250 2020-01-16T05:44:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e60cb8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5c0a4830 con 0x7f3e5c0a9b30 2020-01-16T05:44:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e60cb8700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5c07f9d0 con 0x7f3e5c07ff10 2020-01-16T05:44:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e5bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3e5c0a9b30 0x7f3e5c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e5bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3e5c0a9b30 0x7f3e5c0abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34408/0 (socket says 172.21.15.84:34408) 2020-01-16T05:44:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e5bfff700 1 -- 172.21.15.84:0/2533828503 learned_addr learned my addr 172.21.15.84:0/2533828503 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:12.976 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e5b7fe700 1 --2- 172.21.15.84:0/2533828503 >> v2:172.21.15.142:3300/0 conn(0x7f3e5c07ff10 0x7f3e5c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.976 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e5bfff700 1 -- 172.21.15.84:0/2533828503 >> v2:172.21.15.142:3300/0 conn(0x7f3e5c07ff10 msgr2=0x7f3e5c066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:12.976 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e5bfff700 1 --2- 172.21.15.84:0/2533828503 >> v2:172.21.15.142:3300/0 conn(0x7f3e5c07ff10 0x7f3e5c066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e5bfff700 1 -- 172.21.15.84:0/2533828503 >> v1:172.21.15.142:6789/0 conn(0x7f3e5c0a4250 legacy=0x7f3e5c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e5bfff700 1 -- 172.21.15.84:0/2533828503 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c150ce0 con 0x7f3e5c0a9b30 2020-01-16T05:44:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e5bfff700 1 --2- 172.21.15.84:0/2533828503 >> v2:172.21.15.84:3300/0 conn(0x7f3e5c0a9b30 0x7f3e5c0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3e5c0a49f0 tx=0x7f3e4c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e5bfff700 1 --2- 172.21.15.84:0/2533828503 >> v2:172.21.15.84:3300/0 conn(0x7f3e5c0a9b30 0x7f3e5c0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3e5c0a49f0 tx=0x7f3e4c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e5bfff700 1 --2- 172.21.15.84:0/2533828503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e5c0a9b30 0x7f3e5c0abdd0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f3e5c0a49f0 tx=0x7f3e4c00feb0).ready entity=mon.0 client_cookie=52314216770ff8e9 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:12.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e5bfff700 1 --2- 172.21.15.84:0/2533828503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e5c0a9b30 0x7f3e5c0abdd0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f3e5c0a49f0 tx=0x7f3e4c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e5affd700 1 -- 172.21.15.84:0/2533828503 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e4c0116e0 con 0x7f3e5c0a9b30 2020-01-16T05:44:12.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e5bfff700 1 --2- 172.21.15.84:0/2533828503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e5c0a9b30 0x7f3e5c0abdd0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f3e5c0a49f0 tx=0x7f3e4c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e5bfff700 1 --2- 172.21.15.84:0/2533828503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e5c0a9b30 0x7f3e5c0abdd0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f3e5c0a49f0 tx=0x7f3e4c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.983 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e5affd700 1 -- 172.21.15.84:0/2533828503 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c008d30 con 0x7f3e5c0a9b30 2020-01-16T05:44:12.983 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e5affd700 1 -- 172.21.15.84:0/2533828503 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e4c011cc0 con 0x7f3e5c0a9b30 2020-01-16T05:44:12.983 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e60cb8700 1 -- 172.21.15.84:0/2533828503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e5c0a9b30 msgr2=0x7f3e5c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.983 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e60cb8700 1 --2- 172.21.15.84:0/2533828503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e5c0a9b30 0x7f3e5c0abdd0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f3e5c0a49f0 tx=0x7f3e4c00feb0).stop 2020-01-16T05:44:12.983 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e60cb8700 1 -- 172.21.15.84:0/2533828503 shutdown_connections 2020-01-16T05:44:12.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e60cb8700 1 --2- 172.21.15.84:0/2533828503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e5c0a9b30 0x7f3e5c0abdd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e60cb8700 1 --2- 172.21.15.84:0/2533828503 >> v2:172.21.15.142:3300/0 conn(0x7f3e5c07ff10 0x7f3e5c066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:12.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e60cb8700 1 -- 172.21.15.84:0/2533828503 shutdown_connections 2020-01-16T05:44:12.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e60cb8700 1 -- 172.21.15.84:0/2533828503 wait complete. 2020-01-16T05:44:12.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.955+0000 7f3e60cb8700 1 -- 172.21.15.84:0/2533828503 >> 172.21.15.84:0/2533828503 conn(0x7f3e5c0acfc0 msgr2=0x7f3e5c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:12.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e60cb8700 1 Processor -- start 2020-01-16T05:44:12.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e60cb8700 1 -- start start 2020-01-16T05:44:12.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e60cb8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3e5c1274b0 0x7f3e5c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:12.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e60cb8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e5c0a2450 0x7f3e5c0a2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:12.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e60cb8700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5c09f9b0 con 0x7f3e5c0a9270 2020-01-16T05:44:12.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e60cb8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5c0a21b0 con 0x7f3e5c1274b0 2020-01-16T05:44:12.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e60cb8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c07c390 con 0x7f3e5c0a2450 2020-01-16T05:44:12.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e5bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3e5c1274b0 0x7f3e5c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e5bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3e5c1274b0 0x7f3e5c0a1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34414/0 (socket says 172.21.15.84:34414) 2020-01-16T05:44:12.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e5bfff700 1 -- 172.21.15.84:0/229859062 learned_addr learned my addr 172.21.15.84:0/229859062 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:12.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e61f1a700 1 --2- 172.21.15.84:0/229859062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e5c0a2450 0x7f3e5c0a2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e5bfff700 1 -- 172.21.15.84:0/229859062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e5c0a2450 msgr2=0x7f3e5c0a2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e5bfff700 1 --2- 172.21.15.84:0/229859062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e5c0a2450 0x7f3e5c0a2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:12.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e5bfff700 1 -- 172.21.15.84:0/229859062 >> v1:172.21.15.142:6789/0 conn(0x7f3e5c0a9270 legacy=0x7f3e5c07bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:12.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e5bfff700 1 -- 172.21.15.84:0/229859062 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c0a2dd0 con 0x7f3e5c1274b0 2020-01-16T05:44:12.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e5bfff700 1 --2- 172.21.15.84:0/229859062 >> v2:172.21.15.84:3300/0 conn(0x7f3e5c1274b0 0x7f3e5c0a1af0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e5c0a49f0 tx=0x7f3e4c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e5bfff700 1 --2- 172.21.15.84:0/229859062 >> v2:172.21.15.84:3300/0 conn(0x7f3e5c1274b0 0x7f3e5c0a1af0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e5c0a49f0 tx=0x7f3e4c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e5bfff700 1 --2- 172.21.15.84:0/229859062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e5c1274b0 0x7f3e5c0a1af0 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7f3e5c0a49f0 tx=0x7f3e4c0117a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:12.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e5bfff700 1 --2- 172.21.15.84:0/229859062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e5c1274b0 0x7f3e5c0a1af0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f3e5c0a49f0 tx=0x7f3e4c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e58ff9700 1 -- 172.21.15.84:0/229859062 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e4c007340 con 0x7f3e5c1274b0 2020-01-16T05:44:12.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e5bfff700 1 --2- 172.21.15.84:0/229859062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e5c1274b0 0x7f3e5c0a1af0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f3e5c0a49f0 tx=0x7f3e4c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e58ff9700 1 -- 172.21.15.84:0/229859062 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c0118e0 con 0x7f3e5c1274b0 2020-01-16T05:44:12.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e60cb8700 1 -- 172.21.15.84:0/229859062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e5c0a03f0 con 0x7f3e5c1274b0 2020-01-16T05:44:12.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e5bfff700 1 --2- 172.21.15.84:0/229859062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e5c1274b0 0x7f3e5c0a1af0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f3e5c0a49f0 tx=0x7f3e4c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e58ff9700 1 -- 172.21.15.84:0/229859062 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e4c0056c0 con 0x7f3e5c1274b0 2020-01-16T05:44:12.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e60cb8700 1 -- 172.21.15.84:0/229859062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5c13c290 con 0x7f3e5c1274b0 2020-01-16T05:44:12.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.959+0000 7f3e5bfff700 1 --2- 172.21.15.84:0/229859062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e5c1274b0 0x7f3e5c0a1af0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f3e5c0a49f0 tx=0x7f3e4c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.963+0000 7f3e60cb8700 1 -- 172.21.15.84:0/229859062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5c05e1c0 con 0x7f3e5c1274b0 2020-01-16T05:44:12.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.963+0000 7f3e58ff9700 1 -- 172.21.15.84:0/229859062 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f3e4c0059e0 con 0x7f3e5c1274b0 2020-01-16T05:44:12.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.963+0000 7f3e5bfff700 1 --2- 172.21.15.84:0/229859062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e5c1274b0 0x7f3e5c0a1af0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f3e5c0a49f0 tx=0x7f3e4c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.963+0000 7f3e58ff9700 1 --2- 172.21.15.84:0/229859062 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3e3403c220 0x7f3e3403e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:12.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.963+0000 7f3e58ff9700 1 -- 172.21.15.84:0/229859062 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f3e4c04cf20 con 0x7f3e5c1274b0 2020-01-16T05:44:12.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.963+0000 7f3e5b7fe700 1 --2- 172.21.15.84:0/229859062 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3e3403c220 0x7f3e3403e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:12.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.963+0000 7f3e5b7fe700 1 --2- 172.21.15.84:0/229859062 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3e3403c220 0x7f3e3403e730 crc :-1 s=READY pgs=72 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:12.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.967+0000 7f3e5bfff700 1 --2- 172.21.15.84:0/229859062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e5c1274b0 0x7f3e5c0a1af0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f3e5c0a49f0 tx=0x7f3e4c0117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:12.990 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:12.967+0000 7f3e58ff9700 1 -- 172.21.15.84:0/229859062 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f3e4c033520 con 0x7f3e5c1274b0 2020-01-16T05:44:13.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.083+0000 7f3e60cb8700 1 -- 172.21.15.84:0/229859062 --> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3e5c0a65a0 con 0x7f3e3403c220 2020-01-16T05:44:13.095 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.091+0000 7f3e58ff9700 1 -- 172.21.15.84:0/229859062 <== mgr.4104 v2:172.21.15.84:6800/12486 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66283 (crc 0 0 0) 0x7f3e5c0a65a0 con 0x7f3e3403c220 2020-01-16T05:44:13.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.091+0000 7f3e60cb8700 1 -- 172.21.15.84:0/229859062 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3e3403c220 msgr2=0x7f3e3403e730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.091+0000 7f3e60cb8700 1 --2- 172.21.15.84:0/229859062 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3e3403c220 0x7f3e3403e730 crc :-1 s=READY pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.091+0000 7f3e60cb8700 1 -- 172.21.15.84:0/229859062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e5c1274b0 msgr2=0x7f3e5c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.091+0000 7f3e60cb8700 1 --2- 172.21.15.84:0/229859062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e5c1274b0 0x7f3e5c0a1af0 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7f3e5c0a49f0 tx=0x7f3e4c0117a0).stop 2020-01-16T05:44:13.097 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.091+0000 7f3e60cb8700 1 -- 172.21.15.84:0/229859062 shutdown_connections 2020-01-16T05:44:13.097 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.091+0000 7f3e60cb8700 1 --2- 172.21.15.84:0/229859062 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3e3403c220 0x7f3e3403e730 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.098 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.091+0000 7f3e60cb8700 1 --2- 172.21.15.84:0/229859062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e5c0a2450 0x7f3e5c0a2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.098 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.091+0000 7f3e60cb8700 1 --2- 172.21.15.84:0/229859062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e5c1274b0 0x7f3e5c0a1af0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.098 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.091+0000 7f3e60cb8700 1 -- 172.21.15.84:0/229859062 shutdown_connections 2020-01-16T05:44:13.098 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.091+0000 7f3e60cb8700 1 -- 172.21.15.84:0/229859062 wait complete. 2020-01-16T05:44:13.099 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.091+0000 7f3e60cb8700 1 -- 172.21.15.84:0/229859062 >> 172.21.15.84:0/229859062 conn(0x7f3e5c0a9b30 msgr2=0x7f3e5c0a5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:13.099 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2020-01-16T05:44:13.099 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:13.107 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2020-01-16T05:44:12.474786+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390688,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584032,"statfs":{"total":773094113280,"available":764502048768,"internally_reserved":8589934592,"allocated":2064384,"data_stored":726356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":760,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001325"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071093+0000","last_change":"2020-01-16T05:44:03.942686+0000","last_active":"2020-01-16T05:44:05.071093+0000","last_peered":"2020-01-16T05:44:05.071093+0000","last_clean":"2020-01-16T05:44:05.071093+0000","last_became_active":"2020-01-16T05:44:03.942333+0000","last_became_peered":"2020-01-16T05:44:03.942333+0000","last_unstale":"2020-01-16T05:44:05.071093+0000","last_undegraded":"2020-01-16T05:44:05.071093+0000","last_fullsized":"2020-01-16T05:44:05.071093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.949151+0000","last_change":"2020-01-16T05:44:00.598349+0000","last_active":"2020-01-16T05:44:04.949151+0000","last_peered":"2020-01-16T05:44:04.949151+0000","last_clean":"2020-01-16T05:44:04.949151+0000","last_became_active":"2020-01-16T05:44:00.597979+0000","last_became_peered":"2020-01-16T05:44:00.597979+0000","last_unstale":"2020-01-16T05:44:04.949151+0000","last_undegraded":"2020-01-16T05:44:04.949151+0000","last_fullsized":"2020-01-16T05:44:04.949151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'4","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.539081+0000","last_change":"2020-01-16T05:44:03.633337+0000","last_active":"2020-01-16T05:44:06.539081+0000","last_peered":"2020-01-16T05:44:06.539081+0000","last_clean":"2020-01-16T05:44:06.539081+0000","last_became_active":"2020-01-16T05:44:03.632748+0000","last_became_peered":"2020-01-16T05:44:03.632748+0000","last_unstale":"2020-01-16T05:44:06.539081+0000","last_undegraded":"2020-01-16T05:44:06.539081+0000","last_fullsized":"2020-01-16T05:44:06.539081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.953067+0000","last_change":"2020-01-16T05:44:04.952513+0000","last_active":"2020-01-16T05:44:04.953067+0000","last_peered":"2020-01-16T05:44:04.953067+0000","last_clean":"2020-01-16T05:44:04.953067+0000","last_became_active":"2020-01-16T05:44:04.952051+0000","last_became_peered":"2020-01-16T05:44:04.952051+0000","last_unstale":"2020-01-16T05:44:04.953067+0000","last_undegraded":"2020-01-16T05:44:04.953067+0000","last_fullsized":"2020-01-16T05:44:04.953067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071065+0000","last_change":"2020-01-16T05:44:00.597063+0000","last_active":"2020-01-16T05:44:05.071065+0000","last_peered":"2020-01-16T05:44:05.071065+0000","last_clean":"2020-01-16T05:44:05.071065+0000","last_became_active":"2020-01-16T05:44:00.596565+0000","last_became_peered":"2020-01-16T05:44:00.596565+0000","last_unstale":"2020-01-16T05:44:05.071065+0000","last_undegraded":"2020-01-16T05:44:05.071065+0000","last_fullsized":"2020-01-16T05:44:05.071065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'7","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.542445+0000","last_change":"2020-01-16T05:44:03.632507+0000","last_active":"2020-01-16T05:44:06.542445+0000","last_peered":"2020-01-16T05:44:06.542445+0000","last_clean":"2020-01-16T05:44:06.542445+0000","last_became_active":"2020-01-16T05:44:03.632098+0000","last_became_peered":"2020-01-16T05:44:03.632098+0000","last_unstale":"2020-01-16T05:44:06.542445+0000","last_undegraded":"2020-01-16T05:44:06.542445+0000","last_fullsized":"2020-01-16T05:44:06.542445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.953441+0000","last_change":"2020-01-16T05:44:04.953106+0000","last_active":"2020-01-16T05:44:04.953441+0000","last_peered":"2020-01-16T05:44:04.953441+0000","last_clean":"2020-01-16T05:44:04.953441+0000","last_became_active":"2020-01-16T05:44:04.952727+0000","last_became_peered":"2020-01-16T05:44:04.952727+0000","last_unstale":"2020-01-16T05:44:04.953441+0000","last_undegraded":"2020-01-16T05:44:04.953441+0000","last_fullsized":"2020-01-16T05:44:04.953441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946717+0000","last_change":"2020-01-16T05:44:00.596549+0000","last_active":"2020-01-16T05:44:04.946717+0000","last_peered":"2020-01-16T05:44:04.946717+0000","last_clean":"2020-01-16T05:44:04.946717+0000","last_became_active":"2020-01-16T05:44:00.596161+0000","last_became_peered":"2020-01-16T05:44:00.596161+0000","last_unstale":"2020-01-16T05:44:04.946717+0000","last_undegraded":"2020-01-16T05:44:04.946717+0000","last_fullsized":"2020-01-16T05:44:04.946717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"24'8","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.542801+0000","last_change":"2020-01-16T05:44:03.634762+0000","last_active":"2020-01-16T05:44:06.542801+0000","last_peered":"2020-01-16T05:44:06.542801+0000","last_clean":"2020-01-16T05:44:06.542801+0000","last_became_active":"2020-01-16T05:44:03.634363+0000","last_became_peered":"2020-01-16T05:44:03.634363+0000","last_unstale":"2020-01-16T05:44:06.542801+0000","last_undegraded":"2020-01-16T05:44:06.542801+0000","last_fullsized":"2020-01-16T05:44:06.542801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.947002+0000","last_change":"2020-01-16T05:44:03.945012+0000","last_active":"2020-01-16T05:44:04.947002+0000","last_peered":"2020-01-16T05:44:04.947002+0000","last_clean":"2020-01-16T05:44:04.947002+0000","last_became_active":"2020-01-16T05:44:03.943844+0000","last_became_peered":"2020-01-16T05:44:03.943844+0000","last_unstale":"2020-01-16T05:44:04.947002+0000","last_undegraded":"2020-01-16T05:44:04.947002+0000","last_fullsized":"2020-01-16T05:44:04.947002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.072178+0000","last_change":"2020-01-16T05:44:00.670887+0000","last_active":"2020-01-16T05:44:05.072178+0000","last_peered":"2020-01-16T05:44:05.072178+0000","last_clean":"2020-01-16T05:44:05.072178+0000","last_became_active":"2020-01-16T05:44:00.670249+0000","last_became_peered":"2020-01-16T05:44:00.670249+0000","last_unstale":"2020-01-16T05:44:05.072178+0000","last_undegraded":"2020-01-16T05:44:05.072178+0000","last_fullsized":"2020-01-16T05:44:05.072178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071522+0000","last_change":"2020-01-16T05:44:03.631816+0000","last_active":"2020-01-16T05:44:05.071522+0000","last_peered":"2020-01-16T05:44:05.071522+0000","last_clean":"2020-01-16T05:44:05.071522+0000","last_became_active":"2020-01-16T05:44:03.631369+0000","last_became_peered":"2020-01-16T05:44:03.631369+0000","last_unstale":"2020-01-16T05:44:05.071522+0000","last_undegraded":"2020-01-16T05:44:05.071522+0000","last_fullsized":"2020-01-16T05:44:05.071522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071217+0000","last_change":"2020-01-16T05:44:03.944993+0000","last_active":"2020-01-16T05:44:05.071217+0000","last_peered":"2020-01-16T05:44:05.071217+0000","last_clean":"2020-01-16T05:44:05.071217+0000","last_became_active":"2020-01-16T05:44:03.944613+0000","last_became_peered":"2020-01-16T05:44:03.944613+0000","last_unstale":"2020-01-16T05:44:05.071217+0000","last_undegraded":"2020-01-16T05:44:05.071217+0000","last_fullsized":"2020-01-16T05:44:05.071217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.072173+0000","last_change":"2020-01-16T05:44:00.670906+0000","last_active":"2020-01-16T05:44:05.072173+0000","last_peered":"2020-01-16T05:44:05.072173+0000","last_clean":"2020-01-16T05:44:05.072173+0000","last_became_active":"2020-01-16T05:44:00.670248+0000","last_became_peered":"2020-01-16T05:44:00.670248+0000","last_unstale":"2020-01-16T05:44:05.072173+0000","last_undegraded":"2020-01-16T05:44:05.072173+0000","last_fullsized":"2020-01-16T05:44:05.072173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"24'5","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.538666+0000","last_change":"2020-01-16T05:44:03.631549+0000","last_active":"2020-01-16T05:44:06.538666+0000","last_peered":"2020-01-16T05:44:06.538666+0000","last_clean":"2020-01-16T05:44:06.538666+0000","last_became_active":"2020-01-16T05:44:03.630553+0000","last_became_peered":"2020-01-16T05:44:03.630553+0000","last_unstale":"2020-01-16T05:44:06.538666+0000","last_undegraded":"2020-01-16T05:44:06.538666+0000","last_fullsized":"2020-01-16T05:44:06.538666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.954205+0000","last_change":"2020-01-16T05:44:04.953780+0000","last_active":"2020-01-16T05:44:04.954205+0000","last_peered":"2020-01-16T05:44:04.954205+0000","last_clean":"2020-01-16T05:44:04.954205+0000","last_became_active":"2020-01-16T05:44:04.952922+0000","last_became_peered":"2020-01-16T05:44:04.952922+0000","last_unstale":"2020-01-16T05:44:04.954205+0000","last_undegraded":"2020-01-16T05:44:04.954205+0000","last_fullsized":"2020-01-16T05:44:04.954205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946768+0000","last_change":"2020-01-16T05:44:00.668880+0000","last_active":"2020-01-16T05:44:04.946768+0000","last_peered":"2020-01-16T05:44:04.946768+0000","last_clean":"2020-01-16T05:44:04.946768+0000","last_became_active":"2020-01-16T05:44:00.668292+0000","last_became_peered":"2020-01-16T05:44:00.668292+0000","last_unstale":"2020-01-16T05:44:04.946768+0000","last_undegraded":"2020-01-16T05:44:04.946768+0000","last_fullsized":"2020-01-16T05:44:04.946768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:05.949358+0000","last_change":"2020-01-16T05:44:03.633445+0000","last_active":"2020-01-16T05:44:05.949358+0000","last_peered":"2020-01-16T05:44:05.949358+0000","last_clean":"2020-01-16T05:44:05.949358+0000","last_became_active":"2020-01-16T05:44:03.633080+0000","last_became_peered":"2020-01-16T05:44:03.633080+0000","last_unstale":"2020-01-16T05:44:05.949358+0000","last_undegraded":"2020-01-16T05:44:05.949358+0000","last_fullsized":"2020-01-16T05:44:05.949358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946675+0000","last_change":"2020-01-16T05:44:03.943418+0000","last_active":"2020-01-16T05:44:04.946675+0000","last_peered":"2020-01-16T05:44:04.946675+0000","last_clean":"2020-01-16T05:44:04.946675+0000","last_became_active":"2020-01-16T05:44:03.943039+0000","last_became_peered":"2020-01-16T05:44:03.943039+0000","last_unstale":"2020-01-16T05:44:04.946675+0000","last_undegraded":"2020-01-16T05:44:04.946675+0000","last_fullsized":"2020-01-16T05:44:04.946675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946567+0000","last_change":"2020-01-16T05:44:00.670445+0000","last_active":"2020-01-16T05:44:04.946567+0000","last_peered":"2020-01-16T05:44:04.946567+0000","last_clean":"2020-01-16T05:44:04.946567+0000","last_became_active":"2020-01-16T05:44:00.670082+0000","last_became_peered":"2020-01-16T05:44:00.670082+0000","last_unstale":"2020-01-16T05:44:04.946567+0000","last_undegraded":"2020-01-16T05:44:04.946567+0000","last_fullsized":"2020-01-16T05:44:04.946567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"24'6","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.540786+0000","last_change":"2020-01-16T05:44:03.942740+0000","last_active":"2020-01-16T05:44:06.540786+0000","last_peered":"2020-01-16T05:44:06.540786+0000","last_clean":"2020-01-16T05:44:06.540786+0000","last_became_active":"2020-01-16T05:44:03.942316+0000","last_became_peered":"2020-01-16T05:44:03.942316+0000","last_unstale":"2020-01-16T05:44:06.540786+0000","last_undegraded":"2020-01-16T05:44:06.540786+0000","last_fullsized":"2020-01-16T05:44:06.540786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946887+0000","last_change":"2020-01-16T05:44:03.944413+0000","last_active":"2020-01-16T05:44:04.946887+0000","last_peered":"2020-01-16T05:44:04.946887+0000","last_clean":"2020-01-16T05:44:04.946887+0000","last_became_active":"2020-01-16T05:44:03.943334+0000","last_became_peered":"2020-01-16T05:44:03.943334+0000","last_unstale":"2020-01-16T05:44:04.946887+0000","last_undegraded":"2020-01-16T05:44:04.946887+0000","last_fullsized":"2020-01-16T05:44:04.946887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946988+0000","last_change":"2020-01-16T05:44:00.596442+0000","last_active":"2020-01-16T05:44:04.946988+0000","last_peered":"2020-01-16T05:44:04.946988+0000","last_clean":"2020-01-16T05:44:04.946988+0000","last_became_active":"2020-01-16T05:44:00.596082+0000","last_became_peered":"2020-01-16T05:44:00.596082+0000","last_unstale":"2020-01-16T05:44:04.946988+0000","last_undegraded":"2020-01-16T05:44:04.946988+0000","last_fullsized":"2020-01-16T05:44:04.946988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"24'8","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.902221+0000","last_change":"2020-01-16T05:44:03.945176+0000","last_active":"2020-01-16T05:44:06.902221+0000","last_peered":"2020-01-16T05:44:06.902221+0000","last_clean":"2020-01-16T05:44:06.902221+0000","last_became_active":"2020-01-16T05:44:03.944396+0000","last_became_peered":"2020-01-16T05:44:03.944396+0000","last_unstale":"2020-01-16T05:44:06.902221+0000","last_undegraded":"2020-01-16T05:44:06.902221+0000","last_fullsized":"2020-01-16T05:44:06.902221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":90949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":90257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":90223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":90223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":90789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":91909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":91749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":90257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}]}} 2020-01-16T05:44:13.112 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-01-16T05:44:13.227 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba68e4700 1 Processor -- start 2020-01-16T05:44:13.237 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba68e4700 1 -- start start 2020-01-16T05:44:13.237 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba68e4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba005b0f0 0x7f0ba00a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:13.237 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba68e4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0ba008fd80 0x7f0ba01503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:13.238 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba68e4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba007cd60 con 0x7f0ba00a2f60 2020-01-16T05:44:13.238 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba68e4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba00a3390 con 0x7f0ba008fd80 2020-01-16T05:44:13.238 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba68e4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba00905b0 con 0x7f0ba005b0f0 2020-01-16T05:44:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba4e81700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0ba00a2f60 0x7f0ba007c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51622/0 (socket says 172.21.15.84:51622) 2020-01-16T05:44:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba4e81700 1 -- 172.21.15.84:0/1946632964 learned_addr learned my addr 172.21.15.84:0/1946632964 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba5682700 1 --2- 172.21.15.84:0/1946632964 >> v2:172.21.15.84:3300/0 conn(0x7f0ba008fd80 0x7f0ba01503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0b9ffff700 1 --2- 172.21.15.84:0/1946632964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba005b0f0 0x7f0ba00a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0b9f7fe700 1 -- 172.21.15.84:0/1946632964 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676036339 0 0) 0x7f0ba007cd60 con 0x7f0ba00a2f60 2020-01-16T05:44:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0b9f7fe700 1 -- 172.21.15.84:0/1946632964 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b8c003230 con 0x7f0ba00a2f60 2020-01-16T05:44:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba5682700 1 -- 172.21.15.84:0/1946632964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba005b0f0 msgr2=0x7f0ba00a8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0b9f7fe700 1 -- 172.21.15.84:0/1946632964 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1793248454 0 0) 0x7f0b8c003230 con 0x7f0ba00a2f60 2020-01-16T05:44:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba5682700 1 --2- 172.21.15.84:0/1946632964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba005b0f0 0x7f0ba00a8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba5682700 1 -- 172.21.15.84:0/1946632964 >> v1:172.21.15.84:6789/0 conn(0x7f0ba00a2f60 legacy=0x7f0ba007c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba5682700 1 -- 172.21.15.84:0/1946632964 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba005b520 con 0x7f0ba008fd80 2020-01-16T05:44:13.241 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba5682700 1 --2- 172.21.15.84:0/1946632964 >> v2:172.21.15.84:3300/0 conn(0x7f0ba008fd80 0x7f0ba01503f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0b98001990 tx=0x7f0b980019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.241 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba5682700 1 --2- 172.21.15.84:0/1946632964 >> v2:172.21.15.84:3300/0 conn(0x7f0ba008fd80 0x7f0ba01503f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0b98001990 tx=0x7f0b980019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.241 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba5682700 1 --2- 172.21.15.84:0/1946632964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba008fd80 0x7f0ba01503f0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7f0b98001990 tx=0x7f0b980019d0).ready entity=mon.0 client_cookie=16560ee67e809ab1 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:13.242 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba5682700 1 --2- 172.21.15.84:0/1946632964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba008fd80 0x7f0ba01503f0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f0b98001990 tx=0x7f0b980019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.242 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0b9f7fe700 1 -- 172.21.15.84:0/1946632964 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b98001750 con 0x7f0ba008fd80 2020-01-16T05:44:13.242 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba5682700 1 --2- 172.21.15.84:0/1946632964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba008fd80 0x7f0ba01503f0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f0b98001990 tx=0x7f0b980019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.242 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0b9f7fe700 1 -- 172.21.15.84:0/1946632964 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b98001560 con 0x7f0ba008fd80 2020-01-16T05:44:13.242 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba5682700 1 --2- 172.21.15.84:0/1946632964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba008fd80 0x7f0ba01503f0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f0b98001990 tx=0x7f0b980019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.243 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba68e4700 1 -- 172.21.15.84:0/1946632964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba008fd80 msgr2=0x7f0ba01503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.243 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0b9f7fe700 1 -- 172.21.15.84:0/1946632964 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b9000a160 con 0x7f0ba008fd80 2020-01-16T05:44:13.243 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba68e4700 1 --2- 172.21.15.84:0/1946632964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba008fd80 0x7f0ba01503f0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7f0b98001990 tx=0x7f0b980019d0).stop 2020-01-16T05:44:13.243 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba68e4700 1 -- 172.21.15.84:0/1946632964 shutdown_connections 2020-01-16T05:44:13.243 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba68e4700 1 --2- 172.21.15.84:0/1946632964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba008fd80 0x7f0ba01503f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.243 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba68e4700 1 --2- 172.21.15.84:0/1946632964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba005b0f0 0x7f0ba00a8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:13.243 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba68e4700 1 -- 172.21.15.84:0/1946632964 shutdown_connections 2020-01-16T05:44:13.244 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba68e4700 1 -- 172.21.15.84:0/1946632964 wait complete. 2020-01-16T05:44:13.244 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.223+0000 7f0ba68e4700 1 -- 172.21.15.84:0/1946632964 >> 172.21.15.84:0/1946632964 conn(0x7f0ba00abc10 msgr2=0x7f0ba005a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:13.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.227+0000 7f0ba68e4700 1 Processor -- start 2020-01-16T05:44:13.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.227+0000 7f0ba68e4700 1 -- start start 2020-01-16T05:44:13.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.227+0000 7f0ba68e4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0ba0149920 0x7f0ba00a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:13.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0ba68e4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba009c020 0x7f0ba007ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:13.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0ba68e4700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba007bf80 con 0x7f0ba009c5a0 2020-01-16T05:44:13.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0ba68e4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba00a1d20 con 0x7f0ba0149920 2020-01-16T05:44:13.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0ba68e4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba01493e0 con 0x7f0ba009c020 2020-01-16T05:44:13.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0ba0149920 0x7f0ba00a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0ba0149920 0x7f0ba00a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34430/0 (socket says 172.21.15.84:34430) 2020-01-16T05:44:13.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9ffff700 1 -- 172.21.15.84:0/3060294306 learned_addr learned my addr 172.21.15.84:0/3060294306 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:13.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0ba5682700 1 --2- 172.21.15.84:0/3060294306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba009c020 0x7f0ba007ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9ffff700 1 -- 172.21.15.84:0/3060294306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba009c020 msgr2=0x7f0ba007ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.258 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9d7fa700 1 -- 172.21.15.84:0/3060294306 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943592670 0 0) 0x7f0ba007bf80 con 0x7f0ba009c5a0 2020-01-16T05:44:13.258 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9ffff700 1 --2- 172.21.15.84:0/3060294306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba009c020 0x7f0ba007ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.258 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9ffff700 1 -- 172.21.15.84:0/3060294306 >> v1:172.21.15.142:6789/0 conn(0x7f0ba009c5a0 legacy=0x7f0ba00999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.258 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9ffff700 1 -- 172.21.15.84:0/3060294306 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba0146c70 con 0x7f0ba0149920 2020-01-16T05:44:13.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0ba5682700 1 --2- 172.21.15.84:0/3060294306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba009c020 0x7f0ba007ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:13.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9ffff700 1 --2- 172.21.15.84:0/3060294306 >> v2:172.21.15.84:3300/0 conn(0x7f0ba0149920 0x7f0ba00a1710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ba00a1ee0 tx=0x7f0b88010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9ffff700 1 --2- 172.21.15.84:0/3060294306 >> v2:172.21.15.84:3300/0 conn(0x7f0ba0149920 0x7f0ba00a1710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ba00a1ee0 tx=0x7f0b88010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9ffff700 1 --2- 172.21.15.84:0/3060294306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba0149920 0x7f0ba00a1710 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f0ba00a1ee0 tx=0x7f0b88010df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:13.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9ffff700 1 --2- 172.21.15.84:0/3060294306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba0149920 0x7f0ba00a1710 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f0ba00a1ee0 tx=0x7f0b88010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9ffff700 1 --2- 172.21.15.84:0/3060294306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba0149920 0x7f0ba00a1710 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f0ba00a1ee0 tx=0x7f0b88010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9d7fa700 1 -- 172.21.15.84:0/3060294306 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b88007160 con 0x7f0ba0149920 2020-01-16T05:44:13.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9ffff700 1 --2- 172.21.15.84:0/3060294306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba0149920 0x7f0ba00a1710 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f0ba00a1ee0 tx=0x7f0b88010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9d7fa700 1 -- 172.21.15.84:0/3060294306 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b88005ab0 con 0x7f0ba0149920 2020-01-16T05:44:13.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0ba68e4700 1 -- 172.21.15.84:0/3060294306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba007c1b0 con 0x7f0ba0149920 2020-01-16T05:44:13.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9d7fa700 1 -- 172.21.15.84:0/3060294306 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b88012620 con 0x7f0ba0149920 2020-01-16T05:44:13.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0ba68e4700 1 -- 172.21.15.84:0/3060294306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba0138db0 con 0x7f0ba0149920 2020-01-16T05:44:13.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9ffff700 1 --2- 172.21.15.84:0/3060294306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba0149920 0x7f0ba00a1710 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f0ba00a1ee0 tx=0x7f0b88010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0ba68e4700 1 -- 172.21.15.84:0/3060294306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba005e1c0 con 0x7f0ba0149920 2020-01-16T05:44:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9d7fa700 1 -- 172.21.15.84:0/3060294306 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f0b88012930 con 0x7f0ba0149920 2020-01-16T05:44:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.231+0000 7f0b9ffff700 1 --2- 172.21.15.84:0/3060294306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba0149920 0x7f0ba00a1710 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f0ba00a1ee0 tx=0x7f0b88010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.235+0000 7f0b9d7fa700 1 --2- 172.21.15.84:0/3060294306 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0b8403c210 0x7f0b8403e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.235+0000 7f0b9d7fa700 1 -- 172.21.15.84:0/3060294306 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f0b8804cd10 con 0x7f0ba0149920 2020-01-16T05:44:13.264 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.235+0000 7f0ba4e81700 1 --2- 172.21.15.84:0/3060294306 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0b8403c210 0x7f0b8403e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.265 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.235+0000 7f0ba4e81700 1 --2- 172.21.15.84:0/3060294306 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0b8403c210 0x7f0b8403e720 crc :-1 s=READY pgs=73 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:13.266 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.239+0000 7f0b9ffff700 1 --2- 172.21.15.84:0/3060294306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba0149920 0x7f0ba00a1710 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f0ba00a1ee0 tx=0x7f0b88010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.266 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.239+0000 7f0b9d7fa700 1 -- 172.21.15.84:0/3060294306 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f0b88033590 con 0x7f0ba0149920 2020-01-16T05:44:13.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.355+0000 7f0ba68e4700 1 -- 172.21.15.84:0/3060294306 --> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0ba00a79f0 con 0x7f0b8403c210 2020-01-16T05:44:13.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.359+0000 7f0b9d7fa700 1 -- 172.21.15.84:0/3060294306 <== mgr.4104 v2:172.21.15.84:6800/12486 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66283 (crc 0 0 0) 0x7f0ba00a79f0 con 0x7f0b8403c210 2020-01-16T05:44:13.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.363+0000 7f0ba68e4700 1 -- 172.21.15.84:0/3060294306 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0b8403c210 msgr2=0x7f0b8403e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.363+0000 7f0ba68e4700 1 --2- 172.21.15.84:0/3060294306 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0b8403c210 0x7f0b8403e720 crc :-1 s=READY pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.363+0000 7f0ba68e4700 1 -- 172.21.15.84:0/3060294306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba0149920 msgr2=0x7f0ba00a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.363+0000 7f0ba68e4700 1 --2- 172.21.15.84:0/3060294306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba0149920 0x7f0ba00a1710 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f0ba00a1ee0 tx=0x7f0b88010df0).stop 2020-01-16T05:44:13.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.363+0000 7f0ba68e4700 1 -- 172.21.15.84:0/3060294306 shutdown_connections 2020-01-16T05:44:13.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.363+0000 7f0ba68e4700 1 --2- 172.21.15.84:0/3060294306 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0b8403c210 0x7f0b8403e720 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.363+0000 7f0ba68e4700 1 --2- 172.21.15.84:0/3060294306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba009c020 0x7f0ba007ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.363+0000 7f0ba68e4700 1 --2- 172.21.15.84:0/3060294306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba0149920 0x7f0ba00a1710 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.363+0000 7f0ba68e4700 1 -- 172.21.15.84:0/3060294306 shutdown_connections 2020-01-16T05:44:13.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.363+0000 7f0ba68e4700 1 -- 172.21.15.84:0/3060294306 wait complete. 2020-01-16T05:44:13.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.363+0000 7f0ba68e4700 1 -- 172.21.15.84:0/3060294306 >> 172.21.15.84:0/3060294306 conn(0x7f0ba00a8740 msgr2=0x7f0ba008fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:13.393 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2020-01-16T05:44:13.393 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:13.394 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2020-01-16T05:44:12.474786+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390688,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584032,"statfs":{"total":773094113280,"available":764502048768,"internally_reserved":8589934592,"allocated":2064384,"data_stored":726356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":760,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001325"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071093+0000","last_change":"2020-01-16T05:44:03.942686+0000","last_active":"2020-01-16T05:44:05.071093+0000","last_peered":"2020-01-16T05:44:05.071093+0000","last_clean":"2020-01-16T05:44:05.071093+0000","last_became_active":"2020-01-16T05:44:03.942333+0000","last_became_peered":"2020-01-16T05:44:03.942333+0000","last_unstale":"2020-01-16T05:44:05.071093+0000","last_undegraded":"2020-01-16T05:44:05.071093+0000","last_fullsized":"2020-01-16T05:44:05.071093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.949151+0000","last_change":"2020-01-16T05:44:00.598349+0000","last_active":"2020-01-16T05:44:04.949151+0000","last_peered":"2020-01-16T05:44:04.949151+0000","last_clean":"2020-01-16T05:44:04.949151+0000","last_became_active":"2020-01-16T05:44:00.597979+0000","last_became_peered":"2020-01-16T05:44:00.597979+0000","last_unstale":"2020-01-16T05:44:04.949151+0000","last_undegraded":"2020-01-16T05:44:04.949151+0000","last_fullsized":"2020-01-16T05:44:04.949151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'4","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.539081+0000","last_change":"2020-01-16T05:44:03.633337+0000","last_active":"2020-01-16T05:44:06.539081+0000","last_peered":"2020-01-16T05:44:06.539081+0000","last_clean":"2020-01-16T05:44:06.539081+0000","last_became_active":"2020-01-16T05:44:03.632748+0000","last_became_peered":"2020-01-16T05:44:03.632748+0000","last_unstale":"2020-01-16T05:44:06.539081+0000","last_undegraded":"2020-01-16T05:44:06.539081+0000","last_fullsized":"2020-01-16T05:44:06.539081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.953067+0000","last_change":"2020-01-16T05:44:04.952513+0000","last_active":"2020-01-16T05:44:04.953067+0000","last_peered":"2020-01-16T05:44:04.953067+0000","last_clean":"2020-01-16T05:44:04.953067+0000","last_became_active":"2020-01-16T05:44:04.952051+0000","last_became_peered":"2020-01-16T05:44:04.952051+0000","last_unstale":"2020-01-16T05:44:04.953067+0000","last_undegraded":"2020-01-16T05:44:04.953067+0000","last_fullsized":"2020-01-16T05:44:04.953067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071065+0000","last_change":"2020-01-16T05:44:00.597063+0000","last_active":"2020-01-16T05:44:05.071065+0000","last_peered":"2020-01-16T05:44:05.071065+0000","last_clean":"2020-01-16T05:44:05.071065+0000","last_became_active":"2020-01-16T05:44:00.596565+0000","last_became_peered":"2020-01-16T05:44:00.596565+0000","last_unstale":"2020-01-16T05:44:05.071065+0000","last_undegraded":"2020-01-16T05:44:05.071065+0000","last_fullsized":"2020-01-16T05:44:05.071065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'7","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.542445+0000","last_change":"2020-01-16T05:44:03.632507+0000","last_active":"2020-01-16T05:44:06.542445+0000","last_peered":"2020-01-16T05:44:06.542445+0000","last_clean":"2020-01-16T05:44:06.542445+0000","last_became_active":"2020-01-16T05:44:03.632098+0000","last_became_peered":"2020-01-16T05:44:03.632098+0000","last_unstale":"2020-01-16T05:44:06.542445+0000","last_undegraded":"2020-01-16T05:44:06.542445+0000","last_fullsized":"2020-01-16T05:44:06.542445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.953441+0000","last_change":"2020-01-16T05:44:04.953106+0000","last_active":"2020-01-16T05:44:04.953441+0000","last_peered":"2020-01-16T05:44:04.953441+0000","last_clean":"2020-01-16T05:44:04.953441+0000","last_became_active":"2020-01-16T05:44:04.952727+0000","last_became_peered":"2020-01-16T05:44:04.952727+0000","last_unstale":"2020-01-16T05:44:04.953441+0000","last_undegraded":"2020-01-16T05:44:04.953441+0000","last_fullsized":"2020-01-16T05:44:04.953441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946717+0000","last_change":"2020-01-16T05:44:00.596549+0000","last_active":"2020-01-16T05:44:04.946717+0000","last_peered":"2020-01-16T05:44:04.946717+0000","last_clean":"2020-01-16T05:44:04.946717+0000","last_became_active":"2020-01-16T05:44:00.596161+0000","last_became_peered":"2020-01-16T05:44:00.596161+0000","last_unstale":"2020-01-16T05:44:04.946717+0000","last_undegraded":"2020-01-16T05:44:04.946717+0000","last_fullsized":"2020-01-16T05:44:04.946717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"24'8","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.542801+0000","last_change":"2020-01-16T05:44:03.634762+0000","last_active":"2020-01-16T05:44:06.542801+0000","last_peered":"2020-01-16T05:44:06.542801+0000","last_clean":"2020-01-16T05:44:06.542801+0000","last_became_active":"2020-01-16T05:44:03.634363+0000","last_became_peered":"2020-01-16T05:44:03.634363+0000","last_unstale":"2020-01-16T05:44:06.542801+0000","last_undegraded":"2020-01-16T05:44:06.542801+0000","last_fullsized":"2020-01-16T05:44:06.542801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.947002+0000","last_change":"2020-01-16T05:44:03.945012+0000","last_active":"2020-01-16T05:44:04.947002+0000","last_peered":"2020-01-16T05:44:04.947002+0000","last_clean":"2020-01-16T05:44:04.947002+0000","last_became_active":"2020-01-16T05:44:03.943844+0000","last_became_peered":"2020-01-16T05:44:03.943844+0000","last_unstale":"2020-01-16T05:44:04.947002+0000","last_undegraded":"2020-01-16T05:44:04.947002+0000","last_fullsized":"2020-01-16T05:44:04.947002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.072178+0000","last_change":"2020-01-16T05:44:00.670887+0000","last_active":"2020-01-16T05:44:05.072178+0000","last_peered":"2020-01-16T05:44:05.072178+0000","last_clean":"2020-01-16T05:44:05.072178+0000","last_became_active":"2020-01-16T05:44:00.670249+0000","last_became_peered":"2020-01-16T05:44:00.670249+0000","last_unstale":"2020-01-16T05:44:05.072178+0000","last_undegraded":"2020-01-16T05:44:05.072178+0000","last_fullsized":"2020-01-16T05:44:05.072178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071522+0000","last_change":"2020-01-16T05:44:03.631816+0000","last_active":"2020-01-16T05:44:05.071522+0000","last_peered":"2020-01-16T05:44:05.071522+0000","last_clean":"2020-01-16T05:44:05.071522+0000","last_became_active":"2020-01-16T05:44:03.631369+0000","last_became_peered":"2020-01-16T05:44:03.631369+0000","last_unstale":"2020-01-16T05:44:05.071522+0000","last_undegraded":"2020-01-16T05:44:05.071522+0000","last_fullsized":"2020-01-16T05:44:05.071522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071217+0000","last_change":"2020-01-16T05:44:03.944993+0000","last_active":"2020-01-16T05:44:05.071217+0000","last_peered":"2020-01-16T05:44:05.071217+0000","last_clean":"2020-01-16T05:44:05.071217+0000","last_became_active":"2020-01-16T05:44:03.944613+0000","last_became_peered":"2020-01-16T05:44:03.944613+0000","last_unstale":"2020-01-16T05:44:05.071217+0000","last_undegraded":"2020-01-16T05:44:05.071217+0000","last_fullsized":"2020-01-16T05:44:05.071217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.072173+0000","last_change":"2020-01-16T05:44:00.670906+0000","last_active":"2020-01-16T05:44:05.072173+0000","last_peered":"2020-01-16T05:44:05.072173+0000","last_clean":"2020-01-16T05:44:05.072173+0000","last_became_active":"2020-01-16T05:44:00.670248+0000","last_became_peered":"2020-01-16T05:44:00.670248+0000","last_unstale":"2020-01-16T05:44:05.072173+0000","last_undegraded":"2020-01-16T05:44:05.072173+0000","last_fullsized":"2020-01-16T05:44:05.072173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"24'5","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.538666+0000","last_change":"2020-01-16T05:44:03.631549+0000","last_active":"2020-01-16T05:44:06.538666+0000","last_peered":"2020-01-16T05:44:06.538666+0000","last_clean":"2020-01-16T05:44:06.538666+0000","last_became_active":"2020-01-16T05:44:03.630553+0000","last_became_peered":"2020-01-16T05:44:03.630553+0000","last_unstale":"2020-01-16T05:44:06.538666+0000","last_undegraded":"2020-01-16T05:44:06.538666+0000","last_fullsized":"2020-01-16T05:44:06.538666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.954205+0000","last_change":"2020-01-16T05:44:04.953780+0000","last_active":"2020-01-16T05:44:04.954205+0000","last_peered":"2020-01-16T05:44:04.954205+0000","last_clean":"2020-01-16T05:44:04.954205+0000","last_became_active":"2020-01-16T05:44:04.952922+0000","last_became_peered":"2020-01-16T05:44:04.952922+0000","last_unstale":"2020-01-16T05:44:04.954205+0000","last_undegraded":"2020-01-16T05:44:04.954205+0000","last_fullsized":"2020-01-16T05:44:04.954205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946768+0000","last_change":"2020-01-16T05:44:00.668880+0000","last_active":"2020-01-16T05:44:04.946768+0000","last_peered":"2020-01-16T05:44:04.946768+0000","last_clean":"2020-01-16T05:44:04.946768+0000","last_became_active":"2020-01-16T05:44:00.668292+0000","last_became_peered":"2020-01-16T05:44:00.668292+0000","last_unstale":"2020-01-16T05:44:04.946768+0000","last_undegraded":"2020-01-16T05:44:04.946768+0000","last_fullsized":"2020-01-16T05:44:04.946768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:05.949358+0000","last_change":"2020-01-16T05:44:03.633445+0000","last_active":"2020-01-16T05:44:05.949358+0000","last_peered":"2020-01-16T05:44:05.949358+0000","last_clean":"2020-01-16T05:44:05.949358+0000","last_became_active":"2020-01-16T05:44:03.633080+0000","last_became_peered":"2020-01-16T05:44:03.633080+0000","last_unstale":"2020-01-16T05:44:05.949358+0000","last_undegraded":"2020-01-16T05:44:05.949358+0000","last_fullsized":"2020-01-16T05:44:05.949358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946675+0000","last_change":"2020-01-16T05:44:03.943418+0000","last_active":"2020-01-16T05:44:04.946675+0000","last_peered":"2020-01-16T05:44:04.946675+0000","last_clean":"2020-01-16T05:44:04.946675+0000","last_became_active":"2020-01-16T05:44:03.943039+0000","last_became_peered":"2020-01-16T05:44:03.943039+0000","last_unstale":"2020-01-16T05:44:04.946675+0000","last_undegraded":"2020-01-16T05:44:04.946675+0000","last_fullsized":"2020-01-16T05:44:04.946675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946567+0000","last_change":"2020-01-16T05:44:00.670445+0000","last_active":"2020-01-16T05:44:04.946567+0000","last_peered":"2020-01-16T05:44:04.946567+0000","last_clean":"2020-01-16T05:44:04.946567+0000","last_became_active":"2020-01-16T05:44:00.670082+0000","last_became_peered":"2020-01-16T05:44:00.670082+0000","last_unstale":"2020-01-16T05:44:04.946567+0000","last_undegraded":"2020-01-16T05:44:04.946567+0000","last_fullsized":"2020-01-16T05:44:04.946567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"24'6","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.540786+0000","last_change":"2020-01-16T05:44:03.942740+0000","last_active":"2020-01-16T05:44:06.540786+0000","last_peered":"2020-01-16T05:44:06.540786+0000","last_clean":"2020-01-16T05:44:06.540786+0000","last_became_active":"2020-01-16T05:44:03.942316+0000","last_became_peered":"2020-01-16T05:44:03.942316+0000","last_unstale":"2020-01-16T05:44:06.540786+0000","last_undegraded":"2020-01-16T05:44:06.540786+0000","last_fullsized":"2020-01-16T05:44:06.540786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946887+0000","last_change":"2020-01-16T05:44:03.944413+0000","last_active":"2020-01-16T05:44:04.946887+0000","last_peered":"2020-01-16T05:44:04.946887+0000","last_clean":"2020-01-16T05:44:04.946887+0000","last_became_active":"2020-01-16T05:44:03.943334+0000","last_became_peered":"2020-01-16T05:44:03.943334+0000","last_unstale":"2020-01-16T05:44:04.946887+0000","last_undegraded":"2020-01-16T05:44:04.946887+0000","last_fullsized":"2020-01-16T05:44:04.946887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946988+0000","last_change":"2020-01-16T05:44:00.596442+0000","last_active":"2020-01-16T05:44:04.946988+0000","last_peered":"2020-01-16T05:44:04.946988+0000","last_clean":"2020-01-16T05:44:04.946988+0000","last_became_active":"2020-01-16T05:44:00.596082+0000","last_became_peered":"2020-01-16T05:44:00.596082+0000","last_unstale":"2020-01-16T05:44:04.946988+0000","last_undegraded":"2020-01-16T05:44:04.946988+0000","last_fullsized":"2020-01-16T05:44:04.946988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"24'8","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.902221+0000","last_change":"2020-01-16T05:44:03.945176+0000","last_active":"2020-01-16T05:44:06.902221+0000","last_peered":"2020-01-16T05:44:06.902221+0000","last_clean":"2020-01-16T05:44:06.902221+0000","last_became_active":"2020-01-16T05:44:03.944396+0000","last_became_peered":"2020-01-16T05:44:03.944396+0000","last_unstale":"2020-01-16T05:44:06.902221+0000","last_undegraded":"2020-01-16T05:44:06.902221+0000","last_fullsized":"2020-01-16T05:44:06.902221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":90949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":90257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":90223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":90223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":90789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":91909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":91749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":90257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}]}} 2020-01-16T05:44:13.398 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-01-16T05:44:13.398 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-01-16T05:44:13.398 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-01-16T05:44:13.398 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-16T05:44:13.511 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5bfdb700 1 Processor -- start 2020-01-16T05:44:13.512 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5bfdb700 1 -- start start 2020-01-16T05:44:13.512 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5bfdb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad540a2f60 0x7fad5405b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:13.512 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5bfdb700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fad540a8ff0 0x7fad5408fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:13.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5bfdb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad5407c560 0x7fad5407c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:13.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5bfdb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad540a3390 con 0x7fad540a2f60 2020-01-16T05:44:13.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5bfdb700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad540905b0 con 0x7fad540a8ff0 2020-01-16T05:44:13.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5bfdb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad540a2a20 con 0x7fad5407c560 2020-01-16T05:44:13.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5a578700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad540a2f60 0x7fad5405b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5a578700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad540a2f60 0x7fad5405b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34438/0 (socket says 172.21.15.84:34438) 2020-01-16T05:44:13.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5a578700 1 -- 172.21.15.84:0/2524305722 learned_addr learned my addr 172.21.15.84:0/2524305722 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:13.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad59d77700 1 --2- 172.21.15.84:0/2524305722 >> v2:172.21.15.142:3300/0 conn(0x7fad540a8ff0 0x7fad5408fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5ad79700 1 --2- 172.21.15.84:0/2524305722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad5407c560 0x7fad5407c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad59d77700 1 -- 172.21.15.84:0/2524305722 >> v2:172.21.15.142:3300/0 conn(0x7fad540a8ff0 msgr2=0x7fad5408fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-01-16T05:44:13.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad59d77700 1 -- 172.21.15.84:0/2524305722 >> v2:172.21.15.142:3300/0 conn(0x7fad540a8ff0 msgr2=0x7fad5408fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-01-16T05:44:13.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad59d77700 1 --2- 172.21.15.84:0/2524305722 >> v2:172.21.15.142:3300/0 conn(0x7fad540a8ff0 0x7fad5408fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-01-16T05:44:13.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad59d77700 1 --2- 172.21.15.84:0/2524305722 >> v2:172.21.15.142:3300/0 conn(0x7fad540a8ff0 0x7fad5408fd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-16T05:44:13.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5a578700 1 -- 172.21.15.84:0/2524305722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad5407c560 msgr2=0x7fad5407c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:13.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5a578700 1 --2- 172.21.15.84:0/2524305722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad5407c560 0x7fad5407c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:13.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5a578700 1 -- 172.21.15.84:0/2524305722 >> v2:172.21.15.142:3300/0 conn(0x7fad540a8ff0 msgr2=0x7fad5408fd80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-16T05:44:13.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5a578700 1 --2- 172.21.15.84:0/2524305722 >> v2:172.21.15.142:3300/0 conn(0x7fad540a8ff0 0x7fad5408fd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:13.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5a578700 1 -- 172.21.15.84:0/2524305722 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad540902d0 con 0x7fad540a2f60 2020-01-16T05:44:13.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5a578700 1 --2- 172.21.15.84:0/2524305722 >> v2:172.21.15.84:3300/0 conn(0x7fad540a2f60 0x7fad5405b0f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fad54090770 tx=0x7fad500102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5a578700 1 --2- 172.21.15.84:0/2524305722 >> v2:172.21.15.84:3300/0 conn(0x7fad540a2f60 0x7fad5405b0f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fad54090770 tx=0x7fad500102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5a578700 1 --2- 172.21.15.84:0/2524305722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad540a2f60 0x7fad5405b0f0 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7fad54090770 tx=0x7fad500102b0).ready entity=mon.0 client_cookie=8a440586467f841a server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:13.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5a578700 1 --2- 172.21.15.84:0/2524305722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad540a2f60 0x7fad5405b0f0 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fad54090770 tx=0x7fad500102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad59576700 1 -- 172.21.15.84:0/2524305722 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad5000a160 con 0x7fad540a2f60 2020-01-16T05:44:13.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5a578700 1 --2- 172.21.15.84:0/2524305722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad540a2f60 0x7fad5405b0f0 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fad54090770 tx=0x7fad500102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5a578700 1 --2- 172.21.15.84:0/2524305722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad540a2f60 0x7fad5405b0f0 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fad54090770 tx=0x7fad500102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad59576700 1 -- 172.21.15.84:0/2524305722 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad50011bf0 con 0x7fad540a2f60 2020-01-16T05:44:13.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad59576700 1 -- 172.21.15.84:0/2524305722 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad5000a740 con 0x7fad540a2f60 2020-01-16T05:44:13.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5bfdb700 1 -- 172.21.15.84:0/2524305722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad540a2f60 msgr2=0x7fad5405b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.507+0000 7fad5bfdb700 1 --2- 172.21.15.84:0/2524305722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad540a2f60 0x7fad5405b0f0 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7fad54090770 tx=0x7fad500102b0).stop 2020-01-16T05:44:13.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.511+0000 7fad5bfdb700 1 -- 172.21.15.84:0/2524305722 shutdown_connections 2020-01-16T05:44:13.520 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.511+0000 7fad5bfdb700 1 --2- 172.21.15.84:0/2524305722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad5407c560 0x7fad5407c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:13.520 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.511+0000 7fad5bfdb700 1 --2- 172.21.15.84:0/2524305722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad540a2f60 0x7fad5405b0f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.520 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.511+0000 7fad5bfdb700 1 --2- 172.21.15.84:0/2524305722 >> v2:172.21.15.142:3300/0 conn(0x7fad540a8ff0 0x7fad5408fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:13.521 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.511+0000 7fad5bfdb700 1 -- 172.21.15.84:0/2524305722 shutdown_connections 2020-01-16T05:44:13.521 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.511+0000 7fad5bfdb700 1 -- 172.21.15.84:0/2524305722 wait complete. 2020-01-16T05:44:13.521 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.511+0000 7fad5bfdb700 1 -- 172.21.15.84:0/2524305722 >> 172.21.15.84:0/2524305722 conn(0x7fad540abc10 msgr2=0x7fad5405a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:13.525 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.511+0000 7fad5bfdb700 1 Processor -- start 2020-01-16T05:44:13.525 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.511+0000 7fad5bfdb700 1 -- start start 2020-01-16T05:44:13.525 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.511+0000 7fad5bfdb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad541322d0 0x7fad5407dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:13.526 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.511+0000 7fad5bfdb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad5409dc40 0x7fad5409e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:13.526 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.511+0000 7fad5bfdb700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad54131770 con 0x7fad54060270 2020-01-16T05:44:13.526 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.511+0000 7fad5bfdb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad54131af0 con 0x7fad541322d0 2020-01-16T05:44:13.526 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.511+0000 7fad5bfdb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad54131d90 con 0x7fad5409dc40 2020-01-16T05:44:13.527 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.511+0000 7fad59d77700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad541322d0 0x7fad5407dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.527 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.511+0000 7fad59d77700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad541322d0 0x7fad5407dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34442/0 (socket says 172.21.15.84:34442) 2020-01-16T05:44:13.527 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.511+0000 7fad59d77700 1 -- 172.21.15.84:0/1743974622 learned_addr learned my addr 172.21.15.84:0/1743974622 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:13.527 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.511+0000 7fad5ad79700 1 --2- 172.21.15.84:0/1743974622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad5409dc40 0x7fad5409e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.528 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad59d77700 1 -- 172.21.15.84:0/1743974622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad5409dc40 msgr2=0x7fad5409e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.528 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad59d77700 1 --2- 172.21.15.84:0/1743974622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad5409dc40 0x7fad5409e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.528 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad59d77700 1 -- 172.21.15.84:0/1743974622 >> v1:172.21.15.84:6789/0 conn(0x7fad54060270 legacy=0x7fad5412e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.528 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad59d77700 1 -- 172.21.15.84:0/1743974622 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5407e1e0 con 0x7fad541322d0 2020-01-16T05:44:13.528 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad4affd700 1 -- 172.21.15.84:0/1743974622 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887101992 0 0) 0x7fad54131770 con 0x7fad54060270 2020-01-16T05:44:13.529 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad59d77700 1 --2- 172.21.15.84:0/1743974622 >> v2:172.21.15.84:3300/0 conn(0x7fad541322d0 0x7fad5407dc90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fad54131cb0 tx=0x7fad44010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.529 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad59d77700 1 --2- 172.21.15.84:0/1743974622 >> v2:172.21.15.84:3300/0 conn(0x7fad541322d0 0x7fad5407dc90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fad54131cb0 tx=0x7fad44010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.529 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad59d77700 1 --2- 172.21.15.84:0/1743974622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad541322d0 0x7fad5407dc90 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7fad54131cb0 tx=0x7fad44010b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:13.529 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad59d77700 1 --2- 172.21.15.84:0/1743974622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad541322d0 0x7fad5407dc90 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7fad54131cb0 tx=0x7fad44010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.530 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad59d77700 1 --2- 172.21.15.84:0/1743974622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad541322d0 0x7fad5407dc90 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7fad54131cb0 tx=0x7fad44010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.530 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad4affd700 1 -- 172.21.15.84:0/1743974622 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad44012400 con 0x7fad541322d0 2020-01-16T05:44:13.530 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad59d77700 1 --2- 172.21.15.84:0/1743974622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad541322d0 0x7fad5407dc90 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7fad54131cb0 tx=0x7fad44010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.530 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad4affd700 1 -- 172.21.15.84:0/1743974622 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad44008c70 con 0x7fad541322d0 2020-01-16T05:44:13.531 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad5bfdb700 1 -- 172.21.15.84:0/1743974622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad54138bc0 con 0x7fad541322d0 2020-01-16T05:44:13.531 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad4affd700 1 -- 172.21.15.84:0/1743974622 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad440129e0 con 0x7fad541322d0 2020-01-16T05:44:13.531 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad5bfdb700 1 -- 172.21.15.84:0/1743974622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad540a6340 con 0x7fad541322d0 2020-01-16T05:44:13.531 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad59d77700 1 --2- 172.21.15.84:0/1743974622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad541322d0 0x7fad5407dc90 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7fad54131cb0 tx=0x7fad44010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.531 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad5bfdb700 1 -- 172.21.15.84:0/1743974622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5405e1c0 con 0x7fad541322d0 2020-01-16T05:44:13.532 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad4affd700 1 -- 172.21.15.84:0/1743974622 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fad44012cb0 con 0x7fad541322d0 2020-01-16T05:44:13.532 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad59d77700 1 --2- 172.21.15.84:0/1743974622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad541322d0 0x7fad5407dc90 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7fad54131cb0 tx=0x7fad44010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.532 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad4affd700 1 --2- 172.21.15.84:0/1743974622 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fad3c03e3f0 0x7fad3c040900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:13.532 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad4affd700 1 -- 172.21.15.84:0/1743974622 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7fad44013060 con 0x7fad541322d0 2020-01-16T05:44:13.533 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad5a578700 1 --2- 172.21.15.84:0/1743974622 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fad3c03e3f0 0x7fad3c040900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.533 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.515+0000 7fad5a578700 1 --2- 172.21.15.84:0/1743974622 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fad3c03e3f0 0x7fad3c040900 crc :-1 s=READY pgs=74 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:13.534 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.527+0000 7fad59d77700 1 --2- 172.21.15.84:0/1743974622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad541322d0 0x7fad5407dc90 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7fad54131cb0 tx=0x7fad44010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.534 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.527+0000 7fad4affd700 1 -- 172.21.15.84:0/1743974622 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fad44033480 con 0x7fad541322d0 2020-01-16T05:44:13.680 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.679+0000 7fad5bfdb700 1 -- 172.21.15.84:0/1743974622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fad5408f350 con 0x7fad541322d0 2020-01-16T05:44:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.679+0000 7fad59d77700 1 --2- 172.21.15.84:0/1743974622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad541322d0 0x7fad5407dc90 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7fad54131cb0 tx=0x7fad44010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.679+0000 7fad4affd700 1 -- 172.21.15.84:0/1743974622 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fad440336e0 con 0x7fad541322d0 2020-01-16T05:44:13.681 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.679+0000 7fad5bfdb700 1 -- 172.21.15.84:0/1743974622 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fad3c03e3f0 msgr2=0x7fad3c040900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.679+0000 7fad5bfdb700 1 --2- 172.21.15.84:0/1743974622 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fad3c03e3f0 0x7fad3c040900 crc :-1 s=READY pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.679+0000 7fad5bfdb700 1 -- 172.21.15.84:0/1743974622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad541322d0 msgr2=0x7fad5407dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.679+0000 7fad5bfdb700 1 --2- 172.21.15.84:0/1743974622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad541322d0 0x7fad5407dc90 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7fad54131cb0 tx=0x7fad44010b90).stop 2020-01-16T05:44:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.679+0000 7fad5bfdb700 1 -- 172.21.15.84:0/1743974622 shutdown_connections 2020-01-16T05:44:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.679+0000 7fad5bfdb700 1 --2- 172.21.15.84:0/1743974622 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fad3c03e3f0 0x7fad3c040900 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.679+0000 7fad5bfdb700 1 --2- 172.21.15.84:0/1743974622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad5409dc40 0x7fad5409e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.679+0000 7fad5bfdb700 1 --2- 172.21.15.84:0/1743974622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad541322d0 0x7fad5407dc90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.679+0000 7fad5bfdb700 1 -- 172.21.15.84:0/1743974622 shutdown_connections 2020-01-16T05:44:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.679+0000 7fad5bfdb700 1 -- 172.21.15.84:0/1743974622 wait complete. 2020-01-16T05:44:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.679+0000 7fad5bfdb700 1 -- 172.21.15.84:0/1743974622 >> 172.21.15.84:0/1743974622 conn(0x7fad540a2ec0 msgr2=0x7fad540a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:13.694 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-01-16T05:44:13.694 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-01-16T05:44:13.695 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-16T05:44:13.811 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.803+0000 7fe1a359e700 1 Processor -- start 2020-01-16T05:44:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.803+0000 7fe1a359e700 1 -- start start 2020-01-16T05:44:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.803+0000 7fe1a359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe1a40a9b30 0x7fe1a40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.803+0000 7fe1a359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1a40a4250 0x7fe1a4066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.803+0000 7fe1a359e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a4066dd0 con 0x7fe1a407ff10 2020-01-16T05:44:13.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.803+0000 7fe1a359e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a40a4830 con 0x7fe1a40a9b30 2020-01-16T05:44:13.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.803+0000 7fe1a359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a407f9d0 con 0x7fe1a40a4250 2020-01-16T05:44:13.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.803+0000 7fe1a259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe1a407ff10 0x7fe1a40a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51654/0 (socket says 172.21.15.84:51654) 2020-01-16T05:44:13.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.803+0000 7fe1a259c700 1 -- 172.21.15.84:0/1424378369 learned_addr learned my addr 172.21.15.84:0/1424378369 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:13.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.803+0000 7fe1a2d9d700 1 --2- 172.21.15.84:0/1424378369 >> v2:172.21.15.142:3300/0 conn(0x7fe1a40a9b30 0x7fe1a40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.803+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1424378369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1a40a4250 0x7fe1a4066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.803+0000 7fe1a1d9b700 1 -- 172.21.15.84:0/1424378369 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898827820 0 0) 0x7fe1a4066dd0 con 0x7fe1a407ff10 2020-01-16T05:44:13.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.803+0000 7fe1a1d9b700 1 -- 172.21.15.84:0/1424378369 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe190003230 con 0x7fe1a407ff10 2020-01-16T05:44:13.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.803+0000 7fe1a1d9b700 1 -- 172.21.15.84:0/1424378369 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 816866880 0 0) 0x7fe190003230 con 0x7fe1a407ff10 2020-01-16T05:44:13.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a1d9b700 1 -- 172.21.15.84:0/1424378369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1a40a4250 msgr2=0x7fe1a4066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:13.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a1d9b700 1 --2- 172.21.15.84:0/1424378369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1a40a4250 0x7fe1a4066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:13.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a1d9b700 1 -- 172.21.15.84:0/1424378369 >> v2:172.21.15.142:3300/0 conn(0x7fe1a40a9b30 msgr2=0x7fe1a40abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:13.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a1d9b700 1 --2- 172.21.15.84:0/1424378369 >> v2:172.21.15.142:3300/0 conn(0x7fe1a40a9b30 0x7fe1a40abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:13.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a1d9b700 1 -- 172.21.15.84:0/1424378369 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a4150ce0 con 0x7fe1a407ff10 2020-01-16T05:44:13.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a1d9b700 1 -- 172.21.15.84:0/1424378369 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7fe18c001750 con 0x7fe1a407ff10 2020-01-16T05:44:13.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a1d9b700 1 -- 172.21.15.84:0/1424378369 >> v1:172.21.15.84:6789/0 conn(0x7fe1a407ff10 legacy=0x7fe1a40a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a1d9b700 1 --2- 172.21.15.84:0/1424378369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe190003890 0x7fe190003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:13.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a1d9b700 1 --2- 172.21.15.84:0/1424378369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1900045a0 0x7fe1900049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:13.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a1d9b700 1 --2- 172.21.15.84:0/1424378369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190004f20 0x7fe19004f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:13.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a1d9b700 1 -- 172.21.15.84:0/1424378369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40a4830 con 0x7fe190004f20 2020-01-16T05:44:13.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a1d9b700 1 -- 172.21.15.84:0/1424378369 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a407f9d0 con 0x7fe1900045a0 2020-01-16T05:44:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a1d9b700 1 -- 172.21.15.84:0/1424378369 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900053d0 con 0x7fe190003890 2020-01-16T05:44:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1424378369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190004f20 0x7fe19004f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a259c700 1 --2- 172.21.15.84:0/1424378369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1900045a0 0x7fe1900049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a2d9d700 1 --2- 172.21.15.84:0/1424378369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe190003890 0x7fe190003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a88cd700 1 -- 172.21.15.84:0/1424378369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe190003890 msgr2=0x7fe190003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1424378369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe190003890 0x7fe190003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a88cd700 1 -- 172.21.15.84:0/1424378369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1900045a0 msgr2=0x7fe1900049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1424378369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1900045a0 0x7fe1900049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a88cd700 1 -- 172.21.15.84:0/1424378369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19004fe90 con 0x7fe190004f20 2020-01-16T05:44:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1424378369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190004f20 0x7fe19004f800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe1940032b0 tx=0x7fe194010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1424378369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190004f20 0x7fe19004f800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe1940032b0 tx=0x7fe194010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1424378369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190004f20 0x7fe19004f800 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7fe1940032b0 tx=0x7fe194010480).ready entity=mon.0 client_cookie=b53cf340141ad798 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1424378369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190004f20 0x7fe19004f800 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fe1940032b0 tx=0x7fe194010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a1d9b700 1 -- 172.21.15.84:0/1424378369 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1940110c0 con 0x7fe190004f20 2020-01-16T05:44:13.818 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1424378369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190004f20 0x7fe19004f800 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fe1940032b0 tx=0x7fe194010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.818 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1424378369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190004f20 0x7fe19004f800 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fe1940032b0 tx=0x7fe194010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.818 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a1d9b700 1 -- 172.21.15.84:0/1424378369 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe194005a40 con 0x7fe190004f20 2020-01-16T05:44:13.818 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a1d9b700 1 -- 172.21.15.84:0/1424378369 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1940116a0 con 0x7fe190004f20 2020-01-16T05:44:13.818 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a359e700 1 -- 172.21.15.84:0/1424378369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190004f20 msgr2=0x7fe19004f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.818 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a359e700 1 --2- 172.21.15.84:0/1424378369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190004f20 0x7fe19004f800 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7fe1940032b0 tx=0x7fe194010480).stop 2020-01-16T05:44:13.818 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a88cd700 1 -- 172.21.15.84:0/1424378369 reap_dead start 2020-01-16T05:44:13.818 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a359e700 1 -- 172.21.15.84:0/1424378369 shutdown_connections 2020-01-16T05:44:13.819 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a359e700 1 -- 172.21.15.84:0/1424378369 shutdown_connections 2020-01-16T05:44:13.819 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a359e700 1 -- 172.21.15.84:0/1424378369 wait complete. 2020-01-16T05:44:13.819 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.807+0000 7fe1a359e700 1 -- 172.21.15.84:0/1424378369 >> 172.21.15.84:0/1424378369 conn(0x7fe1a40acfc0 msgr2=0x7fe1a40a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:13.819 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a359e700 1 Processor -- start 2020-01-16T05:44:13.819 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a359e700 1 -- start start 2020-01-16T05:44:13.826 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:44:13.827 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1a40a0d50 0x7fe1a4126bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:13.827 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe1a407c560 0x7fe1a407c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:13.827 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a359e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a4127c60 con 0x7fe1a4091460 2020-01-16T05:44:13.827 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a359e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a405f3e0 con 0x7fe1a407c560 2020-01-16T05:44:13.828 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40a37a0 con 0x7fe1a40a0d50 2020-01-16T05:44:13.828 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a2d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe1a4091460 0x7fe1a41359d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51662/0 (socket says 172.21.15.84:51662) 2020-01-16T05:44:13.828 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a2d9d700 1 -- 172.21.15.84:0/1937564967 learned_addr learned my addr 172.21.15.84:0/1937564967 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:13.828 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a259c700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1a40a0d50 0x7fe1a4126bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.829 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1937564967 >> v2:172.21.15.142:3300/0 conn(0x7fe1a407c560 0x7fe1a407c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.829 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe19b7fe700 1 -- 172.21.15.84:0/1937564967 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443191520 0 0) 0x7fe1a4127c60 con 0x7fe1a4091460 2020-01-16T05:44:13.829 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe19b7fe700 1 -- 172.21.15.84:0/1937564967 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe188003230 con 0x7fe1a4091460 2020-01-16T05:44:13.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe19b7fe700 1 -- 172.21.15.84:0/1937564967 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3116893960 0 0) 0x7fe188003230 con 0x7fe1a4091460 2020-01-16T05:44:13.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe19b7fe700 1 -- 172.21.15.84:0/1937564967 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe1a4127c60 con 0x7fe1a4091460 2020-01-16T05:44:13.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe19b7fe700 1 -- 172.21.15.84:0/1937564967 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7fe19c001490 con 0x7fe1a4091460 2020-01-16T05:44:13.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe19b7fe700 1 -- 172.21.15.84:0/1937564967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1a40a0d50 msgr2=0x7fe1a4126bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.831 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe19b7fe700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1a40a0d50 0x7fe1a4126bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.831 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe19b7fe700 1 -- 172.21.15.84:0/1937564967 >> v2:172.21.15.142:3300/0 conn(0x7fe1a407c560 msgr2=0x7fe1a407c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.831 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe19b7fe700 1 --2- 172.21.15.84:0/1937564967 >> v2:172.21.15.142:3300/0 conn(0x7fe1a407c560 0x7fe1a407c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.831 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe19b7fe700 1 -- 172.21.15.84:0/1937564967 >> v1:172.21.15.84:6789/0 conn(0x7fe1a4091460 legacy=0x7fe1a41359d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.831 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe19b7fe700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe188003a20 0x7fe188003e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:13.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe19b7fe700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1880045a0 0x7fe1880049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:13.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe19b7fe700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe188004fc0 0x7fe18800b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:13.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe19b7fe700 1 -- 172.21.15.84:0/1937564967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a405f3e0 con 0x7fe188004fc0 2020-01-16T05:44:13.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe19b7fe700 1 -- 172.21.15.84:0/1937564967 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40a37a0 con 0x7fe1880045a0 2020-01-16T05:44:13.833 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe19b7fe700 1 -- 172.21.15.84:0/1937564967 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18800bdf0 con 0x7fe188003a20 2020-01-16T05:44:13.833 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a259c700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1a40a0d50 0x7fe1a4126bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:13.833 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe188004fc0 0x7fe18800b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.833 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a2d9d700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe188003a20 0x7fe188003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.833 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a259c700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1880045a0 0x7fe1880049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.834 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a259c700 1 -- 172.21.15.84:0/1937564967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1880045a0 msgr2=0x7fe1880049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-01-16T05:44:13.834 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a259c700 1 -- 172.21.15.84:0/1937564967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1880045a0 msgr2=0x7fe1880049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-01-16T05:44:13.834 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a259c700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1880045a0 0x7fe1880049d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-01-16T05:44:13.834 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a259c700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1880045a0 0x7fe1880049d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-16T05:44:13.834 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a88cd700 1 -- 172.21.15.84:0/1937564967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe188003a20 msgr2=0x7fe188003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.835 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe188003a20 0x7fe188003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.835 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a88cd700 1 -- 172.21.15.84:0/1937564967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1880045a0 msgr2=0x7fe1880049d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-16T05:44:13.835 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1880045a0 0x7fe1880049d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.835 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a88cd700 1 -- 172.21.15.84:0/1937564967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a407cee0 con 0x7fe188004fc0 2020-01-16T05:44:13.836 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a359e700 1 -- 172.21.15.84:0/1937564967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a407d1b0 con 0x7fe188004fc0 2020-01-16T05:44:13.836 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe188004fc0 0x7fe18800b7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe1a40ab490 tx=0x7fe194011240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.836 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.811+0000 7fe1a359e700 1 -- 172.21.15.84:0/1937564967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a40a0d50 con 0x7fe188004fc0 2020-01-16T05:44:13.837 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.815+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe188004fc0 0x7fe18800b7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe1a40ab490 tx=0x7fe194011240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.837 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.815+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe188004fc0 0x7fe18800b7f0 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7fe1a40ab490 tx=0x7fe194011240).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:13.837 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.815+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe188004fc0 0x7fe18800b7f0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fe1a40ab490 tx=0x7fe194011240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.837 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.815+0000 7fe19b7fe700 1 -- 172.21.15.84:0/1937564967 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe194010890 con 0x7fe188004fc0 2020-01-16T05:44:13.837 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.815+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe188004fc0 0x7fe18800b7f0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fe1a40ab490 tx=0x7fe194011240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.838 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.815+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe188004fc0 0x7fe18800b7f0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fe1a40ab490 tx=0x7fe194011240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.838 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.815+0000 7fe19b7fe700 1 -- 172.21.15.84:0/1937564967 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1940112c0 con 0x7fe188004fc0 2020-01-16T05:44:13.838 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.815+0000 7fe19b7fe700 1 -- 172.21.15.84:0/1937564967 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1940114b0 con 0x7fe188004fc0 2020-01-16T05:44:13.838 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.815+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe188004fc0 0x7fe18800b7f0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fe1a40ab490 tx=0x7fe194011240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.838 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.815+0000 7fe1a359e700 1 -- 172.21.15.84:0/1937564967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c003360 con 0x7fe188004fc0 2020-01-16T05:44:13.838 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.815+0000 7fe19b7fe700 1 -- 172.21.15.84:0/1937564967 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fe1940116b0 con 0x7fe188004fc0 2020-01-16T05:44:13.838 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.815+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe188004fc0 0x7fe18800b7f0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fe1a40ab490 tx=0x7fe194011240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.839 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.815+0000 7fe19b7fe700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe188045050 0x7fe188047560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:13.839 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.815+0000 7fe19b7fe700 1 -- 172.21.15.84:0/1937564967 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7fe19404cde0 con 0x7fe188004fc0 2020-01-16T05:44:13.839 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.815+0000 7fe1a2d9d700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe188045050 0x7fe188047560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:13.839 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.815+0000 7fe1a2d9d700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe188045050 0x7fe188047560 crc :-1 s=READY pgs=75 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:13.839 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.823+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe188004fc0 0x7fe18800b7f0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fe1a40ab490 tx=0x7fe194011240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.839 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.823+0000 7fe19b7fe700 1 -- 172.21.15.84:0/1937564967 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fe194033400 con 0x7fe188004fc0 2020-01-16T05:44:13.841 INFO:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:44:13.950 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.947+0000 7fe1a359e700 1 -- 172.21.15.84:0/1937564967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe17c0021f0 con 0x7fe188004fc0 2020-01-16T05:44:13.950 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.947+0000 7fe1a88cd700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe188004fc0 0x7fe18800b7f0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fe1a40ab490 tx=0x7fe194011240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:13.950 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.947+0000 7fe19b7fe700 1 -- 172.21.15.84:0/1937564967 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14672 (secure 0 0 0) 0x7fe1940330f0 con 0x7fe188004fc0 2020-01-16T05:44:13.950 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:13.951 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"cbc67508-4d2a-4483-a1fc-95d371063ac4","created":"2020-01-16T05:43:46.771497+0000","modified":"2020-01-16T05:44:05.941278+0000","last_up_change":"2020-01-16T05:43:55.529492+0000","last_in_change":"2020-01-16T05:43:55.529492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-16T05:43:59.152708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-16T05:44:01.682783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-16T05:44:02.930765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15da60bb-4d16-44cc-80c6-cd2c7fa77364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":12644},{"type":"v1","addr":"172.21.15.84:6812","nonce":12644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":12644},{"type":"v1","addr":"172.21.15.84:6816","nonce":12644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":12644},{"type":"v1","addr":"172.21.15.84:6824","nonce":12644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":12644},{"type":"v1","addr":"172.21.15.84:6820","nonce":12644}]},"public_addr":"172.21.15.84:6812/12644","cluster_addr":"172.21.15.84:6816/12644","heartbeat_back_addr":"172.21.15.84:6824/12644","heartbeat_front_addr":"172.21.15.84:6820/12644","state":["exists","up"]},{"osd":1,"uuid":"0800533c-1d5b-4f9f-99bb-34b8133c8b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":12645},{"type":"v1","addr":"172.21.15.84:6803","nonce":12645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":12645},{"type":"v1","addr":"172.21.15.84:6805","nonce":12645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":12645},{"type":"v1","addr":"172.21.15.84:6809","nonce":12645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":12645},{"type":"v1","addr":"172.21.15.84:6807","nonce":12645}]},"public_addr":"172.21.15.84:6803/12645","cluster_addr":"172.21.15.84:6805/12645","heartbeat_back_addr":"172.21.15.84:6809/12645","heartbeat_front_addr":"172.21.15.84:6807/12645","state":["exists","up"]},{"osd":2,"uuid":"519cc27f-5cf9-4ecf-ad66-f722c37339df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":12646},{"type":"v1","addr":"172.21.15.84:6813","nonce":12646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6815","nonce":12646},{"type":"v1","addr":"172.21.15.84:6817","nonce":12646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":12646},{"type":"v1","addr":"172.21.15.84:6825","nonce":12646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":12646},{"type":"v1","addr":"172.21.15.84:6821","nonce":12646}]},"public_addr":"172.21.15.84:6813/12646","cluster_addr":"172.21.15.84:6817/12646","heartbeat_back_addr":"172.21.15.84:6825/12646","heartbeat_front_addr":"172.21.15.84:6821/12646","state":["exists","up"]},{"osd":3,"uuid":"aec305a6-bbac-4e01-8ea1-6077d49e27e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":12647},{"type":"v1","addr":"172.21.15.84:6827","nonce":12647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":12647},{"type":"v1","addr":"172.21.15.84:6829","nonce":12647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":12647},{"type":"v1","addr":"172.21.15.84:6833","nonce":12647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":12647},{"type":"v1","addr":"172.21.15.84:6831","nonce":12647}]},"public_addr":"172.21.15.84:6827/12647","cluster_addr":"172.21.15.84:6829/12647","heartbeat_back_addr":"172.21.15.84:6833/12647","heartbeat_front_addr":"172.21.15.84:6831/12647","state":["exists","up"]},{"osd":4,"uuid":"aaec7f3e-299a-4546-8406-207bcc4b3afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":12842},{"type":"v1","addr":"172.21.15.142:6801","nonce":12842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12842},{"type":"v1","addr":"172.21.15.142:6803","nonce":12842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12842},{"type":"v1","addr":"172.21.15.142:6807","nonce":12842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12842},{"type":"v1","addr":"172.21.15.142:6805","nonce":12842}]},"public_addr":"172.21.15.142:6801/12842","cluster_addr":"172.21.15.142:6803/12842","heartbeat_back_addr":"172.21.15.142:6807/12842","heartbeat_front_addr":"172.21.15.142:6805/12842","state":["exists","up"]},{"osd":5,"uuid":"5a942a47-7346-46d4-adf8-dad2bdb95aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12843},{"type":"v1","addr":"172.21.15.142:6809","nonce":12843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12843},{"type":"v1","addr":"172.21.15.142:6811","nonce":12843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12843},{"type":"v1","addr":"172.21.15.142:6815","nonce":12843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12843},{"type":"v1","addr":"172.21.15.142:6813","nonce":12843}]},"public_addr":"172.21.15.142:6809/12843","cluster_addr":"172.21.15.142:6811/12843","heartbeat_back_addr":"172.21.15.142:6815/12843","heartbeat_front_addr":"172.21.15.142:6813/12843","state":["exists","up"]},{"osd":6,"uuid":"c69fca67-66e4-4c31-ab03-1419e2a83e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12844},{"type":"v1","addr":"172.21.15.142:6818","nonce":12844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":12844},{"type":"v1","addr":"172.21.15.142:6823","nonce":12844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":12844},{"type":"v1","addr":"172.21.15.142:6831","nonce":12844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":12844},{"type":"v1","addr":"172.21.15.142:6827","nonce":12844}]},"public_addr":"172.21.15.142:6818/12844","cluster_addr":"172.21.15.142:6823/12844","heartbeat_back_addr":"172.21.15.142:6831/12844","heartbeat_front_addr":"172.21.15.142:6827/12844","state":["exists","up"]},{"osd":7,"uuid":"c436f64e-aa1f-435b-ac7b-85633e297591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":12845},{"type":"v1","addr":"172.21.15.142:6819","nonce":12845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12845},{"type":"v1","addr":"172.21.15.142:6822","nonce":12845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12845},{"type":"v1","addr":"172.21.15.142:6830","nonce":12845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12845},{"type":"v1","addr":"172.21.15.142:6826","nonce":12845}]},"public_addr":"172.21.15.142:6819/12845","cluster_addr":"172.21.15.142:6822/12845","heartbeat_back_addr":"172.21.15.142:6830/12845","heartbeat_front_addr":"172.21.15.142:6826/12845","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.534744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.505453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.485516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.333028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.483323+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.567824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.273268+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.559741+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-16T05:44:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.951+0000 7fe1a359e700 1 -- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe188045050 msgr2=0x7fe188047560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.951+0000 7fe1a359e700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe188045050 0x7fe188047560 crc :-1 s=READY pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.951+0000 7fe1a88cd700 1 -- 172.21.15.84:0/1937564967 reap_dead start 2020-01-16T05:44:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.951+0000 7fe1a359e700 1 -- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe188004fc0 msgr2=0x7fe18800b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.951+0000 7fe1a359e700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe188004fc0 0x7fe18800b7f0 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7fe1a40ab490 tx=0x7fe194011240).stop 2020-01-16T05:44:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.951+0000 7fe1a359e700 1 -- 172.21.15.84:0/1937564967 shutdown_connections 2020-01-16T05:44:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.951+0000 7fe1a359e700 1 --2- 172.21.15.84:0/1937564967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe188004fc0 0x7fe18800b7f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:13.953 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.951+0000 7fe1a359e700 1 -- 172.21.15.84:0/1937564967 shutdown_connections 2020-01-16T05:44:13.953 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.951+0000 7fe1a359e700 1 -- 172.21.15.84:0/1937564967 wait complete. 2020-01-16T05:44:13.953 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:13.951+0000 7fe1a359e700 1 -- 172.21.15.84:0/1937564967 >> 172.21.15.84:0/1937564967 conn(0x7fe1a40a4ad0 msgr2=0x7fe1a407eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:13.967 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:43:59.152708+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:44:01.682783+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:44:02.930765+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-16T05:44:13.968 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-16T05:44:14.103 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2fef1700 1 Processor -- start 2020-01-16T05:44:14.104 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2fef1700 1 -- start start 2020-01-16T05:44:14.104 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2fef1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c280a8ff0 0x7f9c2808fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:14.104 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2fef1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c280902d0 con 0x7f9c2805b0f0 2020-01-16T05:44:14.104 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2fef1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2807cd60 con 0x7f9c280a2f60 2020-01-16T05:44:14.104 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2fef1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c280a3390 con 0x7f9c280a8ff0 2020-01-16T05:44:14.105 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2dc8d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9c2805b0f0 0x7f9c2814e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51676/0 (socket says 172.21.15.84:51676) 2020-01-16T05:44:14.105 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2dc8d700 1 -- 172.21.15.84:0/2872752613 learned_addr learned my addr 172.21.15.84:0/2872752613 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:14.105 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2ec8f700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c280a8ff0 0x7f9c2808fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.105 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2d48c700 1 -- 172.21.15.84:0/2872752613 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616937150 0 0) 0x7f9c180010d0 con 0x7f9c2805b0f0 2020-01-16T05:44:14.105 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2d48c700 1 -- 172.21.15.84:0/2872752613 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c14003230 con 0x7f9c2805b0f0 2020-01-16T05:44:14.105 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2d48c700 1 -- 172.21.15.84:0/2872752613 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 596193744 0 0) 0x7f9c14003230 con 0x7f9c2805b0f0 2020-01-16T05:44:14.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2d48c700 1 -- 172.21.15.84:0/2872752613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c280a8ff0 msgr2=0x7f9c2808fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:14.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2d48c700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c280a8ff0 0x7f9c2808fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:14.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2d48c700 1 -- 172.21.15.84:0/2872752613 >> v1:172.21.15.142:6789/0 conn(0x7f9c280a2f60 legacy=0x7f9c2807c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2d48c700 1 -- 172.21.15.84:0/2872752613 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2805b520 con 0x7f9c2805b0f0 2020-01-16T05:44:14.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2d48c700 1 -- 172.21.15.84:0/2872752613 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f9c18001980 con 0x7f9c2805b0f0 2020-01-16T05:44:14.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2ec8f700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c280a8ff0 0x7f9c2808fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:14.107 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2d48c700 1 -- 172.21.15.84:0/2872752613 >> v1:172.21.15.84:6789/0 conn(0x7f9c2805b0f0 legacy=0x7f9c2814e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.107 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2d48c700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c14003890 0x7f9c14003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:14.107 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2d48c700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c140045a0 0x7f9c140049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:14.107 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2d48c700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c14004f20 0x7f9c1400b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:14.107 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2e48e700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c14003890 0x7f9c14003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.107 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2ec8f700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c14004f20 0x7f9c1400b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.107 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2d48c700 1 -- 172.21.15.84:0/2872752613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c280a3390 con 0x7f9c14004f20 2020-01-16T05:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2dc8d700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c140045a0 0x7f9c140049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2d48c700 1 -- 172.21.15.84:0/2872752613 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1404fd50 con 0x7f9c140045a0 2020-01-16T05:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.083+0000 7f9c2d48c700 1 -- 172.21.15.84:0/2872752613 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1404ff10 con 0x7f9c14003890 2020-01-16T05:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2e48e700 1 -- 172.21.15.84:0/2872752613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c140045a0 msgr2=0x7f9c140049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2e48e700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c140045a0 0x7f9c140049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2e48e700 1 -- 172.21.15.84:0/2872752613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c14004f20 msgr2=0x7f9c1400b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2e48e700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c14004f20 0x7f9c1400b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2e48e700 1 -- 172.21.15.84:0/2872752613 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c14050130 con 0x7f9c14003890 2020-01-16T05:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2ec8f700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c14004f20 0x7f9c1400b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2e48e700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c14003890 0x7f9c14003cc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9c24000fe0 tx=0x7f9c2400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2e48e700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c14003890 0x7f9c14003cc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9c24000fe0 tx=0x7f9c2400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2e48e700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c14003890 0x7f9c14003cc0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f9c24000fe0 tx=0x7f9c2400ff00).ready entity=mon.2 client_cookie=28b8da285d1234a1 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2e48e700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c14003890 0x7f9c14003cc0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f9c24000fe0 tx=0x7f9c2400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2d48c700 1 -- 172.21.15.84:0/2872752613 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c24003540 con 0x7f9c14003890 2020-01-16T05:44:14.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2e48e700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c14003890 0x7f9c14003cc0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f9c24000fe0 tx=0x7f9c2400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2e48e700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c14003890 0x7f9c14003cc0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f9c24000fe0 tx=0x7f9c2400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2d48c700 1 -- 172.21.15.84:0/2872752613 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c24003160 con 0x7f9c14003890 2020-01-16T05:44:14.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2d48c700 1 -- 172.21.15.84:0/2872752613 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c24003b20 con 0x7f9c14003890 2020-01-16T05:44:14.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2fef1700 1 -- 172.21.15.84:0/2872752613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c14003890 msgr2=0x7f9c14003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2fef1700 1 --2- 172.21.15.84:0/2872752613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c14003890 0x7f9c14003cc0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f9c24000fe0 tx=0x7f9c2400ff00).stop 2020-01-16T05:44:14.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2ec8f700 1 -- 172.21.15.84:0/2872752613 reap_dead start 2020-01-16T05:44:14.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2fef1700 1 -- 172.21.15.84:0/2872752613 shutdown_connections 2020-01-16T05:44:14.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2fef1700 1 -- 172.21.15.84:0/2872752613 shutdown_connections 2020-01-16T05:44:14.122 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2fef1700 1 -- 172.21.15.84:0/2872752613 wait complete. 2020-01-16T05:44:14.122 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2fef1700 1 -- 172.21.15.84:0/2872752613 >> 172.21.15.84:0/2872752613 conn(0x7f9c280abc10 msgr2=0x7f9c2805a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:14.122 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2fef1700 1 Processor -- start 2020-01-16T05:44:14.122 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.087+0000 7f9c2fef1700 1 -- start start 2020-01-16T05:44:14.122 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2fef1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c28125230 0x7f9c2807d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:14.122 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2fef1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9c28124780 0x7f9c28125890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:14.122 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2fef1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2807d8f0 con 0x7f9c28124350 2020-01-16T05:44:14.122 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2fef1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c2812ea50 con 0x7f9c28124780 2020-01-16T05:44:14.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2fef1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2812ecf0 con 0x7f9c28125230 2020-01-16T05:44:14.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2ec8f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9c28124780 0x7f9c28125890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2ec8f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9c28124780 0x7f9c28125890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34492/0 (socket says 172.21.15.84:34492) 2020-01-16T05:44:14.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2ec8f700 1 -- 172.21.15.84:0/710958859 learned_addr learned my addr 172.21.15.84:0/710958859 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:14.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2e48e700 1 --2- 172.21.15.84:0/710958859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c28125230 0x7f9c2807d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c1effd700 1 -- 172.21.15.84:0/710958859 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334880241 0 0) 0x7f9c2807d8f0 con 0x7f9c28124350 2020-01-16T05:44:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2ec8f700 1 -- 172.21.15.84:0/710958859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c28125230 msgr2=0x7f9c2807d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2ec8f700 1 --2- 172.21.15.84:0/710958859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c28125230 0x7f9c2807d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2ec8f700 1 -- 172.21.15.84:0/710958859 >> v1:172.21.15.142:6789/0 conn(0x7f9c28124350 legacy=0x7f9c2812f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2ec8f700 1 -- 172.21.15.84:0/710958859 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c28125de0 con 0x7f9c28124780 2020-01-16T05:44:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2ec8f700 1 --2- 172.21.15.84:0/710958859 >> v2:172.21.15.84:3300/0 conn(0x7f9c28124780 0x7f9c28125890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c2812ec10 tx=0x7f9c20011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2ec8f700 1 --2- 172.21.15.84:0/710958859 >> v2:172.21.15.84:3300/0 conn(0x7f9c28124780 0x7f9c28125890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c2812ec10 tx=0x7f9c20011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2ec8f700 1 --2- 172.21.15.84:0/710958859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c28124780 0x7f9c28125890 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f9c2812ec10 tx=0x7f9c20011020).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:14.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2ec8f700 1 --2- 172.21.15.84:0/710958859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c28124780 0x7f9c28125890 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f9c2812ec10 tx=0x7f9c20011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c1effd700 1 -- 172.21.15.84:0/710958859 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c2000ecf0 con 0x7f9c28124780 2020-01-16T05:44:14.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2ec8f700 1 --2- 172.21.15.84:0/710958859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c28124780 0x7f9c28125890 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f9c2812ec10 tx=0x7f9c20011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2ec8f700 1 --2- 172.21.15.84:0/710958859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c28124780 0x7f9c28125890 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f9c2812ec10 tx=0x7f9c20011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c1effd700 1 -- 172.21.15.84:0/710958859 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2000e910 con 0x7f9c28124780 2020-01-16T05:44:14.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2fef1700 1 -- 172.21.15.84:0/710958859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c281260b0 con 0x7f9c28124780 2020-01-16T05:44:14.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c1effd700 1 -- 172.21.15.84:0/710958859 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c20011c90 con 0x7f9c28124780 2020-01-16T05:44:14.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2fef1700 1 -- 172.21.15.84:0/710958859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c281393c0 con 0x7f9c28124780 2020-01-16T05:44:14.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2ec8f700 1 --2- 172.21.15.84:0/710958859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c28124780 0x7f9c28125890 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f9c2812ec10 tx=0x7f9c20011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c1effd700 1 -- 172.21.15.84:0/710958859 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f9c20005a40 con 0x7f9c28124780 2020-01-16T05:44:14.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2ec8f700 1 --2- 172.21.15.84:0/710958859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c28124780 0x7f9c28125890 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f9c2812ec10 tx=0x7f9c20011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c2fef1700 1 -- 172.21.15.84:0/710958859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2805e1c0 con 0x7f9c28124780 2020-01-16T05:44:14.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.091+0000 7f9c1effd700 1 --2- 172.21.15.84:0/710958859 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9c1003c240 0x7f9c1003e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:14.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.095+0000 7f9c1effd700 1 -- 172.21.15.84:0/710958859 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f9c2000b740 con 0x7f9c28124780 2020-01-16T05:44:14.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.095+0000 7f9c2e48e700 1 --2- 172.21.15.84:0/710958859 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9c1003c240 0x7f9c1003e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.095+0000 7f9c2e48e700 1 --2- 172.21.15.84:0/710958859 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9c1003c240 0x7f9c1003e750 crc :-1 s=READY pgs=76 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:14.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.099+0000 7f9c2ec8f700 1 --2- 172.21.15.84:0/710958859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c28124780 0x7f9c28125890 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f9c2812ec10 tx=0x7f9c20011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.099+0000 7f9c1effd700 1 -- 172.21.15.84:0/710958859 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f9c20033b80 con 0x7f9c28124780 2020-01-16T05:44:14.217 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.215+0000 7f9c2fef1700 1 -- 172.21.15.84:0/710958859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9c2808f350 con 0x7f9c28124780 2020-01-16T05:44:14.218 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.215+0000 7f9c2ec8f700 1 --2- 172.21.15.84:0/710958859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c28124780 0x7f9c28125890 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f9c2812ec10 tx=0x7f9c20011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.218 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.215+0000 7f9c1effd700 1 -- 172.21.15.84:0/710958859 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9c20005d50 con 0x7f9c28124780 2020-01-16T05:44:14.218 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.219+0000 7f9c2fef1700 1 -- 172.21.15.84:0/710958859 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9c1003c240 msgr2=0x7f9c1003e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.219+0000 7f9c2fef1700 1 --2- 172.21.15.84:0/710958859 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9c1003c240 0x7f9c1003e750 crc :-1 s=READY pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.219+0000 7f9c2fef1700 1 -- 172.21.15.84:0/710958859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c28124780 msgr2=0x7f9c28125890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.219+0000 7f9c2fef1700 1 --2- 172.21.15.84:0/710958859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c28124780 0x7f9c28125890 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f9c2812ec10 tx=0x7f9c20011020).stop 2020-01-16T05:44:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.219+0000 7f9c2fef1700 1 -- 172.21.15.84:0/710958859 shutdown_connections 2020-01-16T05:44:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.219+0000 7f9c2fef1700 1 --2- 172.21.15.84:0/710958859 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9c1003c240 0x7f9c1003e750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.219+0000 7f9c2fef1700 1 --2- 172.21.15.84:0/710958859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c28124780 0x7f9c28125890 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.219+0000 7f9c2fef1700 1 --2- 172.21.15.84:0/710958859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c28125230 0x7f9c2807d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.219+0000 7f9c2fef1700 1 -- 172.21.15.84:0/710958859 shutdown_connections 2020-01-16T05:44:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.219+0000 7f9c2fef1700 1 -- 172.21.15.84:0/710958859 wait complete. 2020-01-16T05:44:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.219+0000 7f9c2fef1700 1 -- 172.21.15.84:0/710958859 >> 172.21.15.84:0/710958859 conn(0x7f9c2808fea0 msgr2=0x7f9c28090510 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:14.243 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-01-16T05:44:14.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.359+0000 7fa811aa5700 1 Processor -- start 2020-01-16T05:44:14.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.359+0000 7fa811aa5700 1 -- start start 2020-01-16T05:44:14.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa811aa5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa80c0a9b30 0x7fa80c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:14.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa811aa5700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa80c07ff10 0x7fa80c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:14.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa811aa5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80c066dd0 con 0x7fa80c0a4250 2020-01-16T05:44:14.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa811aa5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80c0a4830 con 0x7fa80c0a9b30 2020-01-16T05:44:14.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa811aa5700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80c07f9d0 con 0x7fa80c07ff10 2020-01-16T05:44:14.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa8112a4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa80c0a9b30 0x7fa80c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa8112a4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa80c0a9b30 0x7fa80c0abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34496/0 (socket says 172.21.15.84:34496) 2020-01-16T05:44:14.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa8112a4700 1 -- 172.21.15.84:0/3522627926 learned_addr learned my addr 172.21.15.84:0/3522627926 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:14.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa810aa3700 1 --2- 172.21.15.84:0/3522627926 >> v2:172.21.15.142:3300/0 conn(0x7fa80c07ff10 0x7fa80c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa8112a4700 1 -- 172.21.15.84:0/3522627926 >> v2:172.21.15.142:3300/0 conn(0x7fa80c07ff10 msgr2=0x7fa80c066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:14.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa8112a4700 1 --2- 172.21.15.84:0/3522627926 >> v2:172.21.15.142:3300/0 conn(0x7fa80c07ff10 0x7fa80c066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:14.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa8112a4700 1 -- 172.21.15.84:0/3522627926 >> v1:172.21.15.142:6789/0 conn(0x7fa80c0a4250 legacy=0x7fa80c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:14.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa8112a4700 1 -- 172.21.15.84:0/3522627926 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c150ce0 con 0x7fa80c0a9b30 2020-01-16T05:44:14.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa810aa3700 1 --2- 172.21.15.84:0/3522627926 >> v2:172.21.15.142:3300/0 conn(0x7fa80c07ff10 0x7fa80c066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-01-16T05:44:14.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa8112a4700 1 --2- 172.21.15.84:0/3522627926 >> v2:172.21.15.84:3300/0 conn(0x7fa80c0a9b30 0x7fa80c0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa80c0a49f0 tx=0x7fa80800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa8112a4700 1 --2- 172.21.15.84:0/3522627926 >> v2:172.21.15.84:3300/0 conn(0x7fa80c0a9b30 0x7fa80c0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa80c0a49f0 tx=0x7fa80800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa8112a4700 1 --2- 172.21.15.84:0/3522627926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c0a9b30 0x7fa80c0abdd0 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7fa80c0a49f0 tx=0x7fa80800feb0).ready entity=mon.0 client_cookie=52e89956fdb533ca server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:14.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa8112a4700 1 --2- 172.21.15.84:0/3522627926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c0a9b30 0x7fa80c0abdd0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7fa80c0a49f0 tx=0x7fa80800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa8112a4700 1 --2- 172.21.15.84:0/3522627926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c0a9b30 0x7fa80c0abdd0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7fa80c0a49f0 tx=0x7fa80800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa803fff700 1 -- 172.21.15.84:0/3522627926 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8080116e0 con 0x7fa80c0a9b30 2020-01-16T05:44:14.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa8112a4700 1 --2- 172.21.15.84:0/3522627926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c0a9b30 0x7fa80c0abdd0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7fa80c0a49f0 tx=0x7fa80800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa803fff700 1 -- 172.21.15.84:0/3522627926 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa808008d30 con 0x7fa80c0a9b30 2020-01-16T05:44:14.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa803fff700 1 -- 172.21.15.84:0/3522627926 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa808011cc0 con 0x7fa80c0a9b30 2020-01-16T05:44:14.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa811aa5700 1 -- 172.21.15.84:0/3522627926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c0a9b30 msgr2=0x7fa80c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa811aa5700 1 --2- 172.21.15.84:0/3522627926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c0a9b30 0x7fa80c0abdd0 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7fa80c0a49f0 tx=0x7fa80800feb0).stop 2020-01-16T05:44:14.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa811aa5700 1 -- 172.21.15.84:0/3522627926 shutdown_connections 2020-01-16T05:44:14.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa811aa5700 1 --2- 172.21.15.84:0/3522627926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c0a9b30 0x7fa80c0abdd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:14.370 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa811aa5700 1 --2- 172.21.15.84:0/3522627926 >> v2:172.21.15.142:3300/0 conn(0x7fa80c07ff10 0x7fa80c066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:14.370 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa811aa5700 1 -- 172.21.15.84:0/3522627926 shutdown_connections 2020-01-16T05:44:14.370 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa811aa5700 1 -- 172.21.15.84:0/3522627926 wait complete. 2020-01-16T05:44:14.370 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.363+0000 7fa811aa5700 1 -- 172.21.15.84:0/3522627926 >> 172.21.15.84:0/3522627926 conn(0x7fa80c0acfc0 msgr2=0x7fa80c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:14.374 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa811aa5700 1 Processor -- start 2020-01-16T05:44:14.375 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa811aa5700 1 -- start start 2020-01-16T05:44:14.375 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa811aa5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa80c09fa80 0x7fa80c13e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:14.375 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa811aa5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80c0ab040 con 0x7fa80c025230 2020-01-16T05:44:14.375 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa811aa5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80c08ef10 con 0x7fa80c07ed90 2020-01-16T05:44:14.375 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa811aa5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80c025660 con 0x7fa80c09fa80 2020-01-16T05:44:14.375 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa810aa3700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa80c025230 0x7fa80c09f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51702/0 (socket says 172.21.15.84:51702) 2020-01-16T05:44:14.375 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa810aa3700 1 -- 172.21.15.84:0/511760168 learned_addr learned my addr 172.21.15.84:0/511760168 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:14.376 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa812d07700 1 --2- 172.21.15.84:0/511760168 >> v2:172.21.15.84:3300/0 conn(0x7fa80c09fa80 0x7fa80c13e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.376 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa801ffb700 1 -- 172.21.15.84:0/511760168 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920068856 0 0) 0x7fa80c0ab040 con 0x7fa80c025230 2020-01-16T05:44:14.376 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa801ffb700 1 -- 172.21.15.84:0/511760168 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7ec003230 con 0x7fa80c025230 2020-01-16T05:44:14.376 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa801ffb700 1 -- 172.21.15.84:0/511760168 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835370824 0 0) 0x7fa80c08ef10 con 0x7fa80c07ed90 2020-01-16T05:44:14.376 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa801ffb700 1 -- 172.21.15.84:0/511760168 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa80c0ab040 con 0x7fa80c07ed90 2020-01-16T05:44:14.376 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa801ffb700 1 -- 172.21.15.84:0/511760168 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 532472812 0 0) 0x7fa7ec003230 con 0x7fa80c025230 2020-01-16T05:44:14.377 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa812d07700 1 -- 172.21.15.84:0/511760168 >> v1:172.21.15.142:6789/0 conn(0x7fa80c07ed90 legacy=0x7fa80c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.377 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa812d07700 1 -- 172.21.15.84:0/511760168 >> v1:172.21.15.84:6789/0 conn(0x7fa80c025230 legacy=0x7fa80c09f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.377 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa812d07700 1 -- 172.21.15.84:0/511760168 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c08fe10 con 0x7fa80c09fa80 2020-01-16T05:44:14.377 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa812d07700 1 --2- 172.21.15.84:0/511760168 >> v2:172.21.15.84:3300/0 conn(0x7fa80c09fa80 0x7fa80c13e070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7fc0024a0 tx=0x7fa7fc0028d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.377 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa812d07700 1 --2- 172.21.15.84:0/511760168 >> v2:172.21.15.84:3300/0 conn(0x7fa80c09fa80 0x7fa80c13e070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7fc0024a0 tx=0x7fa7fc0028d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.377 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa812d07700 1 --2- 172.21.15.84:0/511760168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c09fa80 0x7fa80c13e070 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7fa7fc0024a0 tx=0x7fa7fc0028d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:14.377 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa812d07700 1 --2- 172.21.15.84:0/511760168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c09fa80 0x7fa80c13e070 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fa7fc0024a0 tx=0x7fa7fc0028d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.378 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa801ffb700 1 -- 172.21.15.84:0/511760168 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa804013060 con 0x7fa80c09fa80 2020-01-16T05:44:14.378 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa812d07700 1 --2- 172.21.15.84:0/511760168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c09fa80 0x7fa80c13e070 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fa7fc0024a0 tx=0x7fa7fc0028d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.378 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa801ffb700 1 -- 172.21.15.84:0/511760168 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7fc0024e0 con 0x7fa80c09fa80 2020-01-16T05:44:14.378 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa812d07700 1 --2- 172.21.15.84:0/511760168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c09fa80 0x7fa80c13e070 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fa7fc0024a0 tx=0x7fa7fc0028d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.378 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa811aa5700 1 -- 172.21.15.84:0/511760168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80c13e5c0 con 0x7fa80c09fa80 2020-01-16T05:44:14.378 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa801ffb700 1 -- 172.21.15.84:0/511760168 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7fc0026d0 con 0x7fa80c09fa80 2020-01-16T05:44:14.378 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.367+0000 7fa811aa5700 1 -- 172.21.15.84:0/511760168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80c13eb40 con 0x7fa80c09fa80 2020-01-16T05:44:14.378 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.371+0000 7fa812d07700 1 --2- 172.21.15.84:0/511760168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c09fa80 0x7fa80c13e070 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fa7fc0024a0 tx=0x7fa7fc0028d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.379 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.371+0000 7fa801ffb700 1 -- 172.21.15.84:0/511760168 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fa804007160 con 0x7fa80c09fa80 2020-01-16T05:44:14.379 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.371+0000 7fa812d07700 1 --2- 172.21.15.84:0/511760168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c09fa80 0x7fa80c13e070 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fa7fc0024a0 tx=0x7fa7fc0028d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.379 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.371+0000 7fa801ffb700 1 --2- 172.21.15.84:0/511760168 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa7ec03c980 0x7fa7ec03ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:14.379 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.371+0000 7fa811aa5700 1 -- 172.21.15.84:0/511760168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80c05e1c0 con 0x7fa80c09fa80 2020-01-16T05:44:14.379 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.371+0000 7fa801ffb700 1 -- 172.21.15.84:0/511760168 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7fa80404c1d0 con 0x7fa80c09fa80 2020-01-16T05:44:14.379 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.371+0000 7fa8112a4700 1 --2- 172.21.15.84:0/511760168 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa7ec03c980 0x7fa7ec03ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.379 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.371+0000 7fa8112a4700 1 --2- 172.21.15.84:0/511760168 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa7ec03c980 0x7fa7ec03ee90 crc :-1 s=READY pgs=77 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:14.380 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.379+0000 7fa812d07700 1 --2- 172.21.15.84:0/511760168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c09fa80 0x7fa80c13e070 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fa7fc0024a0 tx=0x7fa7fc0028d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.380 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.379+0000 7fa801ffb700 1 -- 172.21.15.84:0/511760168 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fa8040327d0 con 0x7fa80c09fa80 2020-01-16T05:44:14.497 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.495+0000 7fa811aa5700 1 -- 172.21.15.84:0/511760168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa80c05cbc0 con 0x7fa80c09fa80 2020-01-16T05:44:14.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.495+0000 7fa812d07700 1 --2- 172.21.15.84:0/511760168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c09fa80 0x7fa80c13e070 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fa7fc0024a0 tx=0x7fa7fc0028d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.495+0000 7fa801ffb700 1 -- 172.21.15.84:0/511760168 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa804032a30 con 0x7fa80c09fa80 2020-01-16T05:44:14.498 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:14.500 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.499+0000 7fa811aa5700 1 -- 172.21.15.84:0/511760168 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa7ec03c980 msgr2=0x7fa7ec03ee90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.500 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.499+0000 7fa811aa5700 1 --2- 172.21.15.84:0/511760168 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa7ec03c980 0x7fa7ec03ee90 crc :-1 s=READY pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:14.500 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.499+0000 7fa811aa5700 1 -- 172.21.15.84:0/511760168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c09fa80 msgr2=0x7fa80c13e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.500 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.499+0000 7fa811aa5700 1 --2- 172.21.15.84:0/511760168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c09fa80 0x7fa80c13e070 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7fa7fc0024a0 tx=0x7fa7fc0028d0).stop 2020-01-16T05:44:14.500 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.499+0000 7fa811aa5700 1 -- 172.21.15.84:0/511760168 shutdown_connections 2020-01-16T05:44:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.499+0000 7fa811aa5700 1 --2- 172.21.15.84:0/511760168 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa7ec03c980 0x7fa7ec03ee90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.499+0000 7fa811aa5700 1 --2- 172.21.15.84:0/511760168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c09fa80 0x7fa80c13e070 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.499+0000 7fa811aa5700 1 -- 172.21.15.84:0/511760168 shutdown_connections 2020-01-16T05:44:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.499+0000 7fa811aa5700 1 -- 172.21.15.84:0/511760168 wait complete. 2020-01-16T05:44:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.499+0000 7fa811aa5700 1 -- 172.21.15.84:0/511760168 >> 172.21.15.84:0/511760168 conn(0x7fa80c0a3db0 msgr2=0x7fa80c127350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:14.511 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-01-16T05:44:14.633 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.627+0000 7f89f48d9700 1 Processor -- start 2020-01-16T05:44:14.634 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.627+0000 7f89f48d9700 1 -- start start 2020-01-16T05:44:14.634 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89f48d9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f89f00a9b30 0x7f89f00abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:14.634 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89f48d9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f89f007ff10 0x7f89f0066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:14.634 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89f48d9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f0066dd0 con 0x7f89f00a4250 2020-01-16T05:44:14.634 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89f48d9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f00a4830 con 0x7f89f007ff10 2020-01-16T05:44:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89f48d9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f007f9d0 con 0x7f89f00a9b30 2020-01-16T05:44:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89eed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f89f007ff10 0x7f89f0066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89eed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f89f007ff10 0x7f89f0066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34510/0 (socket says 172.21.15.84:34510) 2020-01-16T05:44:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89eed9d700 1 -- 172.21.15.84:0/1602136325 learned_addr learned my addr 172.21.15.84:0/1602136325 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89ef59e700 1 --2- 172.21.15.84:0/1602136325 >> v2:172.21.15.142:3300/0 conn(0x7f89f00a9b30 0x7f89f00abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89eed9d700 1 -- 172.21.15.84:0/1602136325 >> v2:172.21.15.142:3300/0 conn(0x7f89f00a9b30 msgr2=0x7f89f00abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89eed9d700 1 --2- 172.21.15.84:0/1602136325 >> v2:172.21.15.142:3300/0 conn(0x7f89f00a9b30 0x7f89f00abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89eed9d700 1 -- 172.21.15.84:0/1602136325 >> v1:172.21.15.142:6789/0 conn(0x7f89f00a4250 legacy=0x7f89f00a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89eed9d700 1 -- 172.21.15.84:0/1602136325 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f0150ce0 con 0x7f89f007ff10 2020-01-16T05:44:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89ef59e700 1 --2- 172.21.15.84:0/1602136325 >> v2:172.21.15.142:3300/0 conn(0x7f89f00a9b30 0x7f89f00abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-01-16T05:44:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89eed9d700 1 --2- 172.21.15.84:0/1602136325 >> v2:172.21.15.84:3300/0 conn(0x7f89f007ff10 0x7f89f0066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f89f00a49f0 tx=0x7f89d800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89eed9d700 1 --2- 172.21.15.84:0/1602136325 >> v2:172.21.15.84:3300/0 conn(0x7f89f007ff10 0x7f89f0066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f89f00a49f0 tx=0x7f89d800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89eed9d700 1 --2- 172.21.15.84:0/1602136325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89f007ff10 0x7f89f0066880 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7f89f00a49f0 tx=0x7f89d800feb0).ready entity=mon.0 client_cookie=eec01df152df0358 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89eed9d700 1 --2- 172.21.15.84:0/1602136325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89f007ff10 0x7f89f0066880 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f89f00a49f0 tx=0x7f89d800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89eed9d700 1 --2- 172.21.15.84:0/1602136325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89f007ff10 0x7f89f0066880 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f89f00a49f0 tx=0x7f89d800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89eed9d700 1 --2- 172.21.15.84:0/1602136325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89f007ff10 0x7f89f0066880 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f89f00a49f0 tx=0x7f89d800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89ee59c700 1 -- 172.21.15.84:0/1602136325 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89d80116e0 con 0x7f89f007ff10 2020-01-16T05:44:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89ee59c700 1 -- 172.21.15.84:0/1602136325 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d8008d30 con 0x7f89f007ff10 2020-01-16T05:44:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89ee59c700 1 -- 172.21.15.84:0/1602136325 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89d8011cc0 con 0x7f89f007ff10 2020-01-16T05:44:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89f48d9700 1 -- 172.21.15.84:0/1602136325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89f007ff10 msgr2=0x7f89f0066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89f48d9700 1 --2- 172.21.15.84:0/1602136325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89f007ff10 0x7f89f0066880 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7f89f00a49f0 tx=0x7f89d800feb0).stop 2020-01-16T05:44:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89f48d9700 1 -- 172.21.15.84:0/1602136325 shutdown_connections 2020-01-16T05:44:14.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89f48d9700 1 --2- 172.21.15.84:0/1602136325 >> v2:172.21.15.142:3300/0 conn(0x7f89f00a9b30 0x7f89f00abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:14.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89f48d9700 1 --2- 172.21.15.84:0/1602136325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89f007ff10 0x7f89f0066880 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:14.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89f48d9700 1 -- 172.21.15.84:0/1602136325 shutdown_connections 2020-01-16T05:44:14.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89f48d9700 1 -- 172.21.15.84:0/1602136325 wait complete. 2020-01-16T05:44:14.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.631+0000 7f89f48d9700 1 -- 172.21.15.84:0/1602136325 >> 172.21.15.84:0/1602136325 conn(0x7f89f00acfc0 msgr2=0x7f89f00a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.635+0000 7f89f48d9700 1 Processor -- start 2020-01-16T05:44:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.635+0000 7f89f48d9700 1 -- start start 2020-01-16T05:44:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.635+0000 7f89f48d9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f89f0126560 0x7f89f0123e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.635+0000 7f89f48d9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f0125d00 con 0x7f89f005bef0 2020-01-16T05:44:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.635+0000 7f89f48d9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f01243c0 con 0x7f89f009fa80 2020-01-16T05:44:14.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.635+0000 7f89f48d9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f00a5fa0 con 0x7f89f0126560 2020-01-16T05:44:14.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.635+0000 7f89f50da700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f89f0126560 0x7f89f0123e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.635+0000 7f89ef59e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f89f005bef0 0x7f89f009f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51716/0 (socket says 172.21.15.84:51716) 2020-01-16T05:44:14.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.635+0000 7f89eed9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f89f009fa80 0x7f89f013b180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:49944/0 (socket says 172.21.15.84:49944) 2020-01-16T05:44:14.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.635+0000 7f89ef59e700 1 -- 172.21.15.84:0/538255001 learned_addr learned my addr 172.21.15.84:0/538255001 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:14.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.635+0000 7f89e7fff700 1 -- 172.21.15.84:0/538255001 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721186341 0 0) 0x7f89f01243c0 con 0x7f89f009fa80 2020-01-16T05:44:14.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.635+0000 7f89e7fff700 1 -- 172.21.15.84:0/538255001 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89d4003230 con 0x7f89f009fa80 2020-01-16T05:44:14.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.635+0000 7f89f50da700 1 -- 172.21.15.84:0/538255001 >> v1:172.21.15.142:6789/0 conn(0x7f89f009fa80 legacy=0x7f89f013b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.635+0000 7f89f50da700 1 -- 172.21.15.84:0/538255001 >> v1:172.21.15.84:6789/0 conn(0x7f89f005bef0 legacy=0x7f89f009f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.635+0000 7f89f50da700 1 -- 172.21.15.84:0/538255001 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f00ab090 con 0x7f89f0126560 2020-01-16T05:44:14.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.635+0000 7f89f50da700 1 --2- 172.21.15.84:0/538255001 >> v2:172.21.15.84:3300/0 conn(0x7f89f0126560 0x7f89f0123e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f89e8003270 tx=0x7f89e8010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.635+0000 7f89f50da700 1 --2- 172.21.15.84:0/538255001 >> v2:172.21.15.84:3300/0 conn(0x7f89f0126560 0x7f89f0123e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f89e8003270 tx=0x7f89e8010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.635+0000 7f89f50da700 1 --2- 172.21.15.84:0/538255001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89f0126560 0x7f89f0123e70 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f89e8003270 tx=0x7f89e8010c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:14.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.639+0000 7f89f50da700 1 --2- 172.21.15.84:0/538255001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89f0126560 0x7f89f0123e70 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f89e8003270 tx=0x7f89e8010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.639+0000 7f89e7fff700 1 -- 172.21.15.84:0/538255001 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89e8008d90 con 0x7f89f0126560 2020-01-16T05:44:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.639+0000 7f89f50da700 1 --2- 172.21.15.84:0/538255001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89f0126560 0x7f89f0123e70 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f89e8003270 tx=0x7f89e8010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.639+0000 7f89f50da700 1 --2- 172.21.15.84:0/538255001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89f0126560 0x7f89f0123e70 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f89e8003270 tx=0x7f89e8010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.639+0000 7f89e7fff700 1 -- 172.21.15.84:0/538255001 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e8005db0 con 0x7f89f0126560 2020-01-16T05:44:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.639+0000 7f89f48d9700 1 -- 172.21.15.84:0/538255001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f0126990 con 0x7f89f0126560 2020-01-16T05:44:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.639+0000 7f89e7fff700 1 -- 172.21.15.84:0/538255001 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89e8012720 con 0x7f89f0126560 2020-01-16T05:44:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.639+0000 7f89f48d9700 1 -- 172.21.15.84:0/538255001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f0126dd0 con 0x7f89f0126560 2020-01-16T05:44:14.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.639+0000 7f89f50da700 1 --2- 172.21.15.84:0/538255001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89f0126560 0x7f89f0123e70 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f89e8003270 tx=0x7f89e8010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.639+0000 7f89e7fff700 1 -- 172.21.15.84:0/538255001 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f89e8012a30 con 0x7f89f0126560 2020-01-16T05:44:14.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.639+0000 7f89f50da700 1 --2- 172.21.15.84:0/538255001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89f0126560 0x7f89f0123e70 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f89e8003270 tx=0x7f89e8010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.639+0000 7f89e7fff700 1 --2- 172.21.15.84:0/538255001 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f89d403c790 0x7f89d403eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:14.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.639+0000 7f89f48d9700 1 -- 172.21.15.84:0/538255001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f005e1c0 con 0x7f89f0126560 2020-01-16T05:44:14.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.639+0000 7f89e7fff700 1 -- 172.21.15.84:0/538255001 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f89e804cdb0 con 0x7f89f0126560 2020-01-16T05:44:14.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.639+0000 7f89ef59e700 1 --2- 172.21.15.84:0/538255001 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f89d403c790 0x7f89d403eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.639+0000 7f89ef59e700 1 --2- 172.21.15.84:0/538255001 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f89d403c790 0x7f89d403eca0 crc :-1 s=READY pgs=78 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:14.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.647+0000 7f89f50da700 1 --2- 172.21.15.84:0/538255001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89f0126560 0x7f89f0123e70 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f89e8003270 tx=0x7f89e8010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.647+0000 7f89e7fff700 1 -- 172.21.15.84:0/538255001 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f89e80333d0 con 0x7f89f0126560 2020-01-16T05:44:14.762 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.759+0000 7f89f48d9700 1 -- 172.21.15.84:0/538255001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89f00a6160 con 0x7f89f0126560 2020-01-16T05:44:14.763 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.763+0000 7f89f50da700 1 --2- 172.21.15.84:0/538255001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89f0126560 0x7f89f0123e70 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f89e8003270 tx=0x7f89e8010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.763 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.763+0000 7f89e7fff700 1 -- 172.21.15.84:0/538255001 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f89e8033630 con 0x7f89f0126560 2020-01-16T05:44:14.763 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:14.764 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.763+0000 7f89f48d9700 1 -- 172.21.15.84:0/538255001 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f89d403c790 msgr2=0x7f89d403eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.764 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.763+0000 7f89f48d9700 1 --2- 172.21.15.84:0/538255001 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f89d403c790 0x7f89d403eca0 crc :-1 s=READY pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:14.764 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.763+0000 7f89f48d9700 1 -- 172.21.15.84:0/538255001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89f0126560 msgr2=0x7f89f0123e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.765 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.763+0000 7f89f48d9700 1 --2- 172.21.15.84:0/538255001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89f0126560 0x7f89f0123e70 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f89e8003270 tx=0x7f89e8010c50).stop 2020-01-16T05:44:14.765 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.763+0000 7f89f48d9700 1 -- 172.21.15.84:0/538255001 shutdown_connections 2020-01-16T05:44:14.765 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.763+0000 7f89f48d9700 1 --2- 172.21.15.84:0/538255001 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f89d403c790 0x7f89d403eca0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:14.765 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.763+0000 7f89f48d9700 1 --2- 172.21.15.84:0/538255001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89f0126560 0x7f89f0123e70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:14.765 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.763+0000 7f89f48d9700 1 -- 172.21.15.84:0/538255001 shutdown_connections 2020-01-16T05:44:14.765 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.763+0000 7f89f48d9700 1 -- 172.21.15.84:0/538255001 wait complete. 2020-01-16T05:44:14.765 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.763+0000 7f89f48d9700 1 -- 172.21.15.84:0/538255001 >> 172.21.15.84:0/538255001 conn(0x7f89f0066650 msgr2=0x7f89f00a8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:14.778 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:44:14.893 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.887+0000 7fa4acdde700 1 Processor -- start 2020-01-16T05:44:14.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.887+0000 7fa4acdde700 1 -- start start 2020-01-16T05:44:14.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4acdde700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4a805b0f0 0x7fa4a80a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:14.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4acdde700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a808fd80 0x7fa4a81503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:14.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4acdde700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a807cd60 con 0x7fa4a80a2f60 2020-01-16T05:44:14.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4acdde700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a80a3390 con 0x7fa4a805b0f0 2020-01-16T05:44:14.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4acdde700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80905b0 con 0x7fa4a808fd80 2020-01-16T05:44:14.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4a659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4a805b0f0 0x7fa4a80a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4a659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4a805b0f0 0x7fa4a80a8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34526/0 (socket says 172.21.15.84:34526) 2020-01-16T05:44:14.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4a659c700 1 -- 172.21.15.84:0/1091723253 learned_addr learned my addr 172.21.15.84:0/1091723253 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:14.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4a759e700 1 --2- 172.21.15.84:0/1091723253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a808fd80 0x7fa4a81503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4a659c700 1 -- 172.21.15.84:0/1091723253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a808fd80 msgr2=0x7fa4a81503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:14.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4a659c700 1 --2- 172.21.15.84:0/1091723253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a808fd80 0x7fa4a81503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:14.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4a659c700 1 -- 172.21.15.84:0/1091723253 >> v1:172.21.15.142:6789/0 conn(0x7fa4a80a2f60 legacy=0x7fa4a807c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4a659c700 1 -- 172.21.15.84:0/1091723253 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a805b520 con 0x7fa4a805b0f0 2020-01-16T05:44:14.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4a759e700 1 --2- 172.21.15.84:0/1091723253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a808fd80 0x7fa4a81503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:44:14.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4a659c700 1 --2- 172.21.15.84:0/1091723253 >> v2:172.21.15.84:3300/0 conn(0x7fa4a805b0f0 0x7fa4a80a8ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa4a8090770 tx=0x7fa49c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4a659c700 1 --2- 172.21.15.84:0/1091723253 >> v2:172.21.15.84:3300/0 conn(0x7fa4a805b0f0 0x7fa4a80a8ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa4a8090770 tx=0x7fa49c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4a659c700 1 --2- 172.21.15.84:0/1091723253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a805b0f0 0x7fa4a80a8ff0 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7fa4a8090770 tx=0x7fa49c00feb0).ready entity=mon.0 client_cookie=ef79d1968f7a60c8 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:14.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4a659c700 1 --2- 172.21.15.84:0/1091723253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a805b0f0 0x7fa4a80a8ff0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fa4a8090770 tx=0x7fa49c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4a5d9b700 1 -- 172.21.15.84:0/1091723253 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa49c011720 con 0x7fa4a805b0f0 2020-01-16T05:44:14.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4a659c700 1 --2- 172.21.15.84:0/1091723253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a805b0f0 0x7fa4a80a8ff0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fa4a8090770 tx=0x7fa49c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.897 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4a5d9b700 1 -- 172.21.15.84:0/1091723253 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c008d30 con 0x7fa4a805b0f0 2020-01-16T05:44:14.897 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4a659c700 1 --2- 172.21.15.84:0/1091723253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a805b0f0 0x7fa4a80a8ff0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fa4a8090770 tx=0x7fa49c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.897 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4a5d9b700 1 -- 172.21.15.84:0/1091723253 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa49c011d00 con 0x7fa4a805b0f0 2020-01-16T05:44:14.897 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4acdde700 1 -- 172.21.15.84:0/1091723253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a805b0f0 msgr2=0x7fa4a80a8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.897 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4acdde700 1 --2- 172.21.15.84:0/1091723253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a805b0f0 0x7fa4a80a8ff0 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7fa4a8090770 tx=0x7fa49c00feb0).stop 2020-01-16T05:44:14.897 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4acdde700 1 -- 172.21.15.84:0/1091723253 shutdown_connections 2020-01-16T05:44:14.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4acdde700 1 --2- 172.21.15.84:0/1091723253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a808fd80 0x7fa4a81503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:14.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4acdde700 1 --2- 172.21.15.84:0/1091723253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4a805b0f0 0x7fa4a80a8ff0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:14.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4acdde700 1 -- 172.21.15.84:0/1091723253 shutdown_connections 2020-01-16T05:44:14.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4acdde700 1 -- 172.21.15.84:0/1091723253 wait complete. 2020-01-16T05:44:14.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.891+0000 7fa4acdde700 1 -- 172.21.15.84:0/1091723253 >> 172.21.15.84:0/1091723253 conn(0x7fa4a80abc10 msgr2=0x7fa4a805a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:14.903 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4acdde700 1 Processor -- start 2020-01-16T05:44:14.903 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4acdde700 1 -- start start 2020-01-16T05:44:14.903 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4acdde700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a807f7a0 0x7fa4a814b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:14.903 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4acdde700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4a8069e80 0x7fa4a809df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:14.903 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4acdde700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a809e460 con 0x7fa4a807ea30 2020-01-16T05:44:14.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4acdde700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a8066d00 con 0x7fa4a8069e80 2020-01-16T05:44:14.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4acdde700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a814b9e0 con 0x7fa4a807f7a0 2020-01-16T05:44:14.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4a759e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa4a807ea30 0x7fa4a807cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51734/0 (socket says 172.21.15.84:51734) 2020-01-16T05:44:14.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4a759e700 1 -- 172.21.15.84:0/1235381749 learned_addr learned my addr 172.21.15.84:0/1235381749 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:14.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4a6d9d700 1 --2- 172.21.15.84:0/1235381749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a807f7a0 0x7fa4a814b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4a659c700 1 --2- 172.21.15.84:0/1235381749 >> v2:172.21.15.142:3300/0 conn(0x7fa4a8069e80 0x7fa4a809df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4977fe700 1 -- 172.21.15.84:0/1235381749 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116717901 0 0) 0x7fa4a809e460 con 0x7fa4a807ea30 2020-01-16T05:44:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4977fe700 1 -- 172.21.15.84:0/1235381749 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa48c003230 con 0x7fa4a807ea30 2020-01-16T05:44:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4a6d9d700 1 -- 172.21.15.84:0/1235381749 >> v2:172.21.15.142:3300/0 conn(0x7fa4a8069e80 msgr2=0x7fa4a809df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4a6d9d700 1 --2- 172.21.15.84:0/1235381749 >> v2:172.21.15.142:3300/0 conn(0x7fa4a8069e80 0x7fa4a809df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4a6d9d700 1 -- 172.21.15.84:0/1235381749 >> v1:172.21.15.84:6789/0 conn(0x7fa4a807ea30 legacy=0x7fa4a807cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4977fe700 1 -- 172.21.15.84:0/1235381749 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3575940379 0 0) 0x7fa48c003230 con 0x7fa4a807ea30 2020-01-16T05:44:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4a6d9d700 1 -- 172.21.15.84:0/1235381749 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a8146c70 con 0x7fa4a807f7a0 2020-01-16T05:44:14.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4a6d9d700 1 --2- 172.21.15.84:0/1235381749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a807f7a0 0x7fa4a814b3c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4980016d0 tx=0x7fa498002ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4a6d9d700 1 --2- 172.21.15.84:0/1235381749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a807f7a0 0x7fa4a814b3c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4980016d0 tx=0x7fa498002ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4a6d9d700 1 --2- 172.21.15.84:0/1235381749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a807f7a0 0x7fa4a814b3c0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fa4980016d0 tx=0x7fa498002ff0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:14.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4a6d9d700 1 --2- 172.21.15.84:0/1235381749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a807f7a0 0x7fa4a814b3c0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fa4980016d0 tx=0x7fa498002ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4977fe700 1 -- 172.21.15.84:0/1235381749 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa498001490 con 0x7fa4a807f7a0 2020-01-16T05:44:14.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4a6d9d700 1 --2- 172.21.15.84:0/1235381749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a807f7a0 0x7fa4a814b3c0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fa4980016d0 tx=0x7fa498002ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4977fe700 1 -- 172.21.15.84:0/1235381749 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4980012a0 con 0x7fa4a807f7a0 2020-01-16T05:44:14.907 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4a6d9d700 1 --2- 172.21.15.84:0/1235381749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a807f7a0 0x7fa4a814b3c0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fa4980016d0 tx=0x7fa498002ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.907 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4acdde700 1 -- 172.21.15.84:0/1235381749 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a807ee60 con 0x7fa4a807f7a0 2020-01-16T05:44:14.907 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4977fe700 1 -- 172.21.15.84:0/1235381749 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4a00103b0 con 0x7fa4a807f7a0 2020-01-16T05:44:14.907 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.895+0000 7fa4acdde700 1 -- 172.21.15.84:0/1235381749 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a807d7b0 con 0x7fa4a807f7a0 2020-01-16T05:44:14.907 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.899+0000 7fa4a6d9d700 1 --2- 172.21.15.84:0/1235381749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a807f7a0 0x7fa4a814b3c0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fa4980016d0 tx=0x7fa498002ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.907 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.899+0000 7fa4acdde700 1 -- 172.21.15.84:0/1235381749 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a805e1c0 con 0x7fa4a807f7a0 2020-01-16T05:44:14.908 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.899+0000 7fa4977fe700 1 -- 172.21.15.84:0/1235381749 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fa4a0006860 con 0x7fa4a807f7a0 2020-01-16T05:44:14.908 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.899+0000 7fa4a6d9d700 1 --2- 172.21.15.84:0/1235381749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a807f7a0 0x7fa4a814b3c0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fa4980016d0 tx=0x7fa498002ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.908 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.899+0000 7fa4977fe700 1 --2- 172.21.15.84:0/1235381749 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa48c03c800 0x7fa48c03ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:14.908 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.899+0000 7fa4977fe700 1 -- 172.21.15.84:0/1235381749 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7fa4a004c950 con 0x7fa4a807f7a0 2020-01-16T05:44:14.908 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.899+0000 7fa4a659c700 1 --2- 172.21.15.84:0/1235381749 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa48c03c800 0x7fa48c03ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:14.908 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.899+0000 7fa4a659c700 1 --2- 172.21.15.84:0/1235381749 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa48c03c800 0x7fa48c03ed10 crc :-1 s=READY pgs=79 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:14.909 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.907+0000 7fa4a6d9d700 1 --2- 172.21.15.84:0/1235381749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a807f7a0 0x7fa4a814b3c0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fa4980016d0 tx=0x7fa498002ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:14.909 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:14.907+0000 7fa4977fe700 1 -- 172.21.15.84:0/1235381749 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fa4a0032ed0 con 0x7fa4a807f7a0 2020-01-16T05:44:15.059 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.059+0000 7fa4acdde700 1 -- 172.21.15.84:0/1235381749 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4a808f350 con 0x7fa4a807f7a0 2020-01-16T05:44:15.060 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.059+0000 7fa4a6d9d700 1 --2- 172.21.15.84:0/1235381749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a807f7a0 0x7fa4a814b3c0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fa4980016d0 tx=0x7fa498002ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.060 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.059+0000 7fa4977fe700 1 -- 172.21.15.84:0/1235381749 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2102 (secure 0 0 0) 0x7fa4a0033130 con 0x7fa4a807f7a0 2020-01-16T05:44:15.060 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:15.061 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4359,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:44:07.656087+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4208":{"gid":4208,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.142:6833/1195730666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1195730666},{"type":"v1","addr":"172.21.15.142:6833","nonce":1195730666}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:44:15.066 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.059+0000 7fa4acdde700 1 -- 172.21.15.84:0/1235381749 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa48c03c800 msgr2=0x7fa48c03ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:15.066 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.059+0000 7fa4acdde700 1 --2- 172.21.15.84:0/1235381749 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa48c03c800 0x7fa48c03ed10 crc :-1 s=READY pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:15.066 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.059+0000 7fa4acdde700 1 -- 172.21.15.84:0/1235381749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a807f7a0 msgr2=0x7fa4a814b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:15.066 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.059+0000 7fa4acdde700 1 --2- 172.21.15.84:0/1235381749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a807f7a0 0x7fa4a814b3c0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fa4980016d0 tx=0x7fa498002ff0).stop 2020-01-16T05:44:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.059+0000 7fa4acdde700 1 -- 172.21.15.84:0/1235381749 shutdown_connections 2020-01-16T05:44:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.059+0000 7fa4acdde700 1 --2- 172.21.15.84:0/1235381749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a807f7a0 0x7fa4a814b3c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.059+0000 7fa4acdde700 1 --2- 172.21.15.84:0/1235381749 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa48c03c800 0x7fa48c03ed10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.059+0000 7fa4acdde700 1 --2- 172.21.15.84:0/1235381749 >> v2:172.21.15.142:3300/0 conn(0x7fa4a8069e80 0x7fa4a809df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.059+0000 7fa4acdde700 1 -- 172.21.15.84:0/1235381749 shutdown_connections 2020-01-16T05:44:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.059+0000 7fa4acdde700 1 -- 172.21.15.84:0/1235381749 wait complete. 2020-01-16T05:44:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.059+0000 7fa4acdde700 1 -- 172.21.15.84:0/1235381749 >> 172.21.15.84:0/1235381749 conn(0x7fa4a80aa110 msgr2=0x7fa4a8149160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 5 2020-01-16T05:44:15.281 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4208}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 5, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4208': {u'export_targets': [], u'name': u'b', u'incarnation': 4, u'state_seq': 2, u'state': u'up:active', u'gid': 4208, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1195730666, u'type': u'v2', u'addr': u'172.21.15.142:6832'}, {u'nonce': 1195730666, u'type': u'v1', u'addr': u'172.21.15.142:6833'}]}, u'addr': u'172.21.15.142:6833/1195730666'}}, u'fs_name': u'cephfs', u'created': u'2020-01-16T05:44:03.929689+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-16T05:44:07.656087+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-16T05:44:15.282 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-01-16T05:44:15.282 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-01-16T05:44:15.400 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-01-16T05:44:15.400 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "cbc67508-4d2a-4483-a1fc-95d371063ac4", 2020-01-16T05:44:15.401 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 0, 2020-01-16T05:44:15.401 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 4208, 2020-01-16T05:44:15.401 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2020-01-16T05:44:15.401 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2020-01-16T05:44:15.401 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 8.8843148719999991, 2020-01-16T05:44:15.401 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 5, 2020-01-16T05:44:15.401 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 24, 2020-01-16T05:44:15.402 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 24, 2020-01-16T05:44:15.402 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 9.083766486 2020-01-16T05:44:15.402 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-01-16T05:44:15.410 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "cbc67508-4d2a-4483-a1fc-95d371063ac4", "whoami": 0, "id": 4208, "want_state": "up:active", "state": "up:active", "rank_uptime": 8.8843148719999991, "mdsmap_epoch": 5, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "uptime": 9.083766486 } 2020-01-16T05:44:15.410 INFO:teuthology.run_tasks:Running task mds_thrash... 2020-01-16T05:44:15.427 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-16T05:44:15.550 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bd530700 1 Processor -- start 2020-01-16T05:44:15.550 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bd530700 1 -- start start 2020-01-16T05:44:15.550 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bd530700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd2b80a9b30 0x7fd2b80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:15.550 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bd530700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b807ff10 0x7fd2b8066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:15.550 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bd530700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b8066dd0 con 0x7fd2b80a4250 2020-01-16T05:44:15.550 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bd530700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b80a4830 con 0x7fd2b80a9b30 2020-01-16T05:44:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bd530700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b807f9d0 con 0x7fd2b807ff10 2020-01-16T05:44:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bcd2f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd2b80a9b30 0x7fd2b80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2be792700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd2b80a4250 0x7fd2b80a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51742/0 (socket says 172.21.15.84:51742) 2020-01-16T05:44:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2be792700 1 -- 172.21.15.84:0/3233839143 learned_addr learned my addr 172.21.15.84:0/3233839143 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2b7fff700 1 --2- 172.21.15.84:0/3233839143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b807ff10 0x7fd2b8066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2b77fe700 1 -- 172.21.15.84:0/3233839143 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987919291 0 0) 0x7fd2b8066dd0 con 0x7fd2b80a4250 2020-01-16T05:44:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2b77fe700 1 -- 172.21.15.84:0/3233839143 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2a8003230 con 0x7fd2b80a4250 2020-01-16T05:44:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bcd2f700 1 -- 172.21.15.84:0/3233839143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b807ff10 msgr2=0x7fd2b8066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/3233839143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b807ff10 0x7fd2b8066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bcd2f700 1 -- 172.21.15.84:0/3233839143 >> v1:172.21.15.84:6789/0 conn(0x7fd2b80a4250 legacy=0x7fd2b80a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bcd2f700 1 -- 172.21.15.84:0/3233839143 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b8150ce0 con 0x7fd2b80a9b30 2020-01-16T05:44:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/3233839143 >> v2:172.21.15.84:3300/0 conn(0x7fd2b80a9b30 0x7fd2b80abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd2ac008910 tx=0x7fd2ac00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/3233839143 >> v2:172.21.15.84:3300/0 conn(0x7fd2b80a9b30 0x7fd2b80abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd2ac008910 tx=0x7fd2ac00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.553 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/3233839143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2b80a9b30 0x7fd2b80abdd0 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7fd2ac008910 tx=0x7fd2ac00fdf0).ready entity=mon.0 client_cookie=c171871e82f9013b server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:15.553 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/3233839143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2b80a9b30 0x7fd2b80abdd0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7fd2ac008910 tx=0x7fd2ac00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.553 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2b77fe700 1 -- 172.21.15.84:0/3233839143 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2ac011660 con 0x7fd2b80a9b30 2020-01-16T05:44:15.553 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/3233839143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2b80a9b30 0x7fd2b80abdd0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7fd2ac008910 tx=0x7fd2ac00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/3233839143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2b80a9b30 0x7fd2b80abdd0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7fd2ac008910 tx=0x7fd2ac00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2b77fe700 1 -- 172.21.15.84:0/3233839143 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac008c50 con 0x7fd2b80a9b30 2020-01-16T05:44:15.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2b77fe700 1 -- 172.21.15.84:0/3233839143 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2ac011c40 con 0x7fd2b80a9b30 2020-01-16T05:44:15.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bd530700 1 -- 172.21.15.84:0/3233839143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2b80a9b30 msgr2=0x7fd2b80abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:15.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bd530700 1 --2- 172.21.15.84:0/3233839143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2b80a9b30 0x7fd2b80abdd0 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7fd2ac008910 tx=0x7fd2ac00fdf0).stop 2020-01-16T05:44:15.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bd530700 1 -- 172.21.15.84:0/3233839143 shutdown_connections 2020-01-16T05:44:15.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bd530700 1 --2- 172.21.15.84:0/3233839143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2b80a9b30 0x7fd2b80abdd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:15.555 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bd530700 1 --2- 172.21.15.84:0/3233839143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b807ff10 0x7fd2b8066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:15.555 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bd530700 1 -- 172.21.15.84:0/3233839143 shutdown_connections 2020-01-16T05:44:15.555 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bd530700 1 -- 172.21.15.84:0/3233839143 wait complete. 2020-01-16T05:44:15.555 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.547+0000 7fd2bd530700 1 -- 172.21.15.84:0/3233839143 >> 172.21.15.84:0/3233839143 conn(0x7fd2b80acfc0 msgr2=0x7fd2b80a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:15.559 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bd530700 1 Processor -- start 2020-01-16T05:44:15.559 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bd530700 1 -- start start 2020-01-16T05:44:15.559 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bd530700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b8024a20 0x7fd2b8091160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:15.559 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bd530700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b8091d90 con 0x7fd2b8134920 2020-01-16T05:44:15.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bd530700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b80a3480 con 0x7fd2b81265e0 2020-01-16T05:44:15.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bd530700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b8126ba0 con 0x7fd2b8024a20 2020-01-16T05:44:15.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bcd2f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd2b8134920 0x7fd2b8125290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51744/0 (socket says 172.21.15.84:51744) 2020-01-16T05:44:15.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bcd2f700 1 -- 172.21.15.84:0/2281088249 learned_addr learned my addr 172.21.15.84:0/2281088249 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:15.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b7fff700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b8024a20 0x7fd2b8091160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:15.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b57fa700 1 -- 172.21.15.84:0/2281088249 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171645134 0 0) 0x7fd2b8091d90 con 0x7fd2b8134920 2020-01-16T05:44:15.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b57fa700 1 -- 172.21.15.84:0/2281088249 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd298003230 con 0x7fd2b8134920 2020-01-16T05:44:15.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b57fa700 1 -- 172.21.15.84:0/2281088249 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2627052097 0 0) 0x7fd298003230 con 0x7fd2b8134920 2020-01-16T05:44:15.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b57fa700 1 -- 172.21.15.84:0/2281088249 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd2b8091d90 con 0x7fd2b8134920 2020-01-16T05:44:15.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b57fa700 1 -- 172.21.15.84:0/2281088249 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7fd2ac007a70 con 0x7fd2b8134920 2020-01-16T05:44:15.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b57fa700 1 -- 172.21.15.84:0/2281088249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b8024a20 msgr2=0x7fd2b8091160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:15.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b57fa700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b8024a20 0x7fd2b8091160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:15.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b57fa700 1 -- 172.21.15.84:0/2281088249 >> v1:172.21.15.142:6789/0 conn(0x7fd2b81265e0 legacy=0x7fd2b813f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:15.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b57fa700 1 -- 172.21.15.84:0/2281088249 >> v1:172.21.15.84:6789/0 conn(0x7fd2b8134920 legacy=0x7fd2b8125290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:15.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b57fa700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd298003a20 0x7fd298003e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:15.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b57fa700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2980045a0 0x7fd2980049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:15.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b57fa700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd298004f20 0x7fd29800b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:15.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b57fa700 1 -- 172.21.15.84:0/2281088249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b8126ba0 con 0x7fd298003a20 2020-01-16T05:44:15.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b57fa700 1 -- 172.21.15.84:0/2281088249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29800bd40 con 0x7fd298004f20 2020-01-16T05:44:15.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b57fa700 1 -- 172.21.15.84:0/2281088249 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29800bf00 con 0x7fd2980045a0 2020-01-16T05:44:15.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd298003a20 0x7fd298003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:15.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b7fff700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2980045a0 0x7fd2980049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:15.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2be792700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd298004f20 0x7fd29800b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:15.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bcd2f700 1 -- 172.21.15.84:0/2281088249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2980045a0 msgr2=0x7fd2980049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:15.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2980045a0 0x7fd2980049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:15.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bcd2f700 1 -- 172.21.15.84:0/2281088249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd298004f20 msgr2=0x7fd29800b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:15.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd298004f20 0x7fd29800b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:15.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bcd2f700 1 -- 172.21.15.84:0/2281088249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b80ab090 con 0x7fd298003a20 2020-01-16T05:44:15.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b7fff700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2980045a0 0x7fd2980049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-01-16T05:44:15.568 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bd530700 1 -- 172.21.15.84:0/2281088249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b8024a20 con 0x7fd298003a20 2020-01-16T05:44:15.568 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd298003a20 0x7fd298003e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd298005570 tx=0x7fd2ac008f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.569 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2be792700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd298004f20 0x7fd29800b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-01-16T05:44:15.569 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bd530700 1 -- 172.21.15.84:0/2281088249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b8091160 con 0x7fd298003a20 2020-01-16T05:44:15.569 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd298003a20 0x7fd298003e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd298005570 tx=0x7fd2ac008f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.569 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd298003a20 0x7fd298003e90 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7fd298005570 tx=0x7fd2ac008f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:15.569 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd298003a20 0x7fd298003e90 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fd298005570 tx=0x7fd2ac008f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.569 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b57fa700 1 -- 172.21.15.84:0/2281088249 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2ac007490 con 0x7fd298003a20 2020-01-16T05:44:15.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd298003a20 0x7fd298003e90 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fd298005570 tx=0x7fd2ac008f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b57fa700 1 -- 172.21.15.84:0/2281088249 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac0070b0 con 0x7fd298003a20 2020-01-16T05:44:15.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd298003a20 0x7fd298003e90 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fd298005570 tx=0x7fd2ac008f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2b57fa700 1 -- 172.21.15.84:0/2281088249 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2ac00b830 con 0x7fd298003a20 2020-01-16T05:44:15.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd298003a20 0x7fd298003e90 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fd298005570 tx=0x7fd2ac008f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.551+0000 7fd2bd530700 1 -- 172.21.15.84:0/2281088249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd290003360 con 0x7fd298003a20 2020-01-16T05:44:15.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.555+0000 7fd2b57fa700 1 -- 172.21.15.84:0/2281088249 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fd2ac00ba30 con 0x7fd298003a20 2020-01-16T05:44:15.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.555+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd298003a20 0x7fd298003e90 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fd298005570 tx=0x7fd2ac008f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.555+0000 7fd2b57fa700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd298045170 0x7fd298047680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:15.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.555+0000 7fd2b57fa700 1 -- 172.21.15.84:0/2281088249 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7fd2ac091590 con 0x7fd298003a20 2020-01-16T05:44:15.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.555+0000 7fd2b7fff700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd298045170 0x7fd298047680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:15.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.555+0000 7fd2b7fff700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd298045170 0x7fd298047680 crc :-1 s=READY pgs=80 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:15.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.555+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd298003a20 0x7fd298003e90 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fd298005570 tx=0x7fd2ac008f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.555+0000 7fd2b57fa700 1 -- 172.21.15.84:0/2281088249 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fd2ac077b90 con 0x7fd298003a20 2020-01-16T05:44:15.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.675+0000 7fd2bd530700 1 -- 172.21.15.84:0/2281088249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2900021f0 con 0x7fd298003a20 2020-01-16T05:44:15.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.675+0000 7fd2bcd2f700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd298003a20 0x7fd298003e90 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fd298005570 tx=0x7fd2ac008f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.675+0000 7fd2b57fa700 1 -- 172.21.15.84:0/2281088249 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14672 (secure 0 0 0) 0x7fd2ac077df0 con 0x7fd298003a20 2020-01-16T05:44:15.677 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:15.677 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"cbc67508-4d2a-4483-a1fc-95d371063ac4","created":"2020-01-16T05:43:46.771497+0000","modified":"2020-01-16T05:44:05.941278+0000","last_up_change":"2020-01-16T05:43:55.529492+0000","last_in_change":"2020-01-16T05:43:55.529492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-16T05:43:59.152708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-16T05:44:01.682783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-16T05:44:02.930765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15da60bb-4d16-44cc-80c6-cd2c7fa77364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":12644},{"type":"v1","addr":"172.21.15.84:6812","nonce":12644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":12644},{"type":"v1","addr":"172.21.15.84:6816","nonce":12644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":12644},{"type":"v1","addr":"172.21.15.84:6824","nonce":12644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":12644},{"type":"v1","addr":"172.21.15.84:6820","nonce":12644}]},"public_addr":"172.21.15.84:6812/12644","cluster_addr":"172.21.15.84:6816/12644","heartbeat_back_addr":"172.21.15.84:6824/12644","heartbeat_front_addr":"172.21.15.84:6820/12644","state":["exists","up"]},{"osd":1,"uuid":"0800533c-1d5b-4f9f-99bb-34b8133c8b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":12645},{"type":"v1","addr":"172.21.15.84:6803","nonce":12645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":12645},{"type":"v1","addr":"172.21.15.84:6805","nonce":12645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":12645},{"type":"v1","addr":"172.21.15.84:6809","nonce":12645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":12645},{"type":"v1","addr":"172.21.15.84:6807","nonce":12645}]},"public_addr":"172.21.15.84:6803/12645","cluster_addr":"172.21.15.84:6805/12645","heartbeat_back_addr":"172.21.15.84:6809/12645","heartbeat_front_addr":"172.21.15.84:6807/12645","state":["exists","up"]},{"osd":2,"uuid":"519cc27f-5cf9-4ecf-ad66-f722c37339df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":12646},{"type":"v1","addr":"172.21.15.84:6813","nonce":12646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6815","nonce":12646},{"type":"v1","addr":"172.21.15.84:6817","nonce":12646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":12646},{"type":"v1","addr":"172.21.15.84:6825","nonce":12646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":12646},{"type":"v1","addr":"172.21.15.84:6821","nonce":12646}]},"public_addr":"172.21.15.84:6813/12646","cluster_addr":"172.21.15.84:6817/12646","heartbeat_back_addr":"172.21.15.84:6825/12646","heartbeat_front_addr":"172.21.15.84:6821/12646","state":["exists","up"]},{"osd":3,"uuid":"aec305a6-bbac-4e01-8ea1-6077d49e27e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":12647},{"type":"v1","addr":"172.21.15.84:6827","nonce":12647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":12647},{"type":"v1","addr":"172.21.15.84:6829","nonce":12647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":12647},{"type":"v1","addr":"172.21.15.84:6833","nonce":12647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":12647},{"type":"v1","addr":"172.21.15.84:6831","nonce":12647}]},"public_addr":"172.21.15.84:6827/12647","cluster_addr":"172.21.15.84:6829/12647","heartbeat_back_addr":"172.21.15.84:6833/12647","heartbeat_front_addr":"172.21.15.84:6831/12647","state":["exists","up"]},{"osd":4,"uuid":"aaec7f3e-299a-4546-8406-207bcc4b3afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":12842},{"type":"v1","addr":"172.21.15.142:6801","nonce":12842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12842},{"type":"v1","addr":"172.21.15.142:6803","nonce":12842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12842},{"type":"v1","addr":"172.21.15.142:6807","nonce":12842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12842},{"type":"v1","addr":"172.21.15.142:6805","nonce":12842}]},"public_addr":"172.21.15.142:6801/12842","cluster_addr":"172.21.15.142:6803/12842","heartbeat_back_addr":"172.21.15.142:6807/12842","heartbeat_front_addr":"172.21.15.142:6805/12842","state":["exists","up"]},{"osd":5,"uuid":"5a942a47-7346-46d4-adf8-dad2bdb95aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12843},{"type":"v1","addr":"172.21.15.142:6809","nonce":12843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12843},{"type":"v1","addr":"172.21.15.142:6811","nonce":12843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12843},{"type":"v1","addr":"172.21.15.142:6815","nonce":12843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12843},{"type":"v1","addr":"172.21.15.142:6813","nonce":12843}]},"public_addr":"172.21.15.142:6809/12843","cluster_addr":"172.21.15.142:6811/12843","heartbeat_back_addr":"172.21.15.142:6815/12843","heartbeat_front_addr":"172.21.15.142:6813/12843","state":["exists","up"]},{"osd":6,"uuid":"c69fca67-66e4-4c31-ab03-1419e2a83e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12844},{"type":"v1","addr":"172.21.15.142:6818","nonce":12844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":12844},{"type":"v1","addr":"172.21.15.142:6823","nonce":12844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":12844},{"type":"v1","addr":"172.21.15.142:6831","nonce":12844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":12844},{"type":"v1","addr":"172.21.15.142:6827","nonce":12844}]},"public_addr":"172.21.15.142:6818/12844","cluster_addr":"172.21.15.142:6823/12844","heartbeat_back_addr":"172.21.15.142:6831/12844","heartbeat_front_addr":"172.21.15.142:6827/12844","state":["exists","up"]},{"osd":7,"uuid":"c436f64e-aa1f-435b-ac7b-85633e297591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":12845},{"type":"v1","addr":"172.21.15.142:6819","nonce":12845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12845},{"type":"v1","addr":"172.21.15.142:6822","nonce":12845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12845},{"type":"v1","addr":"172.21.15.142:6830","nonce":12845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12845},{"type":"v1","addr":"172.21.15.142:6826","nonce":12845}]},"public_addr":"172.21.15.142:6819/12845","cluster_addr":"172.21.15.142:6822/12845","heartbeat_back_addr":"172.21.15.142:6830/12845","heartbeat_front_addr":"172.21.15.142:6826/12845","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.534744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.505453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.485516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.333028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.483323+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.567824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.273268+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.559741+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-16T05:44:15.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.679+0000 7fd2bd530700 1 -- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd298045170 msgr2=0x7fd298047680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:15.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.679+0000 7fd2bd530700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd298045170 0x7fd298047680 crc :-1 s=READY pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:15.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.679+0000 7fd2bd530700 1 -- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd298003a20 msgr2=0x7fd298003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:15.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.679+0000 7fd2bd530700 1 --2- 172.21.15.84:0/2281088249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd298003a20 0x7fd298003e90 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7fd298005570 tx=0x7fd2ac008f20).stop 2020-01-16T05:44:15.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.679+0000 7fd2be792700 1 -- 172.21.15.84:0/2281088249 reap_dead start 2020-01-16T05:44:15.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.679+0000 7fd2be792700 1 -- 172.21.15.84:0/2281088249 reap_dead start 2020-01-16T05:44:15.680 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.679+0000 7fd2bd530700 1 -- 172.21.15.84:0/2281088249 shutdown_connections 2020-01-16T05:44:15.680 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.679+0000 7fd2bd530700 1 -- 172.21.15.84:0/2281088249 shutdown_connections 2020-01-16T05:44:15.680 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.679+0000 7fd2bd530700 1 -- 172.21.15.84:0/2281088249 wait complete. 2020-01-16T05:44:15.680 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.679+0000 7fd2bd530700 1 -- 172.21.15.84:0/2281088249 >> 172.21.15.84:0/2281088249 conn(0x7fd2b80a8e90 msgr2=0x7fd2b8065550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:15.691 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:43:59.152708+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:44:01.682783+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:44:02.930765+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-16T05:44:15.691 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-16T05:44:15.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86072c7700 1 Processor -- start 2020-01-16T05:44:15.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86072c7700 1 -- start start 2020-01-16T05:44:15.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86072c7700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f860007ff10 0x7f86000abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:15.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86072c7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86000a4250 0x7f8600066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:15.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86072c7700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8600066dd0 con 0x7f86000a9b30 2020-01-16T05:44:15.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86072c7700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86000a4830 con 0x7f860007ff10 2020-01-16T05:44:15.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86072c7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860007f9d0 con 0x7f86000a4250 2020-01-16T05:44:15.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f8608529700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86000a4250 0x7f8600066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:15.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86062c5700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f860007ff10 0x7f86000abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:15.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86062c5700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f860007ff10 0x7f86000abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.84:44544/0 (socket says 172.21.15.84:44544) 2020-01-16T05:44:15.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f8608529700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86000a4250 0x7f8600066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:46806/0 (socket says 172.21.15.84:46806) 2020-01-16T05:44:15.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86062c5700 1 -- 172.21.15.84:0/1798631794 learned_addr learned my addr 172.21.15.84:0/1798631794 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:15.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f8606ac6700 1 --1- 172.21.15.84:0/1798631794 >> v1:172.21.15.142:6789/0 conn(0x7f86000a9b30 0x7f86000a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:49984/0 (socket says 172.21.15.84:49984) 2020-01-16T05:44:15.826 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86062c5700 1 -- 172.21.15.84:0/1798631794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86000a4250 msgr2=0x7f8600066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:15.826 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86062c5700 1 --2- 172.21.15.84:0/1798631794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86000a4250 0x7f8600066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:15.826 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86062c5700 1 -- 172.21.15.84:0/1798631794 >> v1:172.21.15.142:6789/0 conn(0x7f86000a9b30 legacy=0x7f86000a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:15.826 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86062c5700 1 -- 172.21.15.84:0/1798631794 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8600150ce0 con 0x7f860007ff10 2020-01-16T05:44:15.826 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86062c5700 1 --2- 172.21.15.84:0/1798631794 >> v2:172.21.15.142:3300/0 conn(0x7f860007ff10 0x7f86000abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f86000a49f0 tx=0x7f85f000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.826 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86062c5700 1 --2- 172.21.15.84:0/1798631794 >> v2:172.21.15.142:3300/0 conn(0x7f860007ff10 0x7f86000abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f86000a49f0 tx=0x7f85f000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.826 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86062c5700 1 --2- 172.21.15.84:0/1798631794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f860007ff10 0x7f86000abdd0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f86000a49f0 tx=0x7f85f000feb0).ready entity=mon.1 client_cookie=2a944a3cb0db19f6 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:15.827 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86062c5700 1 --2- 172.21.15.84:0/1798631794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f860007ff10 0x7f86000abdd0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f86000a49f0 tx=0x7f85f000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.827 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86062c5700 1 --2- 172.21.15.84:0/1798631794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f860007ff10 0x7f86000abdd0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f86000a49f0 tx=0x7f85f000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.827 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f8605ac4700 1 -- 172.21.15.84:0/1798631794 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85f0011720 con 0x7f860007ff10 2020-01-16T05:44:15.827 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.811+0000 7f86062c5700 1 --2- 172.21.15.84:0/1798631794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f860007ff10 0x7f86000abdd0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f86000a49f0 tx=0x7f85f000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.827 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.815+0000 7f8605ac4700 1 -- 172.21.15.84:0/1798631794 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f0008d30 con 0x7f860007ff10 2020-01-16T05:44:15.827 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.815+0000 7f8605ac4700 1 -- 172.21.15.84:0/1798631794 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85f0011d00 con 0x7f860007ff10 2020-01-16T05:44:15.827 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.815+0000 7f86072c7700 1 -- 172.21.15.84:0/1798631794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f860007ff10 msgr2=0x7f86000abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:15.827 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.815+0000 7f86072c7700 1 --2- 172.21.15.84:0/1798631794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f860007ff10 0x7f86000abdd0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f86000a49f0 tx=0x7f85f000feb0).stop 2020-01-16T05:44:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.815+0000 7f86072c7700 1 -- 172.21.15.84:0/1798631794 shutdown_connections 2020-01-16T05:44:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.815+0000 7f86072c7700 1 --2- 172.21.15.84:0/1798631794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86000a4250 0x7f8600066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.815+0000 7f86072c7700 1 --2- 172.21.15.84:0/1798631794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f860007ff10 0x7f86000abdd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.815+0000 7f86072c7700 1 -- 172.21.15.84:0/1798631794 shutdown_connections 2020-01-16T05:44:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.815+0000 7f86072c7700 1 -- 172.21.15.84:0/1798631794 wait complete. 2020-01-16T05:44:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.815+0000 7f86072c7700 1 -- 172.21.15.84:0/1798631794 >> 172.21.15.84:0/1798631794 conn(0x7f86000acfc0 msgr2=0x7f86000a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.815+0000 7f86072c7700 1 Processor -- start 2020-01-16T05:44:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.815+0000 7f86072c7700 1 -- start start 2020-01-16T05:44:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f86072c7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f860007a8e0 0x7f8600079da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f86072c7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f860007b9d0 0x7f860007be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f86072c7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860009fae0 con 0x7f860007f160 2020-01-16T05:44:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f86072c7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860007a3a0 con 0x7f860007a8e0 2020-01-16T05:44:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f86072c7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860007a640 con 0x7f860007b9d0 2020-01-16T05:44:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f8606ac6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f860007a8e0 0x7f8600079da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f86062c5700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f860007f160 0x7f860009f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51766/0 (socket says 172.21.15.84:51766) 2020-01-16T05:44:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f86062c5700 1 -- 172.21.15.84:0/2752436632 learned_addr learned my addr 172.21.15.84:0/2752436632 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f8608529700 1 --2- 172.21.15.84:0/2752436632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f860007b9d0 0x7f860007be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f85f77fe700 1 -- 172.21.15.84:0/2752436632 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079919910 0 0) 0x7f860009fae0 con 0x7f860007f160 2020-01-16T05:44:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f85f77fe700 1 -- 172.21.15.84:0/2752436632 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85e8003230 con 0x7f860007f160 2020-01-16T05:44:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f8606ac6700 1 -- 172.21.15.84:0/2752436632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f860007b9d0 msgr2=0x7f860007be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f8606ac6700 1 --2- 172.21.15.84:0/2752436632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f860007b9d0 0x7f860007be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f8606ac6700 1 -- 172.21.15.84:0/2752436632 >> v1:172.21.15.84:6789/0 conn(0x7f860007f160 legacy=0x7f860009f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f8606ac6700 1 -- 172.21.15.84:0/2752436632 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8600126a40 con 0x7f860007a8e0 2020-01-16T05:44:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f8606ac6700 1 --2- 172.21.15.84:0/2752436632 >> v2:172.21.15.84:3300/0 conn(0x7f860007a8e0 0x7f8600079da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8600126040 tx=0x7f85fc00c4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f8606ac6700 1 --2- 172.21.15.84:0/2752436632 >> v2:172.21.15.84:3300/0 conn(0x7f860007a8e0 0x7f8600079da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8600126040 tx=0x7f85fc00c4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f8606ac6700 1 --2- 172.21.15.84:0/2752436632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f860007a8e0 0x7f8600079da0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f8600126040 tx=0x7f85fc00c4f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f8606ac6700 1 --2- 172.21.15.84:0/2752436632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f860007a8e0 0x7f8600079da0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f8600126040 tx=0x7f85fc00c4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f85f77fe700 1 -- 172.21.15.84:0/2752436632 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85fc00c950 con 0x7f860007a8e0 2020-01-16T05:44:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f8606ac6700 1 --2- 172.21.15.84:0/2752436632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f860007a8e0 0x7f8600079da0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f8600126040 tx=0x7f85fc00c4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f8606ac6700 1 --2- 172.21.15.84:0/2752436632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f860007a8e0 0x7f8600079da0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f8600126040 tx=0x7f85fc00c4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f85f77fe700 1 -- 172.21.15.84:0/2752436632 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85fc00c570 con 0x7f860007a8e0 2020-01-16T05:44:15.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f86072c7700 1 -- 172.21.15.84:0/2752436632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860013d110 con 0x7f860007a8e0 2020-01-16T05:44:15.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f85f77fe700 1 -- 172.21.15.84:0/2752436632 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85fc0044f0 con 0x7f860007a8e0 2020-01-16T05:44:15.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f86072c7700 1 -- 172.21.15.84:0/2752436632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860013d5e0 con 0x7f860007a8e0 2020-01-16T05:44:15.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f8606ac6700 1 --2- 172.21.15.84:0/2752436632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f860007a8e0 0x7f8600079da0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f8600126040 tx=0x7f85fc00c4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f86072c7700 1 -- 172.21.15.84:0/2752436632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860005e1c0 con 0x7f860007a8e0 2020-01-16T05:44:15.833 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f85f77fe700 1 -- 172.21.15.84:0/2752436632 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f85fc004800 con 0x7f860007a8e0 2020-01-16T05:44:15.833 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.819+0000 7f8606ac6700 1 --2- 172.21.15.84:0/2752436632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f860007a8e0 0x7f8600079da0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f8600126040 tx=0x7f85fc00c4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.833 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.823+0000 7f85f77fe700 1 --2- 172.21.15.84:0/2752436632 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f85e803c7d0 0x7f85e803ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:15.834 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.823+0000 7f85f77fe700 1 -- 172.21.15.84:0/2752436632 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f85fc04c660 con 0x7f860007a8e0 2020-01-16T05:44:15.834 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.823+0000 7f86062c5700 1 --2- 172.21.15.84:0/2752436632 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f85e803c7d0 0x7f85e803ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:15.834 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.823+0000 7f86062c5700 1 --2- 172.21.15.84:0/2752436632 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f85e803c7d0 0x7f85e803ece0 crc :-1 s=READY pgs=81 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:15.835 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.823+0000 7f8606ac6700 1 --2- 172.21.15.84:0/2752436632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f860007a8e0 0x7f8600079da0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f8600126040 tx=0x7f85fc00c4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.835 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.823+0000 7f85f77fe700 1 -- 172.21.15.84:0/2752436632 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f85fc032c80 con 0x7f860007a8e0 2020-01-16T05:44:15.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.943+0000 7f86072c7700 1 -- 172.21.15.84:0/2752436632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f860005f1e0 con 0x7f860007a8e0 2020-01-16T05:44:15.944 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.943+0000 7f8606ac6700 1 --2- 172.21.15.84:0/2752436632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f860007a8e0 0x7f8600079da0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f8600126040 tx=0x7f85fc00c4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:15.944 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.943+0000 7f85f77fe700 1 -- 172.21.15.84:0/2752436632 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f85fc032ee0 con 0x7f860007a8e0 2020-01-16T05:44:15.944 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:15.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.943+0000 7f86072c7700 1 -- 172.21.15.84:0/2752436632 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f85e803c7d0 msgr2=0x7f85e803ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:15.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.943+0000 7f86072c7700 1 --2- 172.21.15.84:0/2752436632 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f85e803c7d0 0x7f85e803ece0 crc :-1 s=READY pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:15.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.943+0000 7f86072c7700 1 -- 172.21.15.84:0/2752436632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f860007a8e0 msgr2=0x7f8600079da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:15.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.943+0000 7f86072c7700 1 --2- 172.21.15.84:0/2752436632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f860007a8e0 0x7f8600079da0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f8600126040 tx=0x7f85fc00c4f0).stop 2020-01-16T05:44:15.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.943+0000 7f86072c7700 1 -- 172.21.15.84:0/2752436632 shutdown_connections 2020-01-16T05:44:15.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.943+0000 7f86072c7700 1 --2- 172.21.15.84:0/2752436632 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f85e803c7d0 0x7f85e803ece0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:15.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.943+0000 7f86072c7700 1 --2- 172.21.15.84:0/2752436632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f860007b9d0 0x7f860007be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:15.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.943+0000 7f86072c7700 1 --2- 172.21.15.84:0/2752436632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f860007a8e0 0x7f8600079da0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:15.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.943+0000 7f86072c7700 1 -- 172.21.15.84:0/2752436632 shutdown_connections 2020-01-16T05:44:15.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.943+0000 7f86072c7700 1 -- 172.21.15.84:0/2752436632 wait complete. 2020-01-16T05:44:15.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:15.943+0000 7f86072c7700 1 -- 172.21.15.84:0/2752436632 >> 172.21.15.84:0/2752436632 conn(0x7f86000a9b30 msgr2=0x7f86001270a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:15.957 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-01-16T05:44:16.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f64108c7700 1 Processor -- start 2020-01-16T05:44:16.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f64108c7700 1 -- start start 2020-01-16T05:44:16.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f64108c7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f640c07ff10 0x7f640c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:16.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f64108c7700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f640c0a4250 0x7f640c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:16.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f64108c7700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c066dd0 con 0x7f640c0a9b30 2020-01-16T05:44:16.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f64108c7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640c0a4830 con 0x7f640c07ff10 2020-01-16T05:44:16.081 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f64108c7700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640c07f9d0 con 0x7f640c0a4250 2020-01-16T05:44:16.081 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f640ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f640c07ff10 0x7f640c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.081 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f640ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f640c07ff10 0x7f640c0abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34574/0 (socket says 172.21.15.84:34574) 2020-01-16T05:44:16.081 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f640ad9d700 1 -- 172.21.15.84:0/540178848 learned_addr learned my addr 172.21.15.84:0/540178848 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:16.081 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f64110c8700 1 --2- 172.21.15.84:0/540178848 >> v2:172.21.15.142:3300/0 conn(0x7f640c0a4250 0x7f640c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.081 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f640ad9d700 1 -- 172.21.15.84:0/540178848 >> v2:172.21.15.142:3300/0 conn(0x7f640c0a4250 msgr2=0x7f640c066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:16.081 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f640ad9d700 1 --2- 172.21.15.84:0/540178848 >> v2:172.21.15.142:3300/0 conn(0x7f640c0a4250 0x7f640c066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:16.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f640ad9d700 1 -- 172.21.15.84:0/540178848 >> v1:172.21.15.142:6789/0 conn(0x7f640c0a9b30 legacy=0x7f640c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f640ad9d700 1 -- 172.21.15.84:0/540178848 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c150ce0 con 0x7f640c07ff10 2020-01-16T05:44:16.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f640ad9d700 1 --2- 172.21.15.84:0/540178848 >> v2:172.21.15.84:3300/0 conn(0x7f640c07ff10 0x7f640c0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f640c0a49f0 tx=0x7f63f400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f640ad9d700 1 --2- 172.21.15.84:0/540178848 >> v2:172.21.15.84:3300/0 conn(0x7f640c07ff10 0x7f640c0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f640c0a49f0 tx=0x7f63f400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f640ad9d700 1 --2- 172.21.15.84:0/540178848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f640c07ff10 0x7f640c0abdd0 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7f640c0a49f0 tx=0x7f63f400feb0).ready entity=mon.0 client_cookie=eb194a83667497cd server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:16.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f640ad9d700 1 --2- 172.21.15.84:0/540178848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f640c07ff10 0x7f640c0abdd0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f640c0a49f0 tx=0x7f63f400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f640ad9d700 1 --2- 172.21.15.84:0/540178848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f640c07ff10 0x7f640c0abdd0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f640c0a49f0 tx=0x7f63f400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f640a59c700 1 -- 172.21.15.84:0/540178848 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63f40116e0 con 0x7f640c07ff10 2020-01-16T05:44:16.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f640ad9d700 1 --2- 172.21.15.84:0/540178848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f640c07ff10 0x7f640c0abdd0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f640c0a49f0 tx=0x7f63f400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f640a59c700 1 -- 172.21.15.84:0/540178848 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f4008d30 con 0x7f640c07ff10 2020-01-16T05:44:16.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f640a59c700 1 -- 172.21.15.84:0/540178848 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63f4011cc0 con 0x7f640c07ff10 2020-01-16T05:44:16.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f64108c7700 1 -- 172.21.15.84:0/540178848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f640c07ff10 msgr2=0x7f640c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.075+0000 7f64108c7700 1 --2- 172.21.15.84:0/540178848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f640c07ff10 0x7f640c0abdd0 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7f640c0a49f0 tx=0x7f63f400feb0).stop 2020-01-16T05:44:16.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.079+0000 7f64108c7700 1 -- 172.21.15.84:0/540178848 shutdown_connections 2020-01-16T05:44:16.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.079+0000 7f64108c7700 1 --2- 172.21.15.84:0/540178848 >> v2:172.21.15.142:3300/0 conn(0x7f640c0a4250 0x7f640c066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:16.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.079+0000 7f64108c7700 1 --2- 172.21.15.84:0/540178848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f640c07ff10 0x7f640c0abdd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.079+0000 7f64108c7700 1 -- 172.21.15.84:0/540178848 shutdown_connections 2020-01-16T05:44:16.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.079+0000 7f64108c7700 1 -- 172.21.15.84:0/540178848 wait complete. 2020-01-16T05:44:16.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.079+0000 7f64108c7700 1 -- 172.21.15.84:0/540178848 >> 172.21.15.84:0/540178848 conn(0x7f640c0acfc0 msgr2=0x7f640c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:16.098 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.079+0000 7f64108c7700 1 Processor -- start 2020-01-16T05:44:16.098 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.079+0000 7f64108c7700 1 -- start start 2020-01-16T05:44:16.098 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f64108c7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f640c08fb90 0x7f640c090250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:16.098 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f64108c7700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f640c0a8240 0x7f640c0a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:16.098 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f64108c7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c0a2f20 con 0x7f640c09ec00 2020-01-16T05:44:16.098 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f64108c7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640c08f4c0 con 0x7f640c08fb90 2020-01-16T05:44:16.099 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f64108c7700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640c0a20b0 con 0x7f640c0a8240 2020-01-16T05:44:16.099 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f64110c8700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f640c09ec00 0x7f640c09f030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51782/0 (socket says 172.21.15.84:51782) 2020-01-16T05:44:16.099 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f640b59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f640c08fb90 0x7f640c090250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.099 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f64110c8700 1 -- 172.21.15.84:0/1948857242 learned_addr learned my addr 172.21.15.84:0/1948857242 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:16.099 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f640ad9d700 1 --2- 172.21.15.84:0/1948857242 >> v2:172.21.15.142:3300/0 conn(0x7f640c0a8240 0x7f640c0a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.099 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f6403fff700 1 -- 172.21.15.84:0/1948857242 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53360383 0 0) 0x7f640c0a2f20 con 0x7f640c09ec00 2020-01-16T05:44:16.099 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f6403fff700 1 -- 172.21.15.84:0/1948857242 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63f0003230 con 0x7f640c09ec00 2020-01-16T05:44:16.100 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f640b59e700 1 -- 172.21.15.84:0/1948857242 >> v2:172.21.15.142:3300/0 conn(0x7f640c0a8240 msgr2=0x7f640c0a29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.100 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f640b59e700 1 --2- 172.21.15.84:0/1948857242 >> v2:172.21.15.142:3300/0 conn(0x7f640c0a8240 0x7f640c0a29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.100 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f640b59e700 1 -- 172.21.15.84:0/1948857242 >> v1:172.21.15.84:6789/0 conn(0x7f640c09ec00 legacy=0x7f640c09f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.100 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f640b59e700 1 -- 172.21.15.84:0/1948857242 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c0a8670 con 0x7f640c08fb90 2020-01-16T05:44:16.100 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f640b59e700 1 --2- 172.21.15.84:0/1948857242 >> v2:172.21.15.84:3300/0 conn(0x7f640c08fb90 0x7f640c090250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f640c0a8b70 tx=0x7f63fc00c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.100 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f640b59e700 1 --2- 172.21.15.84:0/1948857242 >> v2:172.21.15.84:3300/0 conn(0x7f640c08fb90 0x7f640c090250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f640c0a8b70 tx=0x7f63fc00c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.100 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f640b59e700 1 --2- 172.21.15.84:0/1948857242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f640c08fb90 0x7f640c090250 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f640c0a8b70 tx=0x7f63fc00c820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:16.101 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f640b59e700 1 --2- 172.21.15.84:0/1948857242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f640c08fb90 0x7f640c090250 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f640c0a8b70 tx=0x7f63fc00c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.101 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f6403fff700 1 -- 172.21.15.84:0/1948857242 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63fc0101c0 con 0x7f640c08fb90 2020-01-16T05:44:16.101 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f640b59e700 1 --2- 172.21.15.84:0/1948857242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f640c08fb90 0x7f640c090250 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f640c0a8b70 tx=0x7f63fc00c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.101 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f640b59e700 1 --2- 172.21.15.84:0/1948857242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f640c08fb90 0x7f640c090250 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f640c0a8b70 tx=0x7f63fc00c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.101 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f6403fff700 1 -- 172.21.15.84:0/1948857242 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63fc00cba0 con 0x7f640c08fb90 2020-01-16T05:44:16.101 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f64108c7700 1 -- 172.21.15.84:0/1948857242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640c09f830 con 0x7f640c08fb90 2020-01-16T05:44:16.101 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f6403fff700 1 -- 172.21.15.84:0/1948857242 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63fc012420 con 0x7f640c08fb90 2020-01-16T05:44:16.101 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f64108c7700 1 -- 172.21.15.84:0/1948857242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640c0a3db0 con 0x7f640c08fb90 2020-01-16T05:44:16.102 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.083+0000 7f640b59e700 1 --2- 172.21.15.84:0/1948857242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f640c08fb90 0x7f640c090250 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f640c0a8b70 tx=0x7f63fc00c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.102 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.087+0000 7f64108c7700 1 -- 172.21.15.84:0/1948857242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640c05e1c0 con 0x7f640c08fb90 2020-01-16T05:44:16.102 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.087+0000 7f6403fff700 1 -- 172.21.15.84:0/1948857242 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f63fc006860 con 0x7f640c08fb90 2020-01-16T05:44:16.102 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.087+0000 7f640b59e700 1 --2- 172.21.15.84:0/1948857242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f640c08fb90 0x7f640c090250 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f640c0a8b70 tx=0x7f63fc00c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.102 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.087+0000 7f6403fff700 1 --2- 172.21.15.84:0/1948857242 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f63f003c820 0x7f63f003ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:16.102 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.087+0000 7f6403fff700 1 -- 172.21.15.84:0/1948857242 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f63fc04ca70 con 0x7f640c08fb90 2020-01-16T05:44:16.102 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.087+0000 7f640ad9d700 1 --2- 172.21.15.84:0/1948857242 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f63f003c820 0x7f63f003ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.103 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.087+0000 7f640ad9d700 1 --2- 172.21.15.84:0/1948857242 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f63f003c820 0x7f63f003ed30 crc :-1 s=READY pgs=82 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:16.103 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.091+0000 7f640b59e700 1 --2- 172.21.15.84:0/1948857242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f640c08fb90 0x7f640c090250 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f640c0a8b70 tx=0x7f63fc00c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.103 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.091+0000 7f6403fff700 1 -- 172.21.15.84:0/1948857242 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f63fc033090 con 0x7f640c08fb90 2020-01-16T05:44:16.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.211+0000 7f64108c7700 1 -- 172.21.15.84:0/1948857242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f640c0a4420 con 0x7f640c08fb90 2020-01-16T05:44:16.215 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.215+0000 7f640b59e700 1 --2- 172.21.15.84:0/1948857242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f640c08fb90 0x7f640c090250 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f640c0a8b70 tx=0x7f63fc00c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.215 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.215+0000 7f6403fff700 1 -- 172.21.15.84:0/1948857242 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f63fc0332f0 con 0x7f640c08fb90 2020-01-16T05:44:16.215 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:16.217 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.215+0000 7f64108c7700 1 -- 172.21.15.84:0/1948857242 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f63f003c820 msgr2=0x7f63f003ed30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.217 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.215+0000 7f64108c7700 1 --2- 172.21.15.84:0/1948857242 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f63f003c820 0x7f63f003ed30 crc :-1 s=READY pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.217 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.215+0000 7f64108c7700 1 -- 172.21.15.84:0/1948857242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f640c08fb90 msgr2=0x7f640c090250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.217 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.215+0000 7f64108c7700 1 --2- 172.21.15.84:0/1948857242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f640c08fb90 0x7f640c090250 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f640c0a8b70 tx=0x7f63fc00c820).stop 2020-01-16T05:44:16.217 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.215+0000 7f64108c7700 1 -- 172.21.15.84:0/1948857242 shutdown_connections 2020-01-16T05:44:16.218 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.215+0000 7f64108c7700 1 --2- 172.21.15.84:0/1948857242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f640c08fb90 0x7f640c090250 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.218 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.215+0000 7f64108c7700 1 --2- 172.21.15.84:0/1948857242 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f63f003c820 0x7f63f003ed30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.218 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.215+0000 7f64108c7700 1 --2- 172.21.15.84:0/1948857242 >> v2:172.21.15.142:3300/0 conn(0x7f640c0a8240 0x7f640c0a29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.218 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.215+0000 7f64108c7700 1 -- 172.21.15.84:0/1948857242 shutdown_connections 2020-01-16T05:44:16.218 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.215+0000 7f64108c7700 1 -- 172.21.15.84:0/1948857242 wait complete. 2020-01-16T05:44:16.218 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.215+0000 7f64108c7700 1 -- 172.21.15.84:0/1948857242 >> 172.21.15.84:0/1948857242 conn(0x7f640c0ab760 msgr2=0x7f640c07ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:16.228 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-01-16T05:44:16.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a7563700 1 Processor -- start 2020-01-16T05:44:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a7563700 1 -- start start 2020-01-16T05:44:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a7563700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb1a00a9b30 0x7fb1a00abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a7563700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1a007ff10 0x7fb1a0066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a7563700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a0066dd0 con 0x7fb1a00a4250 2020-01-16T05:44:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a7563700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a00a4830 con 0x7fb1a00a9b30 2020-01-16T05:44:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a7563700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a007f9d0 con 0x7fb1a007ff10 2020-01-16T05:44:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a87c5700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb1a00a4250 0x7fb1a00a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51790/0 (socket says 172.21.15.84:51790) 2020-01-16T05:44:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a87c5700 1 -- 172.21.15.84:0/949331720 learned_addr learned my addr 172.21.15.84:0/949331720 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a6561700 1 --2- 172.21.15.84:0/949331720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1a007ff10 0x7fb1a0066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/949331720 >> v2:172.21.15.142:3300/0 conn(0x7fb1a00a9b30 0x7fb1a00abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a5d60700 1 -- 172.21.15.84:0/949331720 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616896670 0 0) 0x7fb1a0066dd0 con 0x7fb1a00a4250 2020-01-16T05:44:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a5d60700 1 -- 172.21.15.84:0/949331720 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb18c003230 con 0x7fb1a00a4250 2020-01-16T05:44:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a6d62700 1 -- 172.21.15.84:0/949331720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1a007ff10 msgr2=0x7fb1a0066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/949331720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1a007ff10 0x7fb1a0066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a6d62700 1 -- 172.21.15.84:0/949331720 >> v1:172.21.15.84:6789/0 conn(0x7fb1a00a4250 legacy=0x7fb1a00a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a6d62700 1 -- 172.21.15.84:0/949331720 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a0150ce0 con 0x7fb1a00a9b30 2020-01-16T05:44:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/949331720 >> v2:172.21.15.142:3300/0 conn(0x7fb1a00a9b30 0x7fb1a00abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb19c008910 tx=0x7fb19c00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/949331720 >> v2:172.21.15.142:3300/0 conn(0x7fb1a00a9b30 0x7fb1a00abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb19c008910 tx=0x7fb19c00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.347+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/949331720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1a00a9b30 0x7fb1a00abdd0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fb19c008910 tx=0x7fb19c00fdf0).ready entity=mon.1 client_cookie=b8c983fe88ce2dcd server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:16.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.351+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/949331720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1a00a9b30 0x7fb1a00abdd0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fb19c008910 tx=0x7fb19c00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.351+0000 7fb1a5d60700 1 -- 172.21.15.84:0/949331720 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb19c011660 con 0x7fb1a00a9b30 2020-01-16T05:44:16.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.351+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/949331720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1a00a9b30 0x7fb1a00abdd0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fb19c008910 tx=0x7fb19c00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.351+0000 7fb1a5d60700 1 -- 172.21.15.84:0/949331720 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c008c50 con 0x7fb1a00a9b30 2020-01-16T05:44:16.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.351+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/949331720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1a00a9b30 0x7fb1a00abdd0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fb19c008910 tx=0x7fb19c00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.351+0000 7fb1a5d60700 1 -- 172.21.15.84:0/949331720 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb19c011c40 con 0x7fb1a00a9b30 2020-01-16T05:44:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.351+0000 7fb1a7563700 1 -- 172.21.15.84:0/949331720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1a00a9b30 msgr2=0x7fb1a00abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.351+0000 7fb1a7563700 1 --2- 172.21.15.84:0/949331720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1a00a9b30 0x7fb1a00abdd0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fb19c008910 tx=0x7fb19c00fdf0).stop 2020-01-16T05:44:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.351+0000 7fb1a7563700 1 -- 172.21.15.84:0/949331720 shutdown_connections 2020-01-16T05:44:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.351+0000 7fb1a7563700 1 --2- 172.21.15.84:0/949331720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1a00a9b30 0x7fb1a00abdd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.351+0000 7fb1a7563700 1 --2- 172.21.15.84:0/949331720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1a007ff10 0x7fb1a0066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.351+0000 7fb1a7563700 1 -- 172.21.15.84:0/949331720 shutdown_connections 2020-01-16T05:44:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.351+0000 7fb1a7563700 1 -- 172.21.15.84:0/949331720 wait complete. 2020-01-16T05:44:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.351+0000 7fb1a7563700 1 -- 172.21.15.84:0/949331720 >> 172.21.15.84:0/949331720 conn(0x7fb1a00acfc0 msgr2=0x7fb1a00a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:16.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.351+0000 7fb1a7563700 1 Processor -- start 2020-01-16T05:44:16.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.351+0000 7fb1a7563700 1 -- start start 2020-01-16T05:44:16.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a7563700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb1a00a73d0 0x7fb1a008f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:16.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a7563700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a0024e50 con 0x7fb1a007bd10 2020-01-16T05:44:16.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a7563700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a007c140 con 0x7fb1a0024a20 2020-01-16T05:44:16.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a7563700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a00a6e90 con 0x7fb1a00a73d0 2020-01-16T05:44:16.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a87c5700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb1a007bd10 0x7fb1a013c030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51794/0 (socket says 172.21.15.84:51794) 2020-01-16T05:44:16.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a87c5700 1 -- 172.21.15.84:0/3541961670 learned_addr learned my addr 172.21.15.84:0/3541961670 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:16.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/3541961670 >> v2:172.21.15.84:3300/0 conn(0x7fb1a00a73d0 0x7fb1a008f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1977fe700 1 -- 172.21.15.84:0/3541961670 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682006564 0 0) 0x7fb1a0024e50 con 0x7fb1a007bd10 2020-01-16T05:44:16.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1977fe700 1 -- 172.21.15.84:0/3541961670 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb188003230 con 0x7fb1a007bd10 2020-01-16T05:44:16.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1977fe700 1 -- 172.21.15.84:0/3541961670 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423948189 0 0) 0x7fb1a007c140 con 0x7fb1a0024a20 2020-01-16T05:44:16.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1977fe700 1 -- 172.21.15.84:0/3541961670 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a0024e50 con 0x7fb1a0024a20 2020-01-16T05:44:16.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1977fe700 1 -- 172.21.15.84:0/3541961670 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4207697384 0 0) 0x7fb188003230 con 0x7fb1a007bd10 2020-01-16T05:44:16.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a6d62700 1 -- 172.21.15.84:0/3541961670 >> v1:172.21.15.142:6789/0 conn(0x7fb1a0024a20 legacy=0x7fb1a00a7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a6d62700 1 -- 172.21.15.84:0/3541961670 >> v1:172.21.15.84:6789/0 conn(0x7fb1a007bd10 legacy=0x7fb1a013c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a6d62700 1 -- 172.21.15.84:0/3541961670 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a0025310 con 0x7fb1a00a73d0 2020-01-16T05:44:16.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/3541961670 >> v2:172.21.15.84:3300/0 conn(0x7fb1a00a73d0 0x7fb1a008f5a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb198001970 tx=0x7fb198001da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/3541961670 >> v2:172.21.15.84:3300/0 conn(0x7fb1a00a73d0 0x7fb1a008f5a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb198001970 tx=0x7fb198001da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/3541961670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a00a73d0 0x7fb1a008f5a0 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7fb198001970 tx=0x7fb198001da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:16.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/3541961670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a00a73d0 0x7fb1a008f5a0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fb198001970 tx=0x7fb198001da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1977fe700 1 -- 172.21.15.84:0/3541961670 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb198001ba0 con 0x7fb1a00a73d0 2020-01-16T05:44:16.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/3541961670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a00a73d0 0x7fb1a008f5a0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fb198001970 tx=0x7fb198001da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/3541961670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a00a73d0 0x7fb1a008f5a0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fb198001970 tx=0x7fb198001da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1977fe700 1 -- 172.21.15.84:0/3541961670 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1980019b0 con 0x7fb1a00a73d0 2020-01-16T05:44:16.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a7563700 1 -- 172.21.15.84:0/3541961670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a007c370 con 0x7fb1a00a73d0 2020-01-16T05:44:16.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1977fe700 1 -- 172.21.15.84:0/3541961670 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb19c00f740 con 0x7fb1a00a73d0 2020-01-16T05:44:16.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a7563700 1 -- 172.21.15.84:0/3541961670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a00a52f0 con 0x7fb1a00a73d0 2020-01-16T05:44:16.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/3541961670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a00a73d0 0x7fb1a008f5a0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fb198001970 tx=0x7fb198001da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1977fe700 1 -- 172.21.15.84:0/3541961670 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fb19c007170 con 0x7fb1a00a73d0 2020-01-16T05:44:16.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/3541961670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a00a73d0 0x7fb1a008f5a0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fb198001970 tx=0x7fb198001da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1977fe700 1 --2- 172.21.15.84:0/3541961670 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb18803c9e0 0x7fb18803eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:16.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1977fe700 1 -- 172.21.15.84:0/3541961670 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7fb19c0928a0 con 0x7fb1a00a73d0 2020-01-16T05:44:16.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a6561700 1 --2- 172.21.15.84:0/3541961670 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb18803c9e0 0x7fb18803eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a6561700 1 --2- 172.21.15.84:0/3541961670 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb18803c9e0 0x7fb18803eef0 crc :-1 s=READY pgs=83 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:16.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.355+0000 7fb1a7563700 1 -- 172.21.15.84:0/3541961670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a005e1c0 con 0x7fb1a00a73d0 2020-01-16T05:44:16.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.359+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/3541961670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a00a73d0 0x7fb1a008f5a0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fb198001970 tx=0x7fb198001da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.359+0000 7fb1977fe700 1 -- 172.21.15.84:0/3541961670 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fb19c007480 con 0x7fb1a00a73d0 2020-01-16T05:44:16.478 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.475+0000 7fb1a7563700 1 -- 172.21.15.84:0/3541961670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb1a005f1e0 con 0x7fb1a00a73d0 2020-01-16T05:44:16.478 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.479+0000 7fb1a6d62700 1 --2- 172.21.15.84:0/3541961670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a00a73d0 0x7fb1a008f5a0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fb198001970 tx=0x7fb198001da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.478 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.479+0000 7fb1977fe700 1 -- 172.21.15.84:0/3541961670 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb19c007af0 con 0x7fb1a00a73d0 2020-01-16T05:44:16.479 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:16.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.479+0000 7fb1a7563700 1 -- 172.21.15.84:0/3541961670 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb18803c9e0 msgr2=0x7fb18803eef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.479+0000 7fb1a7563700 1 --2- 172.21.15.84:0/3541961670 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb18803c9e0 0x7fb18803eef0 crc :-1 s=READY pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.479+0000 7fb1a7563700 1 -- 172.21.15.84:0/3541961670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a00a73d0 msgr2=0x7fb1a008f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.479+0000 7fb1a7563700 1 --2- 172.21.15.84:0/3541961670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a00a73d0 0x7fb1a008f5a0 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7fb198001970 tx=0x7fb198001da0).stop 2020-01-16T05:44:16.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.479+0000 7fb1a7563700 1 -- 172.21.15.84:0/3541961670 shutdown_connections 2020-01-16T05:44:16.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.479+0000 7fb1a7563700 1 --2- 172.21.15.84:0/3541961670 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb18803c9e0 0x7fb18803eef0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.479+0000 7fb1a7563700 1 --2- 172.21.15.84:0/3541961670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a00a73d0 0x7fb1a008f5a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.479+0000 7fb1a7563700 1 -- 172.21.15.84:0/3541961670 shutdown_connections 2020-01-16T05:44:16.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.479+0000 7fb1a7563700 1 -- 172.21.15.84:0/3541961670 wait complete. 2020-01-16T05:44:16.482 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.479+0000 7fb1a7563700 1 -- 172.21.15.84:0/3541961670 >> 172.21.15.84:0/3541961670 conn(0x7fb1a00a6400 msgr2=0x7fb1a01270a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:16.492 INFO:tasks.mds_thrash:mds thrasher using random seed: 1579153456 2020-01-16T05:44:16.492 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-16T05:44:16.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.603+0000 7f026eb27700 1 Processor -- start 2020-01-16T05:44:16.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.603+0000 7f026eb27700 1 -- start start 2020-01-16T05:44:16.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.603+0000 7f026eb27700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f02680a9b30 0x7f02680abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:16.609 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.603+0000 7f026eb27700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f026807ff10 0x7f0268066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:16.609 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.603+0000 7f026eb27700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0268066dd0 con 0x7f02680a4250 2020-01-16T05:44:16.609 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.603+0000 7f026eb27700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02680a4830 con 0x7f02680a9b30 2020-01-16T05:44:16.609 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.603+0000 7f026eb27700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026807f9d0 con 0x7f026807ff10 2020-01-16T05:44:16.609 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.603+0000 7f026e326700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f02680a9b30 0x7f02680abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.609 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.603+0000 7f026e326700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f02680a9b30 0x7f02680abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34600/0 (socket says 172.21.15.84:34600) 2020-01-16T05:44:16.609 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.603+0000 7f026e326700 1 -- 172.21.15.84:0/44416662 learned_addr learned my addr 172.21.15.84:0/44416662 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:16.610 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.603+0000 7f026fd89700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f02680a4250 0x7f02680a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51804/0 (socket says 172.21.15.84:51804) 2020-01-16T05:44:16.610 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.603+0000 7f026db25700 1 --2- 172.21.15.84:0/44416662 >> v2:172.21.15.142:3300/0 conn(0x7f026807ff10 0x7f0268066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.610 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026e326700 1 -- 172.21.15.84:0/44416662 >> v2:172.21.15.142:3300/0 conn(0x7f026807ff10 msgr2=0x7f0268066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:16.610 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026e326700 1 --2- 172.21.15.84:0/44416662 >> v2:172.21.15.142:3300/0 conn(0x7f026807ff10 0x7f0268066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:16.610 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026d324700 1 -- 172.21.15.84:0/44416662 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511222278 0 0) 0x7f0268066dd0 con 0x7f02680a4250 2020-01-16T05:44:16.610 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026e326700 1 -- 172.21.15.84:0/44416662 >> v1:172.21.15.84:6789/0 conn(0x7f02680a4250 legacy=0x7f02680a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.610 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026e326700 1 -- 172.21.15.84:0/44416662 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0268150ce0 con 0x7f02680a9b30 2020-01-16T05:44:16.611 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026db25700 1 --2- 172.21.15.84:0/44416662 >> v2:172.21.15.142:3300/0 conn(0x7f026807ff10 0x7f0268066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:44:16.611 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026e326700 1 --2- 172.21.15.84:0/44416662 >> v2:172.21.15.84:3300/0 conn(0x7f02680a9b30 0x7f02680abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f02680a49f0 tx=0x7f0258010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.611 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026e326700 1 --2- 172.21.15.84:0/44416662 >> v2:172.21.15.84:3300/0 conn(0x7f02680a9b30 0x7f02680abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f02680a49f0 tx=0x7f0258010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.611 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026e326700 1 --2- 172.21.15.84:0/44416662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02680a9b30 0x7f02680abdd0 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f02680a49f0 tx=0x7f0258010230).ready entity=mon.0 client_cookie=f171bb047d972699 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:16.611 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026e326700 1 --2- 172.21.15.84:0/44416662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02680a9b30 0x7f02680abdd0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f02680a49f0 tx=0x7f0258010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.611 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026d324700 1 -- 172.21.15.84:0/44416662 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f025800a160 con 0x7f02680a9b30 2020-01-16T05:44:16.611 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026e326700 1 --2- 172.21.15.84:0/44416662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02680a9b30 0x7f02680abdd0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f02680a49f0 tx=0x7f0258010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.611 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026e326700 1 --2- 172.21.15.84:0/44416662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02680a9b30 0x7f02680abdd0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f02680a49f0 tx=0x7f0258010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.612 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026d324700 1 -- 172.21.15.84:0/44416662 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0258011b70 con 0x7f02680a9b30 2020-01-16T05:44:16.612 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026d324700 1 -- 172.21.15.84:0/44416662 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f025800a740 con 0x7f02680a9b30 2020-01-16T05:44:16.612 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026eb27700 1 -- 172.21.15.84:0/44416662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02680a9b30 msgr2=0x7f02680abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.612 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026eb27700 1 --2- 172.21.15.84:0/44416662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02680a9b30 0x7f02680abdd0 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f02680a49f0 tx=0x7f0258010230).stop 2020-01-16T05:44:16.612 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026eb27700 1 -- 172.21.15.84:0/44416662 shutdown_connections 2020-01-16T05:44:16.612 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026eb27700 1 --2- 172.21.15.84:0/44416662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02680a9b30 0x7f02680abdd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.612 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026eb27700 1 --2- 172.21.15.84:0/44416662 >> v2:172.21.15.142:3300/0 conn(0x7f026807ff10 0x7f0268066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:16.613 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026eb27700 1 -- 172.21.15.84:0/44416662 shutdown_connections 2020-01-16T05:44:16.613 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026eb27700 1 -- 172.21.15.84:0/44416662 wait complete. 2020-01-16T05:44:16.613 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026eb27700 1 -- 172.21.15.84:0/44416662 >> 172.21.15.84:0/44416662 conn(0x7f02680acfc0 msgr2=0x7f02680a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:16.616 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026eb27700 1 Processor -- start 2020-01-16T05:44:16.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026eb27700 1 -- start start 2020-01-16T05:44:16.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026eb27700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f02680a6da0 0x7f0268140050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:16.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026eb27700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02680a71d0 con 0x7f0268065920 2020-01-16T05:44:16.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026eb27700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02681415b0 con 0x7f026808f5d0 2020-01-16T05:44:16.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026eb27700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026807d3a0 con 0x7f02680a6da0 2020-01-16T05:44:16.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026db25700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0268065920 0x7f026807cba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51808/0 (socket says 172.21.15.84:51808) 2020-01-16T05:44:16.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026db25700 1 -- 172.21.15.84:0/1433887632 learned_addr learned my addr 172.21.15.84:0/1433887632 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:16.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f026fd89700 1 --2- 172.21.15.84:0/1433887632 >> v2:172.21.15.142:3300/0 conn(0x7f02680a6da0 0x7f0268140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912252875 0 0) 0x7f025c001ec0 con 0x7f0268065920 2020-01-16T05:44:16.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.607+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0248003230 con 0x7f0268065920 2020-01-16T05:44:16.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001849181 0 0) 0x7f02681415b0 con 0x7f026808f5d0 2020-01-16T05:44:16.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f025c001ec0 con 0x7f026808f5d0 2020-01-16T05:44:16.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 491865826 0 0) 0x7f0248003230 con 0x7f0268065920 2020-01-16T05:44:16.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f02681415b0 con 0x7f0268065920 2020-01-16T05:44:16.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f025c0027f0 con 0x7f0268065920 2020-01-16T05:44:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 >> v2:172.21.15.142:3300/0 conn(0x7f02680a6da0 msgr2=0x7f0268140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f0266ffd700 1 --2- 172.21.15.84:0/1433887632 >> v2:172.21.15.142:3300/0 conn(0x7f02680a6da0 0x7f0268140050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 >> v1:172.21.15.142:6789/0 conn(0x7f026808f5d0 legacy=0x7f0268126410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 >> v1:172.21.15.84:6789/0 conn(0x7f0268065920 legacy=0x7f026807cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f0266ffd700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0248003c30 0x7f02480045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f0266ffd700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0248004af0 0x7f0248004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f0266ffd700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02480097e0 0x7f024800bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024800c170 con 0x7f0248004af0 2020-01-16T05:44:16.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024800c330 con 0x7f0248003c30 2020-01-16T05:44:16.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024800c4f0 con 0x7f02480097e0 2020-01-16T05:44:16.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026db25700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0248004af0 0x7f0248004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026fd89700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02480097e0 0x7f024800bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026e326700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0248003c30 0x7f02480045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026db25700 1 -- 172.21.15.84:0/1433887632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02480097e0 msgr2=0x7f024800bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026db25700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02480097e0 0x7f024800bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026db25700 1 -- 172.21.15.84:0/1433887632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0248003c30 msgr2=0x7f02480045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026db25700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0248003c30 0x7f02480045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026db25700 1 -- 172.21.15.84:0/1433887632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02680ab090 con 0x7f0248004af0 2020-01-16T05:44:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026eb27700 1 -- 172.21.15.84:0/1433887632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02681405a0 con 0x7f0248004af0 2020-01-16T05:44:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026fd89700 1 -- 172.21.15.84:0/1433887632 reap_dead start 2020-01-16T05:44:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026db25700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0248004af0 0x7f0248004f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f025c007ad0 tx=0x7f025c011a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026eb27700 1 -- 172.21.15.84:0/1433887632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02680a6da0 con 0x7f0248004af0 2020-01-16T05:44:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026db25700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0248004af0 0x7f0248004f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f025c007ad0 tx=0x7f025c011a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026db25700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0248004af0 0x7f0248004f20 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7f025c007ad0 tx=0x7f025c011a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:16.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026db25700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0248004af0 0x7f0248004f20 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f025c007ad0 tx=0x7f025c011a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f025c001660 con 0x7f0248004af0 2020-01-16T05:44:16.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026db25700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0248004af0 0x7f0248004f20 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f025c007ad0 tx=0x7f025c011a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c001280 con 0x7f0248004af0 2020-01-16T05:44:16.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026db25700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0248004af0 0x7f0248004f20 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f025c007ad0 tx=0x7f025c011a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f025c001c40 con 0x7f0248004af0 2020-01-16T05:44:16.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026eb27700 1 -- 172.21.15.84:0/1433887632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0244003360 con 0x7f0248004af0 2020-01-16T05:44:16.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.611+0000 7f026db25700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0248004af0 0x7f0248004f20 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f025c007ad0 tx=0x7f025c011a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.615+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f025c0056c0 con 0x7f0248004af0 2020-01-16T05:44:16.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.615+0000 7f026db25700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0248004af0 0x7f0248004f20 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f025c007ad0 tx=0x7f025c011a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.615+0000 7f0266ffd700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0248040390 0x7f02480428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:16.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.615+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f02680a71d0 con 0x7f0248004af0 2020-01-16T05:44:16.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.615+0000 7f026e326700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0248040390 0x7f02480428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.615+0000 7f026e326700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0248040390 0x7f02480428a0 crc :-1 s=READY pgs=84 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:16.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.619+0000 7f026db25700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0248004af0 0x7f0248004f20 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f025c007ad0 tx=0x7f025c011a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.619+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f025c033d70 con 0x7f0248004af0 2020-01-16T05:44:16.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.739+0000 7f026eb27700 1 -- 172.21.15.84:0/1433887632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02440021f0 con 0x7f0248004af0 2020-01-16T05:44:16.742 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.743+0000 7f026db25700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0248004af0 0x7f0248004f20 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f025c007ad0 tx=0x7f025c011a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.743 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.743+0000 7f0266ffd700 1 -- 172.21.15.84:0/1433887632 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14672 (secure 0 0 0) 0x7f025c033fd0 con 0x7f0248004af0 2020-01-16T05:44:16.743 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:16.743 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"cbc67508-4d2a-4483-a1fc-95d371063ac4","created":"2020-01-16T05:43:46.771497+0000","modified":"2020-01-16T05:44:05.941278+0000","last_up_change":"2020-01-16T05:43:55.529492+0000","last_in_change":"2020-01-16T05:43:55.529492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-16T05:43:59.152708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-16T05:44:01.682783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-16T05:44:02.930765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15da60bb-4d16-44cc-80c6-cd2c7fa77364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":12644},{"type":"v1","addr":"172.21.15.84:6812","nonce":12644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":12644},{"type":"v1","addr":"172.21.15.84:6816","nonce":12644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":12644},{"type":"v1","addr":"172.21.15.84:6824","nonce":12644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":12644},{"type":"v1","addr":"172.21.15.84:6820","nonce":12644}]},"public_addr":"172.21.15.84:6812/12644","cluster_addr":"172.21.15.84:6816/12644","heartbeat_back_addr":"172.21.15.84:6824/12644","heartbeat_front_addr":"172.21.15.84:6820/12644","state":["exists","up"]},{"osd":1,"uuid":"0800533c-1d5b-4f9f-99bb-34b8133c8b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":12645},{"type":"v1","addr":"172.21.15.84:6803","nonce":12645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":12645},{"type":"v1","addr":"172.21.15.84:6805","nonce":12645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":12645},{"type":"v1","addr":"172.21.15.84:6809","nonce":12645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":12645},{"type":"v1","addr":"172.21.15.84:6807","nonce":12645}]},"public_addr":"172.21.15.84:6803/12645","cluster_addr":"172.21.15.84:6805/12645","heartbeat_back_addr":"172.21.15.84:6809/12645","heartbeat_front_addr":"172.21.15.84:6807/12645","state":["exists","up"]},{"osd":2,"uuid":"519cc27f-5cf9-4ecf-ad66-f722c37339df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":12646},{"type":"v1","addr":"172.21.15.84:6813","nonce":12646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6815","nonce":12646},{"type":"v1","addr":"172.21.15.84:6817","nonce":12646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":12646},{"type":"v1","addr":"172.21.15.84:6825","nonce":12646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":12646},{"type":"v1","addr":"172.21.15.84:6821","nonce":12646}]},"public_addr":"172.21.15.84:6813/12646","cluster_addr":"172.21.15.84:6817/12646","heartbeat_back_addr":"172.21.15.84:6825/12646","heartbeat_front_addr":"172.21.15.84:6821/12646","state":["exists","up"]},{"osd":3,"uuid":"aec305a6-bbac-4e01-8ea1-6077d49e27e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":12647},{"type":"v1","addr":"172.21.15.84:6827","nonce":12647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":12647},{"type":"v1","addr":"172.21.15.84:6829","nonce":12647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":12647},{"type":"v1","addr":"172.21.15.84:6833","nonce":12647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":12647},{"type":"v1","addr":"172.21.15.84:6831","nonce":12647}]},"public_addr":"172.21.15.84:6827/12647","cluster_addr":"172.21.15.84:6829/12647","heartbeat_back_addr":"172.21.15.84:6833/12647","heartbeat_front_addr":"172.21.15.84:6831/12647","state":["exists","up"]},{"osd":4,"uuid":"aaec7f3e-299a-4546-8406-207bcc4b3afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":12842},{"type":"v1","addr":"172.21.15.142:6801","nonce":12842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12842},{"type":"v1","addr":"172.21.15.142:6803","nonce":12842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12842},{"type":"v1","addr":"172.21.15.142:6807","nonce":12842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12842},{"type":"v1","addr":"172.21.15.142:6805","nonce":12842}]},"public_addr":"172.21.15.142:6801/12842","cluster_addr":"172.21.15.142:6803/12842","heartbeat_back_addr":"172.21.15.142:6807/12842","heartbeat_front_addr":"172.21.15.142:6805/12842","state":["exists","up"]},{"osd":5,"uuid":"5a942a47-7346-46d4-adf8-dad2bdb95aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12843},{"type":"v1","addr":"172.21.15.142:6809","nonce":12843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12843},{"type":"v1","addr":"172.21.15.142:6811","nonce":12843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12843},{"type":"v1","addr":"172.21.15.142:6815","nonce":12843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12843},{"type":"v1","addr":"172.21.15.142:6813","nonce":12843}]},"public_addr":"172.21.15.142:6809/12843","cluster_addr":"172.21.15.142:6811/12843","heartbeat_back_addr":"172.21.15.142:6815/12843","heartbeat_front_addr":"172.21.15.142:6813/12843","state":["exists","up"]},{"osd":6,"uuid":"c69fca67-66e4-4c31-ab03-1419e2a83e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12844},{"type":"v1","addr":"172.21.15.142:6818","nonce":12844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":12844},{"type":"v1","addr":"172.21.15.142:6823","nonce":12844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":12844},{"type":"v1","addr":"172.21.15.142:6831","nonce":12844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":12844},{"type":"v1","addr":"172.21.15.142:6827","nonce":12844}]},"public_addr":"172.21.15.142:6818/12844","cluster_addr":"172.21.15.142:6823/12844","heartbeat_back_addr":"172.21.15.142:6831/12844","heartbeat_front_addr":"172.21.15.142:6827/12844","state":["exists","up"]},{"osd":7,"uuid":"c436f64e-aa1f-435b-ac7b-85633e297591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":12845},{"type":"v1","addr":"172.21.15.142:6819","nonce":12845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12845},{"type":"v1","addr":"172.21.15.142:6822","nonce":12845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12845},{"type":"v1","addr":"172.21.15.142:6830","nonce":12845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12845},{"type":"v1","addr":"172.21.15.142:6826","nonce":12845}]},"public_addr":"172.21.15.142:6819/12845","cluster_addr":"172.21.15.142:6822/12845","heartbeat_back_addr":"172.21.15.142:6830/12845","heartbeat_front_addr":"172.21.15.142:6826/12845","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.534744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.505453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.485516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.333028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.483323+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.567824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.273268+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.559741+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-16T05:44:16.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.743+0000 7f026eb27700 1 -- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0248040390 msgr2=0x7f02480428a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.743+0000 7f026eb27700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0248040390 0x7f02480428a0 crc :-1 s=READY pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.743+0000 7f026eb27700 1 -- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0248004af0 msgr2=0x7f0248004f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.743+0000 7f026eb27700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0248004af0 0x7f0248004f20 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7f025c007ad0 tx=0x7f025c011a70).stop 2020-01-16T05:44:16.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.743+0000 7f026eb27700 1 -- 172.21.15.84:0/1433887632 shutdown_connections 2020-01-16T05:44:16.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.743+0000 7f026eb27700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0248040390 0x7f02480428a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.743+0000 7f026eb27700 1 --2- 172.21.15.84:0/1433887632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0248004af0 0x7f0248004f20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.743+0000 7f026eb27700 1 -- 172.21.15.84:0/1433887632 shutdown_connections 2020-01-16T05:44:16.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.743+0000 7f026eb27700 1 -- 172.21.15.84:0/1433887632 wait complete. 2020-01-16T05:44:16.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.743+0000 7f026eb27700 1 -- 172.21.15.84:0/1433887632 >> 172.21.15.84:0/1433887632 conn(0x7f026805ee80 msgr2=0x7f02681279e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:16.760 INFO:tasks.mds_thrash.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:43:59.152708+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:44:01.682783+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:44:02.930765+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-16T05:44:16.760 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-16T05:44:16.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.871+0000 7f9bbffff700 1 Processor -- start 2020-01-16T05:44:16.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.871+0000 7f9bbffff700 1 -- start start 2020-01-16T05:44:16.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.871+0000 7f9bbffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc00a9b30 0x7f9bc00abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:16.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.871+0000 7f9bbffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc0066880 con 0x7f9bc007ff10 2020-01-16T05:44:16.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.871+0000 7f9bbffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc0066ab0 con 0x7f9bc00a4250 2020-01-16T05:44:16.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.871+0000 7f9bbffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc00a4830 con 0x7f9bc00a9b30 2020-01-16T05:44:16.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.871+0000 7f9bbeffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9bc007ff10 0x7f9bc00a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51824/0 (socket says 172.21.15.84:51824) 2020-01-16T05:44:16.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.871+0000 7f9bbeffd700 1 -- 172.21.15.84:0/3386090665 learned_addr learned my addr 172.21.15.84:0/3386090665 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:16.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.871+0000 7f9bbf7fe700 1 --2- 172.21.15.84:0/3386090665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc00a9b30 0x7f9bc00abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbe7fc700 1 -- 172.21.15.84:0/3386090665 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734355091 0 0) 0x7f9bc0066880 con 0x7f9bc007ff10 2020-01-16T05:44:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbe7fc700 1 -- 172.21.15.84:0/3386090665 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ba0003230 con 0x7f9bc007ff10 2020-01-16T05:44:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbf7fe700 1 -- 172.21.15.84:0/3386090665 >> v1:172.21.15.142:6789/0 conn(0x7f9bc00a4250 legacy=0x7f9bc014fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbe7fc700 1 -- 172.21.15.84:0/3386090665 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470851471 0 0) 0x7f9bc0066ab0 con 0x7f9bc00a4250 2020-01-16T05:44:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbf7fe700 1 -- 172.21.15.84:0/3386090665 >> v1:172.21.15.84:6789/0 conn(0x7f9bc007ff10 legacy=0x7f9bc00a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbf7fe700 1 -- 172.21.15.84:0/3386090665 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc0066ce0 con 0x7f9bc00a9b30 2020-01-16T05:44:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbf7fe700 1 --2- 172.21.15.84:0/3386090665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc00a9b30 0x7f9bc00abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9ba8001990 tx=0x7f9ba80014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbf7fe700 1 --2- 172.21.15.84:0/3386090665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc00a9b30 0x7f9bc00abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9ba8001990 tx=0x7f9ba80014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbf7fe700 1 --2- 172.21.15.84:0/3386090665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc00a9b30 0x7f9bc00abdd0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f9ba8001990 tx=0x7f9ba80014a0).ready entity=mon.2 client_cookie=c25af8653b6ad40b server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:16.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbf7fe700 1 --2- 172.21.15.84:0/3386090665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc00a9b30 0x7f9bc00abdd0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f9ba8001990 tx=0x7f9ba80014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbe7fc700 1 -- 172.21.15.84:0/3386090665 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ba8001750 con 0x7f9bc00a9b30 2020-01-16T05:44:16.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbf7fe700 1 --2- 172.21.15.84:0/3386090665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc00a9b30 0x7f9bc00abdd0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f9ba8001990 tx=0x7f9ba80014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbe7fc700 1 -- 172.21.15.84:0/3386090665 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba8001560 con 0x7f9bc00a9b30 2020-01-16T05:44:16.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbf7fe700 1 --2- 172.21.15.84:0/3386090665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc00a9b30 0x7f9bc00abdd0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f9ba8001990 tx=0x7f9ba80014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbe7fc700 1 -- 172.21.15.84:0/3386090665 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bb80114e0 con 0x7f9bc00a9b30 2020-01-16T05:44:16.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbffff700 1 -- 172.21.15.84:0/3386090665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc00a9b30 msgr2=0x7f9bc00abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbffff700 1 --2- 172.21.15.84:0/3386090665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc00a9b30 0x7f9bc00abdd0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f9ba8001990 tx=0x7f9ba80014a0).stop 2020-01-16T05:44:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbffff700 1 -- 172.21.15.84:0/3386090665 shutdown_connections 2020-01-16T05:44:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbffff700 1 --2- 172.21.15.84:0/3386090665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc00a9b30 0x7f9bc00abdd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbffff700 1 -- 172.21.15.84:0/3386090665 shutdown_connections 2020-01-16T05:44:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbffff700 1 -- 172.21.15.84:0/3386090665 wait complete. 2020-01-16T05:44:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.875+0000 7f9bbffff700 1 -- 172.21.15.84:0/3386090665 >> 172.21.15.84:0/3386090665 conn(0x7f9bc00acfc0 msgr2=0x7f9bc00a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:16.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.879+0000 7f9bbffff700 1 Processor -- start 2020-01-16T05:44:16.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.879+0000 7f9bbffff700 1 -- start start 2020-01-16T05:44:16.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.879+0000 7f9bbffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9bc00a2910 0x7f9bc007b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:16.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.879+0000 7f9bbffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc007baa0 0x7f9bc007bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:16.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.879+0000 7f9bbffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc0125bf0 con 0x7f9bc0126940 2020-01-16T05:44:16.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.879+0000 7f9bbffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc0125f30 con 0x7f9bc00a2910 2020-01-16T05:44:16.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.879+0000 7f9bbffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc0126400 con 0x7f9bc007baa0 2020-01-16T05:44:16.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.879+0000 7f9bbf7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9bc0126940 0x7f9bc0123f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51826/0 (socket says 172.21.15.84:51826) 2020-01-16T05:44:16.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.879+0000 7f9bbf7fe700 1 -- 172.21.15.84:0/2905257833 learned_addr learned my addr 172.21.15.84:0/2905257833 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:16.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.879+0000 7f9bc55f7700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc007baa0 0x7f9bc007bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.879+0000 7f9bbeffd700 1 --2- 172.21.15.84:0/2905257833 >> v2:172.21.15.142:3300/0 conn(0x7f9bc00a2910 0x7f9bc007b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.879+0000 7f9bb7fff700 1 -- 172.21.15.84:0/2905257833 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730591507 0 0) 0x7f9bc0125bf0 con 0x7f9bc0126940 2020-01-16T05:44:16.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.879+0000 7f9bb7fff700 1 -- 172.21.15.84:0/2905257833 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b98003230 con 0x7f9bc0126940 2020-01-16T05:44:16.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bb7fff700 1 -- 172.21.15.84:0/2905257833 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3104734582 0 0) 0x7f9b98003230 con 0x7f9bc0126940 2020-01-16T05:44:16.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bb7fff700 1 -- 172.21.15.84:0/2905257833 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9bc0125bf0 con 0x7f9bc0126940 2020-01-16T05:44:16.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bb7fff700 1 -- 172.21.15.84:0/2905257833 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f9bb8007a70 con 0x7f9bc0126940 2020-01-16T05:44:16.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bb7fff700 1 -- 172.21.15.84:0/2905257833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc007baa0 msgr2=0x7f9bc007bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bb7fff700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc007baa0 0x7f9bc007bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bb7fff700 1 -- 172.21.15.84:0/2905257833 >> v2:172.21.15.142:3300/0 conn(0x7f9bc00a2910 msgr2=0x7f9bc007b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bb7fff700 1 --2- 172.21.15.84:0/2905257833 >> v2:172.21.15.142:3300/0 conn(0x7f9bc00a2910 0x7f9bc007b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bb7fff700 1 -- 172.21.15.84:0/2905257833 >> v1:172.21.15.84:6789/0 conn(0x7f9bc0126940 legacy=0x7f9bc0123f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bb7fff700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b98003a20 0x7f9b98003e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:16.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bb7fff700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b980045a0 0x7f9b980049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:16.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bb7fff700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98004f70 0x7f9b9800b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:16.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bb7fff700 1 -- 172.21.15.84:0/2905257833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc0125f30 con 0x7f9b98004f70 2020-01-16T05:44:16.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bb7fff700 1 -- 172.21.15.84:0/2905257833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc0126400 con 0x7f9b98003a20 2020-01-16T05:44:16.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bb7fff700 1 -- 172.21.15.84:0/2905257833 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9800bdf0 con 0x7f9b980045a0 2020-01-16T05:44:16.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bbf7fe700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b98003a20 0x7f9b98003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bc55f7700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98004f70 0x7f9b9800b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bbeffd700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b980045a0 0x7f9b980049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bc55f7700 1 -- 172.21.15.84:0/2905257833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b980045a0 msgr2=0x7f9b980049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bc55f7700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b980045a0 0x7f9b980049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bc55f7700 1 -- 172.21.15.84:0/2905257833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b98003a20 msgr2=0x7f9b98003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:16.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bc55f7700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b98003a20 0x7f9b98003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:16.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bc55f7700 1 -- 172.21.15.84:0/2905257833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc0126fe0 con 0x7f9b98004f70 2020-01-16T05:44:16.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bbffff700 1 -- 172.21.15.84:0/2905257833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc007baa0 con 0x7f9b98004f70 2020-01-16T05:44:16.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bbffff700 1 -- 172.21.15.84:0/2905257833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc007bfa0 con 0x7f9b98004f70 2020-01-16T05:44:16.892 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bc55f7700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98004f70 0x7f9b9800b7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9bb0000f00 tx=0x7f9bb0010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.892 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bc55f7700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98004f70 0x7f9b9800b7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9bb0000f00 tx=0x7f9bb0010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.892 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bc55f7700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98004f70 0x7f9b9800b7f0 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f9bb0000f00 tx=0x7f9bb0010df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:16.892 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bc55f7700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98004f70 0x7f9b9800b7f0 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f9bb0000f00 tx=0x7f9bb0010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.892 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bc55f7700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98004f70 0x7f9b9800b7f0 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f9bb0000f00 tx=0x7f9bb0010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.892 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bb7fff700 1 -- 172.21.15.84:0/2905257833 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bb0006a50 con 0x7f9b98004f70 2020-01-16T05:44:16.892 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bc55f7700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98004f70 0x7f9b9800b7f0 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f9bb0000f00 tx=0x7f9bb0010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.892 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bb7fff700 1 -- 172.21.15.84:0/2905257833 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb000ccb0 con 0x7f9b98004f70 2020-01-16T05:44:16.893 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bb7fff700 1 -- 172.21.15.84:0/2905257833 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bb0012640 con 0x7f9b98004f70 2020-01-16T05:44:16.893 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bc55f7700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98004f70 0x7f9b9800b7f0 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f9bb0000f00 tx=0x7f9bb0010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.893 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bbffff700 1 -- 172.21.15.84:0/2905257833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9c003360 con 0x7f9b98004f70 2020-01-16T05:44:16.893 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bb7fff700 1 -- 172.21.15.84:0/2905257833 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f9bb0012840 con 0x7f9b98004f70 2020-01-16T05:44:16.893 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.883+0000 7f9bc55f7700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98004f70 0x7f9b9800b7f0 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f9bb0000f00 tx=0x7f9bb0010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.893 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.887+0000 7f9bb7fff700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9b98044fc0 0x7f9b980474d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:16.893 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.887+0000 7f9bb7fff700 1 -- 172.21.15.84:0/2905257833 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f9bb004ca10 con 0x7f9b98004f70 2020-01-16T05:44:16.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.887+0000 7f9bbf7fe700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9b98044fc0 0x7f9b980474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:16.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.887+0000 7f9bbf7fe700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9b98044fc0 0x7f9b980474d0 crc :-1 s=READY pgs=85 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:16.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.891+0000 7f9bc55f7700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98004f70 0x7f9b9800b7f0 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f9bb0000f00 tx=0x7f9bb0010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:16.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:16.891+0000 7f9bb7fff700 1 -- 172.21.15.84:0/2905257833 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f9bb0033030 con 0x7f9b98004f70 2020-01-16T05:44:17.012 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.011+0000 7f9bbffff700 1 -- 172.21.15.84:0/2905257833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9b9c002220 con 0x7f9b98004f70 2020-01-16T05:44:17.012 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.011+0000 7f9bc55f7700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98004f70 0x7f9b9800b7f0 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f9bb0000f00 tx=0x7f9bb0010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.012 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.011+0000 7f9bb7fff700 1 -- 172.21.15.84:0/2905257833 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9bb0033290 con 0x7f9b98004f70 2020-01-16T05:44:17.013 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:17.014 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.011+0000 7f9bbffff700 1 -- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9b98044fc0 msgr2=0x7f9b980474d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:17.014 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.011+0000 7f9bbffff700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9b98044fc0 0x7f9b980474d0 crc :-1 s=READY pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:17.015 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.011+0000 7f9bbffff700 1 -- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98004f70 msgr2=0x7f9b9800b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:17.015 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.011+0000 7f9bc55f7700 1 -- 172.21.15.84:0/2905257833 reap_dead start 2020-01-16T05:44:17.015 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.011+0000 7f9bbffff700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98004f70 0x7f9b9800b7f0 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f9bb0000f00 tx=0x7f9bb0010df0).stop 2020-01-16T05:44:17.015 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.015+0000 7f9bbffff700 1 -- 172.21.15.84:0/2905257833 shutdown_connections 2020-01-16T05:44:17.015 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.015+0000 7f9bbffff700 1 --2- 172.21.15.84:0/2905257833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98004f70 0x7f9b9800b7f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:17.015 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.015+0000 7f9bbffff700 1 -- 172.21.15.84:0/2905257833 shutdown_connections 2020-01-16T05:44:17.015 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.015+0000 7f9bbffff700 1 -- 172.21.15.84:0/2905257833 wait complete. 2020-01-16T05:44:17.016 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.015+0000 7f9bbffff700 1 -- 172.21.15.84:0/2905257833 >> 172.21.15.84:0/2905257833 conn(0x7f9bc00a9b30 msgr2=0x7f9bc007dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:17.026 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-01-16T05:44:17.148 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b6dff700 1 Processor -- start 2020-01-16T05:44:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b6dff700 1 -- start start 2020-01-16T05:44:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b6dff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74b00a9b30 0x7f74b00abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b6dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f74b00a4250 0x7f74b0066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b6dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b0066dd0 con 0x7f74b007ff10 2020-01-16T05:44:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b6dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b00a4830 con 0x7f74b00a4250 2020-01-16T05:44:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b6dff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b007f9d0 con 0x7f74b00a9b30 2020-01-16T05:44:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b5dfd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f74b007ff10 0x7f74b00a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51842/0 (socket says 172.21.15.84:51842) 2020-01-16T05:44:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b5dfd700 1 -- 172.21.15.84:0/460751525 learned_addr learned my addr 172.21.15.84:0/460751525 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b65fe700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74b00a9b30 0x7f74b00abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b8061700 1 --2- 172.21.15.84:0/460751525 >> v2:172.21.15.142:3300/0 conn(0x7f74b00a4250 0x7f74b0066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b55fc700 1 -- 172.21.15.84:0/460751525 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693935189 0 0) 0x7f74b0066dd0 con 0x7f74b007ff10 2020-01-16T05:44:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b55fc700 1 -- 172.21.15.84:0/460751525 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7498003230 con 0x7f74b007ff10 2020-01-16T05:44:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b55fc700 1 -- 172.21.15.84:0/460751525 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 356528902 0 0) 0x7f7498003230 con 0x7f74b007ff10 2020-01-16T05:44:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b55fc700 1 -- 172.21.15.84:0/460751525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74b00a9b30 msgr2=0x7f74b00abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:17.151 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b55fc700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74b00a9b30 0x7f74b00abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:17.151 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b55fc700 1 -- 172.21.15.84:0/460751525 >> v2:172.21.15.142:3300/0 conn(0x7f74b00a4250 msgr2=0x7f74b0066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:17.151 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b55fc700 1 --2- 172.21.15.84:0/460751525 >> v2:172.21.15.142:3300/0 conn(0x7f74b00a4250 0x7f74b0066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:17.151 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b55fc700 1 -- 172.21.15.84:0/460751525 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b0150ce0 con 0x7f74b007ff10 2020-01-16T05:44:17.151 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b55fc700 1 -- 172.21.15.84:0/460751525 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f74a4001750 con 0x7f74b007ff10 2020-01-16T05:44:17.151 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b55fc700 1 -- 172.21.15.84:0/460751525 >> v1:172.21.15.84:6789/0 conn(0x7f74b007ff10 legacy=0x7f74b00a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:17.151 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b55fc700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7498003860 0x7f7498003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:17.152 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b55fc700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74980045a0 0x7f74980049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:17.152 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b55fc700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7498004f20 0x7f749804f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:17.152 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b55fc700 1 -- 172.21.15.84:0/460751525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00a4830 con 0x7f7498004f20 2020-01-16T05:44:17.152 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b55fc700 1 -- 172.21.15.84:0/460751525 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b007f9d0 con 0x7f74980045a0 2020-01-16T05:44:17.152 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b55fc700 1 -- 172.21.15.84:0/460751525 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749804fd50 con 0x7f7498003860 2020-01-16T05:44:17.152 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b65fe700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74b00a9b30 0x7f74b00abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:17.152 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b8061700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7498004f20 0x7f749804f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:17.152 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b5dfd700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74980045a0 0x7f74980049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:17.153 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.143+0000 7f74b65fe700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7498003860 0x7f7498003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:17.153 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b8061700 1 -- 172.21.15.84:0/460751525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7498003860 msgr2=0x7f7498003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:17.153 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b8061700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7498003860 0x7f7498003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:17.153 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b8061700 1 -- 172.21.15.84:0/460751525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74980045a0 msgr2=0x7f74980049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:17.153 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b8061700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74980045a0 0x7f74980049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:17.153 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b8061700 1 -- 172.21.15.84:0/460751525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7498050000 con 0x7f7498004f20 2020-01-16T05:44:17.153 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b65fe700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7498003860 0x7f7498003c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:44:17.154 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b5dfd700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74980045a0 0x7f74980049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:44:17.154 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b8061700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7498004f20 0x7f749804f800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f74a80032b0 tx=0x7f74a80104e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.154 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b8061700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7498004f20 0x7f749804f800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f74a80032b0 tx=0x7f74a80104e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.154 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b8061700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7498004f20 0x7f749804f800 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7f74a80032b0 tx=0x7f74a80104e0).ready entity=mon.0 client_cookie=d817fe3dbe0ca612 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:17.154 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b8061700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7498004f20 0x7f749804f800 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f74a80032b0 tx=0x7f74a80104e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.154 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b55fc700 1 -- 172.21.15.84:0/460751525 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74a80114a0 con 0x7f7498004f20 2020-01-16T05:44:17.154 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b8061700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7498004f20 0x7f749804f800 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f74a80032b0 tx=0x7f74a80104e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.154 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b55fc700 1 -- 172.21.15.84:0/460751525 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a80110c0 con 0x7f7498004f20 2020-01-16T05:44:17.155 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b8061700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7498004f20 0x7f749804f800 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f74a80032b0 tx=0x7f74a80104e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.155 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b6dff700 1 -- 172.21.15.84:0/460751525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7498004f20 msgr2=0x7f749804f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:17.155 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b55fc700 1 -- 172.21.15.84:0/460751525 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74a8011a80 con 0x7f7498004f20 2020-01-16T05:44:17.155 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b6dff700 1 --2- 172.21.15.84:0/460751525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7498004f20 0x7f749804f800 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7f74a80032b0 tx=0x7f74a80104e0).stop 2020-01-16T05:44:17.155 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b8061700 1 -- 172.21.15.84:0/460751525 reap_dead start 2020-01-16T05:44:17.155 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b6dff700 1 -- 172.21.15.84:0/460751525 shutdown_connections 2020-01-16T05:44:17.155 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b6dff700 1 -- 172.21.15.84:0/460751525 shutdown_connections 2020-01-16T05:44:17.156 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b6dff700 1 -- 172.21.15.84:0/460751525 wait complete. 2020-01-16T05:44:17.156 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b6dff700 1 -- 172.21.15.84:0/460751525 >> 172.21.15.84:0/460751525 conn(0x7f74b00acfc0 msgr2=0x7f74b00a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:17.159 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b6dff700 1 Processor -- start 2020-01-16T05:44:17.159 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.147+0000 7f74b6dff700 1 -- start start 2020-01-16T05:44:17.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b6dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f74b0066990 0x7f74b007d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:17.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b6dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b007ed00 con 0x7f74b007c8c0 2020-01-16T05:44:17.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b6dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b007bc80 con 0x7f74b007c490 2020-01-16T05:44:17.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b6dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b0124e30 con 0x7f74b0066990 2020-01-16T05:44:17.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b65fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f74b0066990 0x7f74b007d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:17.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b65fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f74b0066990 0x7f74b007d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34652/0 (socket says 172.21.15.84:34652) 2020-01-16T05:44:17.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b65fe700 1 -- 172.21.15.84:0/3472093641 learned_addr learned my addr 172.21.15.84:0/3472093641 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:17.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b65fe700 1 -- 172.21.15.84:0/3472093641 >> v1:172.21.15.142:6789/0 conn(0x7f74b007c490 legacy=0x7f74b01349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:17.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b65fe700 1 -- 172.21.15.84:0/3472093641 >> v1:172.21.15.84:6789/0 conn(0x7f74b007c8c0 legacy=0x7f74b01351c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:17.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b65fe700 1 -- 172.21.15.84:0/3472093641 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b00921e0 con 0x7f74b0066990 2020-01-16T05:44:17.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b65fe700 1 --2- 172.21.15.84:0/3472093641 >> v2:172.21.15.84:3300/0 conn(0x7f74b0066990 0x7f74b007d2c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f74a0007720 tx=0x7f74a0012e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b65fe700 1 --2- 172.21.15.84:0/3472093641 >> v2:172.21.15.84:3300/0 conn(0x7f74b0066990 0x7f74b007d2c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f74a0007720 tx=0x7f74a0012e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b65fe700 1 --2- 172.21.15.84:0/3472093641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74b0066990 0x7f74b007d2c0 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7f74a0007720 tx=0x7f74a0012e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:17.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b65fe700 1 --2- 172.21.15.84:0/3472093641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74b0066990 0x7f74b007d2c0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f74a0007720 tx=0x7f74a0012e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b65fe700 1 --2- 172.21.15.84:0/3472093641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74b0066990 0x7f74b007d2c0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f74a0007720 tx=0x7f74a0012e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74aeffd700 1 -- 172.21.15.84:0/3472093641 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74a0013b00 con 0x7f74b0066990 2020-01-16T05:44:17.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b65fe700 1 --2- 172.21.15.84:0/3472093641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74b0066990 0x7f74b007d2c0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f74a0007720 tx=0x7f74a0012e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74aeffd700 1 -- 172.21.15.84:0/3472093641 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a0013720 con 0x7f74b0066990 2020-01-16T05:44:17.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b6dff700 1 -- 172.21.15.84:0/3472093641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b00a0890 con 0x7f74b0066990 2020-01-16T05:44:17.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74aeffd700 1 -- 172.21.15.84:0/3472093641 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74a00058b0 con 0x7f74b0066990 2020-01-16T05:44:17.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b6dff700 1 -- 172.21.15.84:0/3472093641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b007d810 con 0x7f74b0066990 2020-01-16T05:44:17.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b65fe700 1 --2- 172.21.15.84:0/3472093641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74b0066990 0x7f74b007d2c0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f74a0007720 tx=0x7f74a0012e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.163 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74aeffd700 1 -- 172.21.15.84:0/3472093641 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f74a0005bc0 con 0x7f74b0066990 2020-01-16T05:44:17.163 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b65fe700 1 --2- 172.21.15.84:0/3472093641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74b0066990 0x7f74b007d2c0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f74a0007720 tx=0x7f74a0012e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.163 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b6dff700 1 -- 172.21.15.84:0/3472093641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b005e1c0 con 0x7f74b0066990 2020-01-16T05:44:17.163 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74aeffd700 1 --2- 172.21.15.84:0/3472093641 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f749003c250 0x7f749003e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:17.163 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74aeffd700 1 -- 172.21.15.84:0/3472093641 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f74a00080d0 con 0x7f74b0066990 2020-01-16T05:44:17.163 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.151+0000 7f74b5dfd700 1 --2- 172.21.15.84:0/3472093641 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f749003c250 0x7f749003e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:17.163 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.155+0000 7f74b5dfd700 1 --2- 172.21.15.84:0/3472093641 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f749003c250 0x7f749003e760 crc :-1 s=READY pgs=86 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:17.164 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.159+0000 7f74b65fe700 1 --2- 172.21.15.84:0/3472093641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74b0066990 0x7f74b007d2c0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f74a0007720 tx=0x7f74a0012e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.164 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.159+0000 7f74aeffd700 1 -- 172.21.15.84:0/3472093641 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f74a0034e40 con 0x7f74b0066990 2020-01-16T05:44:17.277 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.275+0000 7f74b6dff700 1 -- 172.21.15.84:0/3472093641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f74b007ce60 con 0x7f74b0066990 2020-01-16T05:44:17.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.275+0000 7f74b65fe700 1 --2- 172.21.15.84:0/3472093641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74b0066990 0x7f74b007d2c0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f74a0007720 tx=0x7f74a0012e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.275+0000 7f74aeffd700 1 -- 172.21.15.84:0/3472093641 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f74a00350a0 con 0x7f74b0066990 2020-01-16T05:44:17.278 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:17.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.279+0000 7f74b6dff700 1 -- 172.21.15.84:0/3472093641 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f749003c250 msgr2=0x7f749003e760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:17.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.279+0000 7f74b6dff700 1 --2- 172.21.15.84:0/3472093641 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f749003c250 0x7f749003e760 crc :-1 s=READY pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:17.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.279+0000 7f74b6dff700 1 -- 172.21.15.84:0/3472093641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74b0066990 msgr2=0x7f74b007d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:17.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.279+0000 7f74b6dff700 1 --2- 172.21.15.84:0/3472093641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74b0066990 0x7f74b007d2c0 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7f74a0007720 tx=0x7f74a0012e50).stop 2020-01-16T05:44:17.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.279+0000 7f74b6dff700 1 -- 172.21.15.84:0/3472093641 shutdown_connections 2020-01-16T05:44:17.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.279+0000 7f74b6dff700 1 --2- 172.21.15.84:0/3472093641 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f749003c250 0x7f749003e760 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:17.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.279+0000 7f74b6dff700 1 --2- 172.21.15.84:0/3472093641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74b0066990 0x7f74b007d2c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:17.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.279+0000 7f74b6dff700 1 -- 172.21.15.84:0/3472093641 shutdown_connections 2020-01-16T05:44:17.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.279+0000 7f74b6dff700 1 -- 172.21.15.84:0/3472093641 wait complete. 2020-01-16T05:44:17.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.279+0000 7f74b6dff700 1 -- 172.21.15.84:0/3472093641 >> 172.21.15.84:0/3472093641 conn(0x7f74b00a4d70 msgr2=0x7f74b005e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:17.291 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-01-16T05:44:17.416 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a462fa700 1 Processor -- start 2020-01-16T05:44:17.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a462fa700 1 -- start start 2020-01-16T05:44:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a462fa700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3a400a9b30 0x7f3a400abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a462fa700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400a4250 0x7f3a40066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a462fa700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a40066dd0 con 0x7f3a4007ff10 2020-01-16T05:44:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a462fa700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a400a4830 con 0x7f3a400a9b30 2020-01-16T05:44:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a462fa700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4007f9d0 con 0x7f3a400a4250 2020-01-16T05:44:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a45af9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3a400a9b30 0x7f3a400abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a452f8700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3a4007ff10 0x7f3a400a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51862/0 (socket says 172.21.15.84:51862) 2020-01-16T05:44:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a452f8700 1 -- 172.21.15.84:0/2859848267 learned_addr learned my addr 172.21.15.84:0/2859848267 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a45af9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3a400a9b30 0x7f3a400abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34660/0 (socket says 172.21.15.84:34660) 2020-01-16T05:44:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a4755c700 1 --2- 172.21.15.84:0/2859848267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400a4250 0x7f3a40066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a45af9700 1 -- 172.21.15.84:0/2859848267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400a4250 msgr2=0x7f3a40066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a45af9700 1 --2- 172.21.15.84:0/2859848267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400a4250 0x7f3a40066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a45af9700 1 -- 172.21.15.84:0/2859848267 >> v1:172.21.15.84:6789/0 conn(0x7f3a4007ff10 legacy=0x7f3a400a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a45af9700 1 -- 172.21.15.84:0/2859848267 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a40150ce0 con 0x7f3a400a9b30 2020-01-16T05:44:17.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a45af9700 1 --2- 172.21.15.84:0/2859848267 >> v2:172.21.15.84:3300/0 conn(0x7f3a400a9b30 0x7f3a400abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3a400a49f0 tx=0x7f3a30010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a45af9700 1 --2- 172.21.15.84:0/2859848267 >> v2:172.21.15.84:3300/0 conn(0x7f3a400a9b30 0x7f3a400abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3a400a49f0 tx=0x7f3a30010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a45af9700 1 --2- 172.21.15.84:0/2859848267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a400a9b30 0x7f3a400abdd0 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f3a400a49f0 tx=0x7f3a30010170).ready entity=mon.0 client_cookie=aba60dcf971638a server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:17.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a45af9700 1 --2- 172.21.15.84:0/2859848267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a400a9b30 0x7f3a400abdd0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f3a400a49f0 tx=0x7f3a30010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a44af7700 1 -- 172.21.15.84:0/2859848267 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a3000a160 con 0x7f3a400a9b30 2020-01-16T05:44:17.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a45af9700 1 --2- 172.21.15.84:0/2859848267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a400a9b30 0x7f3a400abdd0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f3a400a49f0 tx=0x7f3a30010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.411+0000 7f3a45af9700 1 --2- 172.21.15.84:0/2859848267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a400a9b30 0x7f3a400abdd0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f3a400a49f0 tx=0x7f3a30010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a44af7700 1 -- 172.21.15.84:0/2859848267 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a30011af0 con 0x7f3a400a9b30 2020-01-16T05:44:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a44af7700 1 -- 172.21.15.84:0/2859848267 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a3000a740 con 0x7f3a400a9b30 2020-01-16T05:44:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a462fa700 1 -- 172.21.15.84:0/2859848267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a400a9b30 msgr2=0x7f3a400abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a462fa700 1 --2- 172.21.15.84:0/2859848267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a400a9b30 0x7f3a400abdd0 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f3a400a49f0 tx=0x7f3a30010170).stop 2020-01-16T05:44:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a462fa700 1 -- 172.21.15.84:0/2859848267 shutdown_connections 2020-01-16T05:44:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a462fa700 1 --2- 172.21.15.84:0/2859848267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400a4250 0x7f3a40066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a462fa700 1 --2- 172.21.15.84:0/2859848267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a400a9b30 0x7f3a400abdd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a462fa700 1 -- 172.21.15.84:0/2859848267 shutdown_connections 2020-01-16T05:44:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a462fa700 1 -- 172.21.15.84:0/2859848267 wait complete. 2020-01-16T05:44:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a462fa700 1 -- 172.21.15.84:0/2859848267 >> 172.21.15.84:0/2859848267 conn(0x7f3a400acfc0 msgr2=0x7f3a400a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:17.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a462fa700 1 Processor -- start 2020-01-16T05:44:17.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a462fa700 1 -- start start 2020-01-16T05:44:17.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a462fa700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3a400251f0 0x7f3a40090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:17.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a462fa700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400775a0 0x7f3a4009f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:17.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a462fa700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a400a3610 con 0x7f3a4009f7c0 2020-01-16T05:44:17.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a462fa700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a40077300 con 0x7f3a400251f0 2020-01-16T05:44:17.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a462fa700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a400913f0 con 0x7f3a400775a0 2020-01-16T05:44:17.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a452f8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400775a0 0x7f3a4009f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:17.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a452f8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400775a0 0x7f3a4009f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:46910/0 (socket says 172.21.15.84:46910) 2020-01-16T05:44:17.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.415+0000 7f3a452f8700 1 -- 172.21.15.84:0/2791508280 learned_addr learned my addr 172.21.15.84:0/2791508280 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:17.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a45af9700 1 --2- 172.21.15.84:0/2791508280 >> v2:172.21.15.142:3300/0 conn(0x7f3a400251f0 0x7f3a40090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:17.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a452f8700 1 -- 172.21.15.84:0/2791508280 >> v2:172.21.15.142:3300/0 conn(0x7f3a400251f0 msgr2=0x7f3a40090d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:17.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a452f8700 1 --2- 172.21.15.84:0/2791508280 >> v2:172.21.15.142:3300/0 conn(0x7f3a400251f0 0x7f3a40090d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:17.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a452f8700 1 -- 172.21.15.84:0/2791508280 >> v1:172.21.15.142:6789/0 conn(0x7f3a4009f7c0 legacy=0x7f3a4007c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:17.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a452f8700 1 -- 172.21.15.84:0/2791508280 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4009fbf0 con 0x7f3a400775a0 2020-01-16T05:44:17.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a452f8700 1 --2- 172.21.15.84:0/2791508280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400775a0 0x7f3a4009f270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3a34004520 tx=0x7f3a34010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a452f8700 1 --2- 172.21.15.84:0/2791508280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400775a0 0x7f3a4009f270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3a34004520 tx=0x7f3a34010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a452f8700 1 --2- 172.21.15.84:0/2791508280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400775a0 0x7f3a4009f270 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f3a34004520 tx=0x7f3a34010b80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:17.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a452f8700 1 --2- 172.21.15.84:0/2791508280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400775a0 0x7f3a4009f270 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f3a34004520 tx=0x7f3a34010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a452f8700 1 --2- 172.21.15.84:0/2791508280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400775a0 0x7f3a4009f270 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f3a34004520 tx=0x7f3a34010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a452f8700 1 --2- 172.21.15.84:0/2791508280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400775a0 0x7f3a4009f270 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f3a34004520 tx=0x7f3a34010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a3e7fc700 1 -- 172.21.15.84:0/2791508280 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a3400ca10 con 0x7f3a400775a0 2020-01-16T05:44:17.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a3e7fc700 1 -- 172.21.15.84:0/2791508280 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3400c630 con 0x7f3a400775a0 2020-01-16T05:44:17.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a462fa700 1 -- 172.21.15.84:0/2791508280 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a40076fc0 con 0x7f3a400775a0 2020-01-16T05:44:17.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a3e7fc700 1 -- 172.21.15.84:0/2791508280 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a340125f0 con 0x7f3a400775a0 2020-01-16T05:44:17.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a462fa700 1 -- 172.21.15.84:0/2791508280 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a400767c0 con 0x7f3a400775a0 2020-01-16T05:44:17.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a452f8700 1 --2- 172.21.15.84:0/2791508280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400775a0 0x7f3a4009f270 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f3a34004520 tx=0x7f3a34010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a462fa700 1 -- 172.21.15.84:0/2791508280 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4005e1c0 con 0x7f3a400775a0 2020-01-16T05:44:17.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a3e7fc700 1 -- 172.21.15.84:0/2791508280 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f3a34012900 con 0x7f3a400775a0 2020-01-16T05:44:17.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a452f8700 1 --2- 172.21.15.84:0/2791508280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400775a0 0x7f3a4009f270 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f3a34004520 tx=0x7f3a34010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a3e7fc700 1 --2- 172.21.15.84:0/2791508280 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3a2003c270 0x7f3a2003e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:17.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a3e7fc700 1 -- 172.21.15.84:0/2791508280 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f3a3404c990 con 0x7f3a400775a0 2020-01-16T05:44:17.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.419+0000 7f3a45af9700 1 --2- 172.21.15.84:0/2791508280 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3a2003c270 0x7f3a2003e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:17.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.423+0000 7f3a45af9700 1 --2- 172.21.15.84:0/2791508280 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3a2003c270 0x7f3a2003e780 crc :-1 s=READY pgs=87 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:17.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.427+0000 7f3a452f8700 1 --2- 172.21.15.84:0/2791508280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400775a0 0x7f3a4009f270 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f3a34004520 tx=0x7f3a34010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.427+0000 7f3a3e7fc700 1 -- 172.21.15.84:0/2791508280 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f3a34033210 con 0x7f3a400775a0 2020-01-16T05:44:17.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.547+0000 7f3a462fa700 1 -- 172.21.15.84:0/2791508280 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3a40077b70 con 0x7f3a400775a0 2020-01-16T05:44:17.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.547+0000 7f3a452f8700 1 --2- 172.21.15.84:0/2791508280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400775a0 0x7f3a4009f270 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f3a34004520 tx=0x7f3a34010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:17.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.547+0000 7f3a3e7fc700 1 -- 172.21.15.84:0/2791508280 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3a34012c10 con 0x7f3a400775a0 2020-01-16T05:44:17.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.551+0000 7f3a462fa700 1 -- 172.21.15.84:0/2791508280 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3a2003c270 msgr2=0x7f3a2003e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:17.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.551+0000 7f3a462fa700 1 --2- 172.21.15.84:0/2791508280 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3a2003c270 0x7f3a2003e780 crc :-1 s=READY pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:17.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.551+0000 7f3a462fa700 1 -- 172.21.15.84:0/2791508280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400775a0 msgr2=0x7f3a4009f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:17.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.551+0000 7f3a462fa700 1 --2- 172.21.15.84:0/2791508280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400775a0 0x7f3a4009f270 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f3a34004520 tx=0x7f3a34010b80).stop 2020-01-16T05:44:17.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.551+0000 7f3a462fa700 1 -- 172.21.15.84:0/2791508280 shutdown_connections 2020-01-16T05:44:17.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.551+0000 7f3a462fa700 1 --2- 172.21.15.84:0/2791508280 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3a2003c270 0x7f3a2003e780 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:17.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.551+0000 7f3a462fa700 1 --2- 172.21.15.84:0/2791508280 >> v2:172.21.15.142:3300/0 conn(0x7f3a400251f0 0x7f3a40090d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:17.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.551+0000 7f3a462fa700 1 --2- 172.21.15.84:0/2791508280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a400775a0 0x7f3a4009f270 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:17.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.551+0000 7f3a462fa700 1 -- 172.21.15.84:0/2791508280 shutdown_connections 2020-01-16T05:44:17.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.551+0000 7f3a462fa700 1 -- 172.21.15.84:0/2791508280 wait complete. 2020-01-16T05:44:17.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:17.551+0000 7f3a462fa700 1 -- 172.21.15.84:0/2791508280 >> 172.21.15.84:0/2791508280 conn(0x7f3a400a4ad0 msgr2=0x7f3a4007eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:17.938 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:17.938 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2020-01-16T05:44:17.938 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:44:18.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.059+0000 7f42bacff700 1 Processor -- start 2020-01-16T05:44:18.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.059+0000 7f42bacff700 1 -- start start 2020-01-16T05:44:18.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42bacff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f42b40a9b30 0x7f42b40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:18.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42bacff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b4066880 con 0x7f42b407ff10 2020-01-16T05:44:18.068 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42bacff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b4066ab0 con 0x7f42b40a4250 2020-01-16T05:44:18.068 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42bacff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b40a4830 con 0x7f42b40a9b30 2020-01-16T05:44:18.068 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42ba4fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f42b40a9b30 0x7f42b40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:18.068 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42ba4fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f42b40a9b30 0x7f42b40abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34674/0 (socket says 172.21.15.84:34674) 2020-01-16T05:44:18.068 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42ba4fe700 1 -- 172.21.15.84:0/1668598059 learned_addr learned my addr 172.21.15.84:0/1668598059 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:18.068 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42b9cfd700 1 --1- 172.21.15.84:0/1668598059 >> v1:172.21.15.84:6789/0 conn(0x7f42b407ff10 0x7f42b40a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51876/0 (socket says 172.21.15.84:51876) 2020-01-16T05:44:18.068 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42ba4fe700 1 -- 172.21.15.84:0/1668598059 >> v1:172.21.15.142:6789/0 conn(0x7f42b40a4250 legacy=0x7f42b414fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:18.069 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42ba4fe700 1 -- 172.21.15.84:0/1668598059 >> v1:172.21.15.84:6789/0 conn(0x7f42b407ff10 legacy=0x7f42b40a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.069 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42ba4fe700 1 -- 172.21.15.84:0/1668598059 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b4066ce0 con 0x7f42b40a9b30 2020-01-16T05:44:18.069 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42ba4fe700 1 --2- 172.21.15.84:0/1668598059 >> v2:172.21.15.84:3300/0 conn(0x7f42b40a9b30 0x7f42b40abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f42ac008c90 tx=0x7f42ac0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.069 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42ba4fe700 1 --2- 172.21.15.84:0/1668598059 >> v2:172.21.15.84:3300/0 conn(0x7f42b40a9b30 0x7f42b40abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f42ac008c90 tx=0x7f42ac0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.069 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42ba4fe700 1 --2- 172.21.15.84:0/1668598059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42b40a9b30 0x7f42b40abdd0 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7f42ac008c90 tx=0x7f42ac0101b0).ready entity=mon.0 client_cookie=758e1d52b417b3d2 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:18.069 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42ba4fe700 1 --2- 172.21.15.84:0/1668598059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42b40a9b30 0x7f42b40abdd0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f42ac008c90 tx=0x7f42ac0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.069 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42b94fc700 1 -- 172.21.15.84:0/1668598059 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42ac00a160 con 0x7f42b40a9b30 2020-01-16T05:44:18.070 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42ba4fe700 1 --2- 172.21.15.84:0/1668598059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42b40a9b30 0x7f42b40abdd0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f42ac008c90 tx=0x7f42ac0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.070 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42b94fc700 1 -- 172.21.15.84:0/1668598059 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac011c20 con 0x7f42b40a9b30 2020-01-16T05:44:18.070 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42ba4fe700 1 --2- 172.21.15.84:0/1668598059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42b40a9b30 0x7f42b40abdd0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f42ac008c90 tx=0x7f42ac0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.070 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42b94fc700 1 -- 172.21.15.84:0/1668598059 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42ac00a740 con 0x7f42b40a9b30 2020-01-16T05:44:18.070 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42bacff700 1 -- 172.21.15.84:0/1668598059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42b40a9b30 msgr2=0x7f42b40abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.070 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42bacff700 1 --2- 172.21.15.84:0/1668598059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42b40a9b30 0x7f42b40abdd0 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7f42ac008c90 tx=0x7f42ac0101b0).stop 2020-01-16T05:44:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42bacff700 1 -- 172.21.15.84:0/1668598059 shutdown_connections 2020-01-16T05:44:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42bacff700 1 --2- 172.21.15.84:0/1668598059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42b40a9b30 0x7f42b40abdd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42bacff700 1 -- 172.21.15.84:0/1668598059 shutdown_connections 2020-01-16T05:44:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42bacff700 1 -- 172.21.15.84:0/1668598059 wait complete. 2020-01-16T05:44:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.063+0000 7f42bacff700 1 -- 172.21.15.84:0/1668598059 >> 172.21.15.84:0/1668598059 conn(0x7f42b40acfc0 msgr2=0x7f42b40a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42bacff700 1 Processor -- start 2020-01-16T05:44:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42bacff700 1 -- start start 2020-01-16T05:44:18.075 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42bacff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f42b4132b00 0x7f42b40a2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:18.075 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42bacff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42b4124480 0x7f42b413d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:18.075 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42bacff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b40a3790 con 0x7f42b4122c40 2020-01-16T05:44:18.075 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42bacff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b40a2110 con 0x7f42b4132b00 2020-01-16T05:44:18.075 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42bacff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b4132f30 con 0x7f42b4124480 2020-01-16T05:44:18.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42b9cfd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f42b4132b00 0x7f42b40a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:18.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42b9cfd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f42b4132b00 0x7f42b40a2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34682/0 (socket says 172.21.15.84:34682) 2020-01-16T05:44:18.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42b9cfd700 1 -- 172.21.15.84:0/3164298735 learned_addr learned my addr 172.21.15.84:0/3164298735 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:18.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42bbf61700 1 --2- 172.21.15.84:0/3164298735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42b4124480 0x7f42b413d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:18.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42b2ffd700 1 -- 172.21.15.84:0/3164298735 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463986342 0 0) 0x7f42b40a3790 con 0x7f42b4122c40 2020-01-16T05:44:18.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42b9cfd700 1 -- 172.21.15.84:0/3164298735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42b4124480 msgr2=0x7f42b413d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42b9cfd700 1 --2- 172.21.15.84:0/3164298735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42b4124480 0x7f42b413d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42b9cfd700 1 -- 172.21.15.84:0/3164298735 >> v1:172.21.15.142:6789/0 conn(0x7f42b4122c40 legacy=0x7f42b407ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42b9cfd700 1 -- 172.21.15.84:0/3164298735 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b40a3410 con 0x7f42b4132b00 2020-01-16T05:44:18.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42b9cfd700 1 --2- 172.21.15.84:0/3164298735 >> v2:172.21.15.84:3300/0 conn(0x7f42b4132b00 0x7f42b40a2610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f42a8000e90 tx=0x7f42a8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42b9cfd700 1 --2- 172.21.15.84:0/3164298735 >> v2:172.21.15.84:3300/0 conn(0x7f42b4132b00 0x7f42b40a2610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f42a8000e90 tx=0x7f42a8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42b9cfd700 1 --2- 172.21.15.84:0/3164298735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42b4132b00 0x7f42b40a2610 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7f42a8000e90 tx=0x7f42a8010b70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:18.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42b9cfd700 1 --2- 172.21.15.84:0/3164298735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42b4132b00 0x7f42b40a2610 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f42a8000e90 tx=0x7f42a8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42b2ffd700 1 -- 172.21.15.84:0/3164298735 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42a800c940 con 0x7f42b4132b00 2020-01-16T05:44:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42bacff700 1 -- 172.21.15.84:0/3164298735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b41248b0 con 0x7f42b4132b00 2020-01-16T05:44:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42b9cfd700 1 --2- 172.21.15.84:0/3164298735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42b4132b00 0x7f42b40a2610 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f42a8000e90 tx=0x7f42a8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42b2ffd700 1 -- 172.21.15.84:0/3164298735 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a800c560 con 0x7f42b4132b00 2020-01-16T05:44:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42b9cfd700 1 --2- 172.21.15.84:0/3164298735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42b4132b00 0x7f42b40a2610 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f42a8000e90 tx=0x7f42a8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42b2ffd700 1 -- 172.21.15.84:0/3164298735 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42a80044f0 con 0x7f42b4132b00 2020-01-16T05:44:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42bacff700 1 -- 172.21.15.84:0/3164298735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b413da60 con 0x7f42b4132b00 2020-01-16T05:44:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.067+0000 7f42b9cfd700 1 --2- 172.21.15.84:0/3164298735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42b4132b00 0x7f42b40a2610 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f42a8000e90 tx=0x7f42a8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.071+0000 7f42b2ffd700 1 -- 172.21.15.84:0/3164298735 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f42a80047d0 con 0x7f42b4132b00 2020-01-16T05:44:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.071+0000 7f42bacff700 1 -- 172.21.15.84:0/3164298735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b405e1c0 con 0x7f42b4132b00 2020-01-16T05:44:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.071+0000 7f42b9cfd700 1 --2- 172.21.15.84:0/3164298735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42b4132b00 0x7f42b40a2610 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f42a8000e90 tx=0x7f42a8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.071+0000 7f42b2ffd700 1 --2- 172.21.15.84:0/3164298735 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f429403c170 0x7f429403e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.071+0000 7f42b2ffd700 1 -- 172.21.15.84:0/3164298735 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f42a804c870 con 0x7f42b4132b00 2020-01-16T05:44:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.071+0000 7f42ba4fe700 1 --2- 172.21.15.84:0/3164298735 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f429403c170 0x7f429403e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.071+0000 7f42ba4fe700 1 --2- 172.21.15.84:0/3164298735 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f429403c170 0x7f429403e680 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:18.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.071+0000 7f42b9cfd700 1 --2- 172.21.15.84:0/3164298735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42b4132b00 0x7f42b40a2610 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f42a8000e90 tx=0x7f42a8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.071+0000 7f42b2ffd700 1 -- 172.21.15.84:0/3164298735 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f42a8032e70 con 0x7f42b4132b00 2020-01-16T05:44:18.223 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.223+0000 7f42bacff700 1 -- 172.21.15.84:0/3164298735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42b409fce0 con 0x7f42b4132b00 2020-01-16T05:44:18.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.223+0000 7f42b9cfd700 1 --2- 172.21.15.84:0/3164298735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42b4132b00 0x7f42b40a2610 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f42a8000e90 tx=0x7f42a8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.223+0000 7f42b2ffd700 1 -- 172.21.15.84:0/3164298735 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2102 (secure 0 0 0) 0x7f42a80330d0 con 0x7f42b4132b00 2020-01-16T05:44:18.224 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:18.225 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4359,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:44:07.656087+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4208":{"gid":4208,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.142:6833/1195730666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1195730666},{"type":"v1","addr":"172.21.15.142:6833","nonce":1195730666}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:44:18.226 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.223+0000 7f42bacff700 1 -- 172.21.15.84:0/3164298735 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f429403c170 msgr2=0x7f429403e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.226 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.223+0000 7f42bacff700 1 --2- 172.21.15.84:0/3164298735 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f429403c170 0x7f429403e680 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.226 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.223+0000 7f42bacff700 1 -- 172.21.15.84:0/3164298735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42b4132b00 msgr2=0x7f42b40a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.227 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.223+0000 7f42bacff700 1 --2- 172.21.15.84:0/3164298735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42b4132b00 0x7f42b40a2610 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7f42a8000e90 tx=0x7f42a8010b70).stop 2020-01-16T05:44:18.227 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.223+0000 7f42bacff700 1 -- 172.21.15.84:0/3164298735 shutdown_connections 2020-01-16T05:44:18.227 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.223+0000 7f42bacff700 1 --2- 172.21.15.84:0/3164298735 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f429403c170 0x7f429403e680 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.227 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.223+0000 7f42bacff700 1 --2- 172.21.15.84:0/3164298735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42b4124480 0x7f42b413d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.227 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.223+0000 7f42bacff700 1 --2- 172.21.15.84:0/3164298735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42b4132b00 0x7f42b40a2610 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.228 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.223+0000 7f42bacff700 1 -- 172.21.15.84:0/3164298735 shutdown_connections 2020-01-16T05:44:18.228 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.223+0000 7f42bacff700 1 -- 172.21.15.84:0/3164298735 wait complete. 2020-01-16T05:44:18.228 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.223+0000 7f42bacff700 1 -- 172.21.15.84:0/3164298735 >> 172.21.15.84:0/3164298735 conn(0x7f42b405f400 msgr2=0x7f42b40246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:18.229 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 5 2020-01-16T05:44:18.237 INFO:tasks.mds_thrash:Ready to start thrashing 2020-01-16T05:44:18.237 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2020-01-16T05:44:18.237 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-01-16T05:44:18.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41ddf82700 1 Processor -- start 2020-01-16T05:44:18.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41ddf82700 1 -- start start 2020-01-16T05:44:18.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41ddf82700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41d807ff10 0x7f41d80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:18.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41ddf82700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d8066880 con 0x7f41d80a4250 2020-01-16T05:44:18.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41ddf82700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d8066ab0 con 0x7f41d80a9b30 2020-01-16T05:44:18.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41ddf82700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d80a4830 con 0x7f41d807ff10 2020-01-16T05:44:18.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41df1e4700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f41d80a4250 0x7f41d814fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51892/0 (socket says 172.21.15.84:51892) 2020-01-16T05:44:18.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41df1e4700 1 -- 172.21.15.84:0/3701734162 learned_addr learned my addr 172.21.15.84:0/3701734162 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:18.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41dcf80700 1 --2- 172.21.15.84:0/3701734162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41d807ff10 0x7f41d80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:18.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41cbfff700 1 -- 172.21.15.84:0/3701734162 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153149754 0 0) 0x7f41d8066880 con 0x7f41d80a4250 2020-01-16T05:44:18.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41cbfff700 1 -- 172.21.15.84:0/3701734162 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41c4003230 con 0x7f41d80a4250 2020-01-16T05:44:18.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41dcf80700 1 -- 172.21.15.84:0/3701734162 >> v1:172.21.15.142:6789/0 conn(0x7f41d80a9b30 legacy=0x7f41d80a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41cbfff700 1 -- 172.21.15.84:0/3701734162 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122009670 0 0) 0x7f41d8066ab0 con 0x7f41d80a9b30 2020-01-16T05:44:18.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41dcf80700 1 -- 172.21.15.84:0/3701734162 >> v1:172.21.15.84:6789/0 conn(0x7f41d80a4250 legacy=0x7f41d814fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41dcf80700 1 -- 172.21.15.84:0/3701734162 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d8066ce0 con 0x7f41d807ff10 2020-01-16T05:44:18.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41dcf80700 1 --2- 172.21.15.84:0/3701734162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41d807ff10 0x7f41d80abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f41cc002f30 tx=0x7f41cc00fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41dcf80700 1 --2- 172.21.15.84:0/3701734162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41d807ff10 0x7f41d80abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f41cc002f30 tx=0x7f41cc00fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41dcf80700 1 --2- 172.21.15.84:0/3701734162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41d807ff10 0x7f41d80abdd0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f41cc002f30 tx=0x7f41cc00fd70).ready entity=mon.2 client_cookie=2f3465dbf545b950 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:18.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41dcf80700 1 --2- 172.21.15.84:0/3701734162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41d807ff10 0x7f41d80abdd0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f41cc002f30 tx=0x7f41cc00fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41cbfff700 1 -- 172.21.15.84:0/3701734162 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41cc011620 con 0x7f41d807ff10 2020-01-16T05:44:18.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41dcf80700 1 --2- 172.21.15.84:0/3701734162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41d807ff10 0x7f41d80abdd0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f41cc002f30 tx=0x7f41cc00fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41cbfff700 1 -- 172.21.15.84:0/3701734162 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc008d40 con 0x7f41d807ff10 2020-01-16T05:44:18.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41dcf80700 1 --2- 172.21.15.84:0/3701734162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41d807ff10 0x7f41d80abdd0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f41cc002f30 tx=0x7f41cc00fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41cbfff700 1 -- 172.21.15.84:0/3701734162 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41cc011c00 con 0x7f41d807ff10 2020-01-16T05:44:18.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41ddf82700 1 -- 172.21.15.84:0/3701734162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41d807ff10 msgr2=0x7f41d80abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.347+0000 7f41ddf82700 1 --2- 172.21.15.84:0/3701734162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41d807ff10 0x7f41d80abdd0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f41cc002f30 tx=0x7f41cc00fd70).stop 2020-01-16T05:44:18.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.351+0000 7f41ddf82700 1 -- 172.21.15.84:0/3701734162 shutdown_connections 2020-01-16T05:44:18.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.351+0000 7f41ddf82700 1 --2- 172.21.15.84:0/3701734162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41d807ff10 0x7f41d80abdd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.351+0000 7f41ddf82700 1 -- 172.21.15.84:0/3701734162 shutdown_connections 2020-01-16T05:44:18.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.351+0000 7f41ddf82700 1 -- 172.21.15.84:0/3701734162 wait complete. 2020-01-16T05:44:18.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.351+0000 7f41ddf82700 1 -- 172.21.15.84:0/3701734162 >> 172.21.15.84:0/3701734162 conn(0x7f41d80acfc0 msgr2=0x7f41d80a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:18.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.351+0000 7f41ddf82700 1 Processor -- start 2020-01-16T05:44:18.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.351+0000 7f41ddf82700 1 -- start start 2020-01-16T05:44:18.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.351+0000 7f41ddf82700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f41d8091310 0x7f41d809ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:18.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.351+0000 7f41ddf82700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f41d809f220 0x7f41d809f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:18.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.351+0000 7f41ddf82700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d808f100 con 0x7f41d81275f0 2020-01-16T05:44:18.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.351+0000 7f41ddf82700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d808ff20 con 0x7f41d8091310 2020-01-16T05:44:18.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.351+0000 7f41ddf82700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d80ab090 con 0x7f41d809f220 2020-01-16T05:44:18.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.351+0000 7f41dcf80700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f41d8091310 0x7f41d809ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:18.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.351+0000 7f41df1e4700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f41d809f220 0x7f41d809f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:18.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.351+0000 7f41dcf80700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f41d8091310 0x7f41d809ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34698/0 (socket says 172.21.15.84:34698) 2020-01-16T05:44:18.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.351+0000 7f41dcf80700 1 -- 172.21.15.84:0/3917636147 learned_addr learned my addr 172.21.15.84:0/3917636147 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:18.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41dcf80700 1 -- 172.21.15.84:0/3917636147 >> v2:172.21.15.142:3300/0 conn(0x7f41d809f220 msgr2=0x7f41d809f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41dcf80700 1 --2- 172.21.15.84:0/3917636147 >> v2:172.21.15.142:3300/0 conn(0x7f41d809f220 0x7f41d809f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41dcf80700 1 -- 172.21.15.84:0/3917636147 >> v1:172.21.15.142:6789/0 conn(0x7f41d81275f0 legacy=0x7f41d80a5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41dcf80700 1 -- 172.21.15.84:0/3917636147 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d80a3750 con 0x7f41d8091310 2020-01-16T05:44:18.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41dcf80700 1 --2- 172.21.15.84:0/3917636147 >> v2:172.21.15.84:3300/0 conn(0x7f41d8091310 0x7f41d809ecd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41d80900e0 tx=0x7f41cc011430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41dcf80700 1 --2- 172.21.15.84:0/3917636147 >> v2:172.21.15.84:3300/0 conn(0x7f41d8091310 0x7f41d809ecd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41d80900e0 tx=0x7f41cc011430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41dcf80700 1 --2- 172.21.15.84:0/3917636147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41d8091310 0x7f41d809ecd0 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f41d80900e0 tx=0x7f41cc011430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:18.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41dcf80700 1 --2- 172.21.15.84:0/3917636147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41d8091310 0x7f41d809ecd0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f41d80900e0 tx=0x7f41cc011430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41c9ffb700 1 -- 172.21.15.84:0/3917636147 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41cc00f760 con 0x7f41d8091310 2020-01-16T05:44:18.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41dcf80700 1 --2- 172.21.15.84:0/3917636147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41d8091310 0x7f41d809ecd0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f41d80900e0 tx=0x7f41cc011430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41ddf82700 1 -- 172.21.15.84:0/3917636147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d813d3e0 con 0x7f41d8091310 2020-01-16T05:44:18.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41c9ffb700 1 -- 172.21.15.84:0/3917636147 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc011820 con 0x7f41d8091310 2020-01-16T05:44:18.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41dcf80700 1 --2- 172.21.15.84:0/3917636147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41d8091310 0x7f41d809ecd0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f41d80900e0 tx=0x7f41cc011430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41c9ffb700 1 -- 172.21.15.84:0/3917636147 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41cc0056c0 con 0x7f41d8091310 2020-01-16T05:44:18.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41ddf82700 1 -- 172.21.15.84:0/3917636147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d813d910 con 0x7f41d8091310 2020-01-16T05:44:18.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41dcf80700 1 --2- 172.21.15.84:0/3917636147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41d8091310 0x7f41d809ecd0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f41d80900e0 tx=0x7f41cc011430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41ddf82700 1 -- 172.21.15.84:0/3917636147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d805e1c0 con 0x7f41d8091310 2020-01-16T05:44:18.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41c9ffb700 1 -- 172.21.15.84:0/3917636147 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f41cc005a20 con 0x7f41d8091310 2020-01-16T05:44:18.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41dcf80700 1 --2- 172.21.15.84:0/3917636147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41d8091310 0x7f41d809ecd0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f41d80900e0 tx=0x7f41cc011430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41c9ffb700 1 --2- 172.21.15.84:0/3917636147 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f41b803c1d0 0x7f41b803e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:18.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41c9ffb700 1 -- 172.21.15.84:0/3917636147 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f41cc04d150 con 0x7f41d8091310 2020-01-16T05:44:18.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41dd781700 1 --2- 172.21.15.84:0/3917636147 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f41b803c1d0 0x7f41b803e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:18.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.355+0000 7f41dd781700 1 --2- 172.21.15.84:0/3917636147 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f41b803c1d0 0x7f41b803e6e0 crc :-1 s=READY pgs=89 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:18.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.363+0000 7f41dcf80700 1 --2- 172.21.15.84:0/3917636147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41d8091310 0x7f41d809ecd0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f41d80900e0 tx=0x7f41cc011430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.363+0000 7f41c9ffb700 1 -- 172.21.15.84:0/3917636147 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f41cc033750 con 0x7f41d8091310 2020-01-16T05:44:18.475 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.475+0000 7f41ddf82700 1 -- 172.21.15.84:0/3917636147 --> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41d8066370 con 0x7f41b803c1d0 2020-01-16T05:44:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.475+0000 7f41c9ffb700 1 -- 172.21.15.84:0/3917636147 <== mgr.4104 v2:172.21.15.84:6800/12486 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66284 (crc 0 0 0) 0x7f41d8066370 con 0x7f41b803c1d0 2020-01-16T05:44:18.479 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:18.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.479+0000 7f41ddf82700 1 -- 172.21.15.84:0/3917636147 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f41b803c1d0 msgr2=0x7f41b803e6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.479+0000 7f41ddf82700 1 --2- 172.21.15.84:0/3917636147 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f41b803c1d0 0x7f41b803e6e0 crc :-1 s=READY pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.479+0000 7f41ddf82700 1 -- 172.21.15.84:0/3917636147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41d8091310 msgr2=0x7f41d809ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.479+0000 7f41ddf82700 1 --2- 172.21.15.84:0/3917636147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41d8091310 0x7f41d809ecd0 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f41d80900e0 tx=0x7f41cc011430).stop 2020-01-16T05:44:18.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.479+0000 7f41ddf82700 1 -- 172.21.15.84:0/3917636147 shutdown_connections 2020-01-16T05:44:18.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.479+0000 7f41ddf82700 1 --2- 172.21.15.84:0/3917636147 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f41b803c1d0 0x7f41b803e6e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.479+0000 7f41ddf82700 1 --2- 172.21.15.84:0/3917636147 >> v2:172.21.15.142:3300/0 conn(0x7f41d809f220 0x7f41d809f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.479+0000 7f41ddf82700 1 --2- 172.21.15.84:0/3917636147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41d8091310 0x7f41d809ecd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.479+0000 7f41ddf82700 1 -- 172.21.15.84:0/3917636147 shutdown_connections 2020-01-16T05:44:18.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.479+0000 7f41ddf82700 1 -- 172.21.15.84:0/3917636147 wait complete. 2020-01-16T05:44:18.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.479+0000 7f41ddf82700 1 -- 172.21.15.84:0/3917636147 >> 172.21.15.84:0/3917636147 conn(0x7f41d8066650 msgr2=0x7f41d807f070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:18.482 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2020-01-16T05:44:18.491 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2020-01-16T05:44:18.476461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390688,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584032,"statfs":{"total":773094113280,"available":764502048768,"internally_reserved":8589934592,"allocated":2064384,"data_stored":726356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":760,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003000"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071093+0000","last_change":"2020-01-16T05:44:03.942686+0000","last_active":"2020-01-16T05:44:05.071093+0000","last_peered":"2020-01-16T05:44:05.071093+0000","last_clean":"2020-01-16T05:44:05.071093+0000","last_became_active":"2020-01-16T05:44:03.942333+0000","last_became_peered":"2020-01-16T05:44:03.942333+0000","last_unstale":"2020-01-16T05:44:05.071093+0000","last_undegraded":"2020-01-16T05:44:05.071093+0000","last_fullsized":"2020-01-16T05:44:05.071093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.949151+0000","last_change":"2020-01-16T05:44:00.598349+0000","last_active":"2020-01-16T05:44:04.949151+0000","last_peered":"2020-01-16T05:44:04.949151+0000","last_clean":"2020-01-16T05:44:04.949151+0000","last_became_active":"2020-01-16T05:44:00.597979+0000","last_became_peered":"2020-01-16T05:44:00.597979+0000","last_unstale":"2020-01-16T05:44:04.949151+0000","last_undegraded":"2020-01-16T05:44:04.949151+0000","last_fullsized":"2020-01-16T05:44:04.949151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'4","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.539081+0000","last_change":"2020-01-16T05:44:03.633337+0000","last_active":"2020-01-16T05:44:06.539081+0000","last_peered":"2020-01-16T05:44:06.539081+0000","last_clean":"2020-01-16T05:44:06.539081+0000","last_became_active":"2020-01-16T05:44:03.632748+0000","last_became_peered":"2020-01-16T05:44:03.632748+0000","last_unstale":"2020-01-16T05:44:06.539081+0000","last_undegraded":"2020-01-16T05:44:06.539081+0000","last_fullsized":"2020-01-16T05:44:06.539081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.953067+0000","last_change":"2020-01-16T05:44:04.952513+0000","last_active":"2020-01-16T05:44:04.953067+0000","last_peered":"2020-01-16T05:44:04.953067+0000","last_clean":"2020-01-16T05:44:04.953067+0000","last_became_active":"2020-01-16T05:44:04.952051+0000","last_became_peered":"2020-01-16T05:44:04.952051+0000","last_unstale":"2020-01-16T05:44:04.953067+0000","last_undegraded":"2020-01-16T05:44:04.953067+0000","last_fullsized":"2020-01-16T05:44:04.953067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071065+0000","last_change":"2020-01-16T05:44:00.597063+0000","last_active":"2020-01-16T05:44:05.071065+0000","last_peered":"2020-01-16T05:44:05.071065+0000","last_clean":"2020-01-16T05:44:05.071065+0000","last_became_active":"2020-01-16T05:44:00.596565+0000","last_became_peered":"2020-01-16T05:44:00.596565+0000","last_unstale":"2020-01-16T05:44:05.071065+0000","last_undegraded":"2020-01-16T05:44:05.071065+0000","last_fullsized":"2020-01-16T05:44:05.071065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'7","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.542445+0000","last_change":"2020-01-16T05:44:03.632507+0000","last_active":"2020-01-16T05:44:06.542445+0000","last_peered":"2020-01-16T05:44:06.542445+0000","last_clean":"2020-01-16T05:44:06.542445+0000","last_became_active":"2020-01-16T05:44:03.632098+0000","last_became_peered":"2020-01-16T05:44:03.632098+0000","last_unstale":"2020-01-16T05:44:06.542445+0000","last_undegraded":"2020-01-16T05:44:06.542445+0000","last_fullsized":"2020-01-16T05:44:06.542445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.953441+0000","last_change":"2020-01-16T05:44:04.953106+0000","last_active":"2020-01-16T05:44:04.953441+0000","last_peered":"2020-01-16T05:44:04.953441+0000","last_clean":"2020-01-16T05:44:04.953441+0000","last_became_active":"2020-01-16T05:44:04.952727+0000","last_became_peered":"2020-01-16T05:44:04.952727+0000","last_unstale":"2020-01-16T05:44:04.953441+0000","last_undegraded":"2020-01-16T05:44:04.953441+0000","last_fullsized":"2020-01-16T05:44:04.953441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946717+0000","last_change":"2020-01-16T05:44:00.596549+0000","last_active":"2020-01-16T05:44:04.946717+0000","last_peered":"2020-01-16T05:44:04.946717+0000","last_clean":"2020-01-16T05:44:04.946717+0000","last_became_active":"2020-01-16T05:44:00.596161+0000","last_became_peered":"2020-01-16T05:44:00.596161+0000","last_unstale":"2020-01-16T05:44:04.946717+0000","last_undegraded":"2020-01-16T05:44:04.946717+0000","last_fullsized":"2020-01-16T05:44:04.946717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"24'8","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.542801+0000","last_change":"2020-01-16T05:44:03.634762+0000","last_active":"2020-01-16T05:44:06.542801+0000","last_peered":"2020-01-16T05:44:06.542801+0000","last_clean":"2020-01-16T05:44:06.542801+0000","last_became_active":"2020-01-16T05:44:03.634363+0000","last_became_peered":"2020-01-16T05:44:03.634363+0000","last_unstale":"2020-01-16T05:44:06.542801+0000","last_undegraded":"2020-01-16T05:44:06.542801+0000","last_fullsized":"2020-01-16T05:44:06.542801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.947002+0000","last_change":"2020-01-16T05:44:03.945012+0000","last_active":"2020-01-16T05:44:04.947002+0000","last_peered":"2020-01-16T05:44:04.947002+0000","last_clean":"2020-01-16T05:44:04.947002+0000","last_became_active":"2020-01-16T05:44:03.943844+0000","last_became_peered":"2020-01-16T05:44:03.943844+0000","last_unstale":"2020-01-16T05:44:04.947002+0000","last_undegraded":"2020-01-16T05:44:04.947002+0000","last_fullsized":"2020-01-16T05:44:04.947002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.072178+0000","last_change":"2020-01-16T05:44:00.670887+0000","last_active":"2020-01-16T05:44:05.072178+0000","last_peered":"2020-01-16T05:44:05.072178+0000","last_clean":"2020-01-16T05:44:05.072178+0000","last_became_active":"2020-01-16T05:44:00.670249+0000","last_became_peered":"2020-01-16T05:44:00.670249+0000","last_unstale":"2020-01-16T05:44:05.072178+0000","last_undegraded":"2020-01-16T05:44:05.072178+0000","last_fullsized":"2020-01-16T05:44:05.072178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071522+0000","last_change":"2020-01-16T05:44:03.631816+0000","last_active":"2020-01-16T05:44:05.071522+0000","last_peered":"2020-01-16T05:44:05.071522+0000","last_clean":"2020-01-16T05:44:05.071522+0000","last_became_active":"2020-01-16T05:44:03.631369+0000","last_became_peered":"2020-01-16T05:44:03.631369+0000","last_unstale":"2020-01-16T05:44:05.071522+0000","last_undegraded":"2020-01-16T05:44:05.071522+0000","last_fullsized":"2020-01-16T05:44:05.071522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071217+0000","last_change":"2020-01-16T05:44:03.944993+0000","last_active":"2020-01-16T05:44:05.071217+0000","last_peered":"2020-01-16T05:44:05.071217+0000","last_clean":"2020-01-16T05:44:05.071217+0000","last_became_active":"2020-01-16T05:44:03.944613+0000","last_became_peered":"2020-01-16T05:44:03.944613+0000","last_unstale":"2020-01-16T05:44:05.071217+0000","last_undegraded":"2020-01-16T05:44:05.071217+0000","last_fullsized":"2020-01-16T05:44:05.071217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.072173+0000","last_change":"2020-01-16T05:44:00.670906+0000","last_active":"2020-01-16T05:44:05.072173+0000","last_peered":"2020-01-16T05:44:05.072173+0000","last_clean":"2020-01-16T05:44:05.072173+0000","last_became_active":"2020-01-16T05:44:00.670248+0000","last_became_peered":"2020-01-16T05:44:00.670248+0000","last_unstale":"2020-01-16T05:44:05.072173+0000","last_undegraded":"2020-01-16T05:44:05.072173+0000","last_fullsized":"2020-01-16T05:44:05.072173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"24'5","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.538666+0000","last_change":"2020-01-16T05:44:03.631549+0000","last_active":"2020-01-16T05:44:06.538666+0000","last_peered":"2020-01-16T05:44:06.538666+0000","last_clean":"2020-01-16T05:44:06.538666+0000","last_became_active":"2020-01-16T05:44:03.630553+0000","last_became_peered":"2020-01-16T05:44:03.630553+0000","last_unstale":"2020-01-16T05:44:06.538666+0000","last_undegraded":"2020-01-16T05:44:06.538666+0000","last_fullsized":"2020-01-16T05:44:06.538666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.954205+0000","last_change":"2020-01-16T05:44:04.953780+0000","last_active":"2020-01-16T05:44:04.954205+0000","last_peered":"2020-01-16T05:44:04.954205+0000","last_clean":"2020-01-16T05:44:04.954205+0000","last_became_active":"2020-01-16T05:44:04.952922+0000","last_became_peered":"2020-01-16T05:44:04.952922+0000","last_unstale":"2020-01-16T05:44:04.954205+0000","last_undegraded":"2020-01-16T05:44:04.954205+0000","last_fullsized":"2020-01-16T05:44:04.954205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946768+0000","last_change":"2020-01-16T05:44:00.668880+0000","last_active":"2020-01-16T05:44:04.946768+0000","last_peered":"2020-01-16T05:44:04.946768+0000","last_clean":"2020-01-16T05:44:04.946768+0000","last_became_active":"2020-01-16T05:44:00.668292+0000","last_became_peered":"2020-01-16T05:44:00.668292+0000","last_unstale":"2020-01-16T05:44:04.946768+0000","last_undegraded":"2020-01-16T05:44:04.946768+0000","last_fullsized":"2020-01-16T05:44:04.946768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:05.949358+0000","last_change":"2020-01-16T05:44:03.633445+0000","last_active":"2020-01-16T05:44:05.949358+0000","last_peered":"2020-01-16T05:44:05.949358+0000","last_clean":"2020-01-16T05:44:05.949358+0000","last_became_active":"2020-01-16T05:44:03.633080+0000","last_became_peered":"2020-01-16T05:44:03.633080+0000","last_unstale":"2020-01-16T05:44:05.949358+0000","last_undegraded":"2020-01-16T05:44:05.949358+0000","last_fullsized":"2020-01-16T05:44:05.949358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946675+0000","last_change":"2020-01-16T05:44:03.943418+0000","last_active":"2020-01-16T05:44:04.946675+0000","last_peered":"2020-01-16T05:44:04.946675+0000","last_clean":"2020-01-16T05:44:04.946675+0000","last_became_active":"2020-01-16T05:44:03.943039+0000","last_became_peered":"2020-01-16T05:44:03.943039+0000","last_unstale":"2020-01-16T05:44:04.946675+0000","last_undegraded":"2020-01-16T05:44:04.946675+0000","last_fullsized":"2020-01-16T05:44:04.946675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946567+0000","last_change":"2020-01-16T05:44:00.670445+0000","last_active":"2020-01-16T05:44:04.946567+0000","last_peered":"2020-01-16T05:44:04.946567+0000","last_clean":"2020-01-16T05:44:04.946567+0000","last_became_active":"2020-01-16T05:44:00.670082+0000","last_became_peered":"2020-01-16T05:44:00.670082+0000","last_unstale":"2020-01-16T05:44:04.946567+0000","last_undegraded":"2020-01-16T05:44:04.946567+0000","last_fullsized":"2020-01-16T05:44:04.946567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"24'6","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.540786+0000","last_change":"2020-01-16T05:44:03.942740+0000","last_active":"2020-01-16T05:44:06.540786+0000","last_peered":"2020-01-16T05:44:06.540786+0000","last_clean":"2020-01-16T05:44:06.540786+0000","last_became_active":"2020-01-16T05:44:03.942316+0000","last_became_peered":"2020-01-16T05:44:03.942316+0000","last_unstale":"2020-01-16T05:44:06.540786+0000","last_undegraded":"2020-01-16T05:44:06.540786+0000","last_fullsized":"2020-01-16T05:44:06.540786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946887+0000","last_change":"2020-01-16T05:44:03.944413+0000","last_active":"2020-01-16T05:44:04.946887+0000","last_peered":"2020-01-16T05:44:04.946887+0000","last_clean":"2020-01-16T05:44:04.946887+0000","last_became_active":"2020-01-16T05:44:03.943334+0000","last_became_peered":"2020-01-16T05:44:03.943334+0000","last_unstale":"2020-01-16T05:44:04.946887+0000","last_undegraded":"2020-01-16T05:44:04.946887+0000","last_fullsized":"2020-01-16T05:44:04.946887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946988+0000","last_change":"2020-01-16T05:44:00.596442+0000","last_active":"2020-01-16T05:44:04.946988+0000","last_peered":"2020-01-16T05:44:04.946988+0000","last_clean":"2020-01-16T05:44:04.946988+0000","last_became_active":"2020-01-16T05:44:00.596082+0000","last_became_peered":"2020-01-16T05:44:00.596082+0000","last_unstale":"2020-01-16T05:44:04.946988+0000","last_undegraded":"2020-01-16T05:44:04.946988+0000","last_fullsized":"2020-01-16T05:44:04.946988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"24'8","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.902221+0000","last_change":"2020-01-16T05:44:03.945176+0000","last_active":"2020-01-16T05:44:06.902221+0000","last_peered":"2020-01-16T05:44:06.902221+0000","last_clean":"2020-01-16T05:44:06.902221+0000","last_became_active":"2020-01-16T05:44:03.944396+0000","last_became_peered":"2020-01-16T05:44:03.944396+0000","last_unstale":"2020-01-16T05:44:06.902221+0000","last_undegraded":"2020-01-16T05:44:06.902221+0000","last_fullsized":"2020-01-16T05:44:06.902221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":90949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":90257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":90223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":90223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":90789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":91909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":91749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":90257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}]}} 2020-01-16T05:44:18.493 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-01-16T05:44:18.613 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.603+0000 7f5ea5ce4700 1 Processor -- start 2020-01-16T05:44:18.613 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.603+0000 7f5ea5ce4700 1 -- start start 2020-01-16T05:44:18.614 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.603+0000 7f5ea5ce4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ea007ff10 0x7f5ea00abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:18.614 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.603+0000 7f5ea5ce4700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5ea00a4250 0x7f5ea0066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:18.614 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.603+0000 7f5ea5ce4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea0066dd0 con 0x7f5ea00a9b30 2020-01-16T05:44:18.614 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.603+0000 7f5ea5ce4700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea00a4830 con 0x7f5ea00a4250 2020-01-16T05:44:18.614 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.603+0000 7f5ea5ce4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea007f9d0 con 0x7f5ea007ff10 2020-01-16T05:44:18.614 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.603+0000 7f5ea54e3700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5ea00a9b30 0x7f5ea00a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51902/0 (socket says 172.21.15.84:51902) 2020-01-16T05:44:18.614 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea54e3700 1 -- 172.21.15.84:0/2208265404 learned_addr learned my addr 172.21.15.84:0/2208265404 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:18.615 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea4ce2700 1 --2- 172.21.15.84:0/2208265404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ea007ff10 0x7f5ea00abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:18.615 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea6f46700 1 --2- 172.21.15.84:0/2208265404 >> v2:172.21.15.142:3300/0 conn(0x7f5ea00a4250 0x7f5ea0066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:18.615 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5e9ffff700 1 -- 172.21.15.84:0/2208265404 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522559356 0 0) 0x7f5ea0066dd0 con 0x7f5ea00a9b30 2020-01-16T05:44:18.615 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5e9ffff700 1 -- 172.21.15.84:0/2208265404 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e8c003230 con 0x7f5ea00a9b30 2020-01-16T05:44:18.615 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5e9ffff700 1 -- 172.21.15.84:0/2208265404 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4207194423 0 0) 0x7f5e8c003230 con 0x7f5ea00a9b30 2020-01-16T05:44:18.615 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea4ce2700 1 -- 172.21.15.84:0/2208265404 >> v2:172.21.15.142:3300/0 conn(0x7f5ea00a4250 msgr2=0x7f5ea0066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:18.615 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea4ce2700 1 --2- 172.21.15.84:0/2208265404 >> v2:172.21.15.142:3300/0 conn(0x7f5ea00a4250 0x7f5ea0066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:18.616 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea4ce2700 1 -- 172.21.15.84:0/2208265404 >> v1:172.21.15.84:6789/0 conn(0x7f5ea00a9b30 legacy=0x7f5ea00a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.616 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea4ce2700 1 -- 172.21.15.84:0/2208265404 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea0150ce0 con 0x7f5ea007ff10 2020-01-16T05:44:18.616 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea4ce2700 1 --2- 172.21.15.84:0/2208265404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ea007ff10 0x7f5ea00abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5e98008910 tx=0x7f5e880019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.616 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea4ce2700 1 --2- 172.21.15.84:0/2208265404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ea007ff10 0x7f5ea00abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5e98008910 tx=0x7f5e880019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.616 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea4ce2700 1 --2- 172.21.15.84:0/2208265404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ea007ff10 0x7f5ea00abdd0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f5e98008910 tx=0x7f5e880019d0).ready entity=mon.2 client_cookie=6a8d6cc0ab89a6af server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:18.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea4ce2700 1 --2- 172.21.15.84:0/2208265404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ea007ff10 0x7f5ea00abdd0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f5e98008910 tx=0x7f5e880019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5e9ffff700 1 -- 172.21.15.84:0/2208265404 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e88001750 con 0x7f5ea007ff10 2020-01-16T05:44:18.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea4ce2700 1 --2- 172.21.15.84:0/2208265404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ea007ff10 0x7f5ea00abdd0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f5e98008910 tx=0x7f5e880019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea4ce2700 1 --2- 172.21.15.84:0/2208265404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ea007ff10 0x7f5ea00abdd0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f5e98008910 tx=0x7f5e880019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5e9ffff700 1 -- 172.21.15.84:0/2208265404 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e88001560 con 0x7f5ea007ff10 2020-01-16T05:44:18.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5e9ffff700 1 -- 172.21.15.84:0/2208265404 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e98011750 con 0x7f5ea007ff10 2020-01-16T05:44:18.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea5ce4700 1 -- 172.21.15.84:0/2208265404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ea007ff10 msgr2=0x7f5ea00abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea5ce4700 1 --2- 172.21.15.84:0/2208265404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ea007ff10 0x7f5ea00abdd0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f5e98008910 tx=0x7f5e880019d0).stop 2020-01-16T05:44:18.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea5ce4700 1 -- 172.21.15.84:0/2208265404 shutdown_connections 2020-01-16T05:44:18.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea5ce4700 1 --2- 172.21.15.84:0/2208265404 >> v2:172.21.15.142:3300/0 conn(0x7f5ea00a4250 0x7f5ea0066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:18.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea5ce4700 1 --2- 172.21.15.84:0/2208265404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ea007ff10 0x7f5ea00abdd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea5ce4700 1 -- 172.21.15.84:0/2208265404 shutdown_connections 2020-01-16T05:44:18.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea5ce4700 1 -- 172.21.15.84:0/2208265404 wait complete. 2020-01-16T05:44:18.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea5ce4700 1 -- 172.21.15.84:0/2208265404 >> 172.21.15.84:0/2208265404 conn(0x7f5ea00acfc0 msgr2=0x7f5ea00a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:18.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea5ce4700 1 Processor -- start 2020-01-16T05:44:18.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.607+0000 7f5ea5ce4700 1 -- start start 2020-01-16T05:44:18.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea5ce4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5ea0124fb0 0x7f5ea00a8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:18.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea5ce4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea007d3a0 con 0x7f5ea0135d30 2020-01-16T05:44:18.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea5ce4700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea013f020 con 0x7f5ea00251f0 2020-01-16T05:44:18.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea5ce4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea0122c40 con 0x7f5ea0124fb0 2020-01-16T05:44:18.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea54e3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5ea0124fb0 0x7f5ea00a8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:18.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea54e3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5ea0124fb0 0x7f5ea00a8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34710/0 (socket says 172.21.15.84:34710) 2020-01-16T05:44:18.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea6f46700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5ea0135d30 0x7f5ea0136160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51912/0 (socket says 172.21.15.84:51912) 2020-01-16T05:44:18.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea54e3700 1 -- 172.21.15.84:0/1176677767 learned_addr learned my addr 172.21.15.84:0/1176677767 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:18.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea54e3700 1 -- 172.21.15.84:0/1176677767 >> v1:172.21.15.142:6789/0 conn(0x7f5ea00251f0 legacy=0x7f5ea007cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5e9dffb700 1 -- 172.21.15.84:0/1176677767 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997379848 0 0) 0x7f5ea007d3a0 con 0x7f5ea0135d30 2020-01-16T05:44:18.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea54e3700 1 -- 172.21.15.84:0/1176677767 >> v1:172.21.15.84:6789/0 conn(0x7f5ea0135d30 legacy=0x7f5ea0136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea54e3700 1 -- 172.21.15.84:0/1176677767 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea0140260 con 0x7f5ea0124fb0 2020-01-16T05:44:18.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea54e3700 1 --2- 172.21.15.84:0/1176677767 >> v2:172.21.15.84:3300/0 conn(0x7f5ea0124fb0 0x7f5ea00a8a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e88001a50 tx=0x7f5e88010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea54e3700 1 --2- 172.21.15.84:0/1176677767 >> v2:172.21.15.84:3300/0 conn(0x7f5ea0124fb0 0x7f5ea00a8a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e88001a50 tx=0x7f5e88010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea54e3700 1 --2- 172.21.15.84:0/1176677767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea0124fb0 0x7f5ea00a8a70 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7f5e88001a50 tx=0x7f5e88010b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:18.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea54e3700 1 --2- 172.21.15.84:0/1176677767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea0124fb0 0x7f5ea00a8a70 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f5e88001a50 tx=0x7f5e88010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5e9dffb700 1 -- 172.21.15.84:0/1176677767 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e8800cba0 con 0x7f5ea0124fb0 2020-01-16T05:44:18.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea54e3700 1 --2- 172.21.15.84:0/1176677767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea0124fb0 0x7f5ea00a8a70 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f5e88001a50 tx=0x7f5e88010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea54e3700 1 --2- 172.21.15.84:0/1176677767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea0124fb0 0x7f5ea00a8a70 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f5e88001a50 tx=0x7f5e88010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5e9dffb700 1 -- 172.21.15.84:0/1176677767 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e88013060 con 0x7f5ea0124fb0 2020-01-16T05:44:18.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea5ce4700 1 -- 172.21.15.84:0/1176677767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea013f250 con 0x7f5ea0124fb0 2020-01-16T05:44:18.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5e9dffb700 1 -- 172.21.15.84:0/1176677767 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e880047a0 con 0x7f5ea0124fb0 2020-01-16T05:44:18.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea5ce4700 1 -- 172.21.15.84:0/1176677767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea013f660 con 0x7f5ea0124fb0 2020-01-16T05:44:18.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea5ce4700 1 -- 172.21.15.84:0/1176677767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea005e1c0 con 0x7f5ea0124fb0 2020-01-16T05:44:18.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea54e3700 1 --2- 172.21.15.84:0/1176677767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea0124fb0 0x7f5ea00a8a70 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f5e88001a50 tx=0x7f5e88010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5e9dffb700 1 -- 172.21.15.84:0/1176677767 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f5e88004a70 con 0x7f5ea0124fb0 2020-01-16T05:44:18.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.611+0000 7f5ea54e3700 1 --2- 172.21.15.84:0/1176677767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea0124fb0 0x7f5ea00a8a70 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f5e88001a50 tx=0x7f5e88010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.615+0000 7f5e9dffb700 1 --2- 172.21.15.84:0/1176677767 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5e8403c1a0 0x7f5e8403e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:18.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.615+0000 7f5e9dffb700 1 -- 172.21.15.84:0/1176677767 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f5e8804c890 con 0x7f5ea0124fb0 2020-01-16T05:44:18.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.615+0000 7f5ea4ce2700 1 --2- 172.21.15.84:0/1176677767 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5e8403c1a0 0x7f5e8403e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:18.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.615+0000 7f5ea4ce2700 1 --2- 172.21.15.84:0/1176677767 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5e8403c1a0 0x7f5e8403e6b0 crc :-1 s=READY pgs=90 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:18.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.619+0000 7f5ea54e3700 1 --2- 172.21.15.84:0/1176677767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea0124fb0 0x7f5ea00a8a70 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f5e88001a50 tx=0x7f5e88010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.619+0000 7f5e9dffb700 1 -- 172.21.15.84:0/1176677767 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f5e88032eb0 con 0x7f5ea0124fb0 2020-01-16T05:44:18.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.731+0000 7f5ea5ce4700 1 -- 172.21.15.84:0/1176677767 --> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ea005cbc0 con 0x7f5e8403c1a0 2020-01-16T05:44:18.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.735+0000 7f5e9dffb700 1 -- 172.21.15.84:0/1176677767 <== mgr.4104 v2:172.21.15.84:6800/12486 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66284 (crc 0 0 0) 0x7f5ea005cbc0 con 0x7f5e8403c1a0 2020-01-16T05:44:18.736 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:18.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.735+0000 7f5ea5ce4700 1 -- 172.21.15.84:0/1176677767 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5e8403c1a0 msgr2=0x7f5e8403e6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.735+0000 7f5ea5ce4700 1 --2- 172.21.15.84:0/1176677767 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5e8403c1a0 0x7f5e8403e6b0 crc :-1 s=READY pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.735+0000 7f5ea5ce4700 1 -- 172.21.15.84:0/1176677767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea0124fb0 msgr2=0x7f5ea00a8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.735+0000 7f5ea5ce4700 1 --2- 172.21.15.84:0/1176677767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea0124fb0 0x7f5ea00a8a70 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7f5e88001a50 tx=0x7f5e88010b60).stop 2020-01-16T05:44:18.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.735+0000 7f5ea5ce4700 1 -- 172.21.15.84:0/1176677767 shutdown_connections 2020-01-16T05:44:18.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.735+0000 7f5ea5ce4700 1 --2- 172.21.15.84:0/1176677767 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5e8403c1a0 0x7f5e8403e6b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.735+0000 7f5ea5ce4700 1 --2- 172.21.15.84:0/1176677767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea0124fb0 0x7f5ea00a8a70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.735+0000 7f5ea5ce4700 1 -- 172.21.15.84:0/1176677767 shutdown_connections 2020-01-16T05:44:18.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.735+0000 7f5ea5ce4700 1 -- 172.21.15.84:0/1176677767 wait complete. 2020-01-16T05:44:18.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.735+0000 7f5ea5ce4700 1 -- 172.21.15.84:0/1176677767 >> 172.21.15.84:0/1176677767 conn(0x7f5ea00acfc0 msgr2=0x7f5ea0091460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:18.738 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2020-01-16T05:44:18.748 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2020-01-16T05:44:18.476461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390688,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584032,"statfs":{"total":773094113280,"available":764502048768,"internally_reserved":8589934592,"allocated":2064384,"data_stored":726356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":760,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003000"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071093+0000","last_change":"2020-01-16T05:44:03.942686+0000","last_active":"2020-01-16T05:44:05.071093+0000","last_peered":"2020-01-16T05:44:05.071093+0000","last_clean":"2020-01-16T05:44:05.071093+0000","last_became_active":"2020-01-16T05:44:03.942333+0000","last_became_peered":"2020-01-16T05:44:03.942333+0000","last_unstale":"2020-01-16T05:44:05.071093+0000","last_undegraded":"2020-01-16T05:44:05.071093+0000","last_fullsized":"2020-01-16T05:44:05.071093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.949151+0000","last_change":"2020-01-16T05:44:00.598349+0000","last_active":"2020-01-16T05:44:04.949151+0000","last_peered":"2020-01-16T05:44:04.949151+0000","last_clean":"2020-01-16T05:44:04.949151+0000","last_became_active":"2020-01-16T05:44:00.597979+0000","last_became_peered":"2020-01-16T05:44:00.597979+0000","last_unstale":"2020-01-16T05:44:04.949151+0000","last_undegraded":"2020-01-16T05:44:04.949151+0000","last_fullsized":"2020-01-16T05:44:04.949151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'4","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.539081+0000","last_change":"2020-01-16T05:44:03.633337+0000","last_active":"2020-01-16T05:44:06.539081+0000","last_peered":"2020-01-16T05:44:06.539081+0000","last_clean":"2020-01-16T05:44:06.539081+0000","last_became_active":"2020-01-16T05:44:03.632748+0000","last_became_peered":"2020-01-16T05:44:03.632748+0000","last_unstale":"2020-01-16T05:44:06.539081+0000","last_undegraded":"2020-01-16T05:44:06.539081+0000","last_fullsized":"2020-01-16T05:44:06.539081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.953067+0000","last_change":"2020-01-16T05:44:04.952513+0000","last_active":"2020-01-16T05:44:04.953067+0000","last_peered":"2020-01-16T05:44:04.953067+0000","last_clean":"2020-01-16T05:44:04.953067+0000","last_became_active":"2020-01-16T05:44:04.952051+0000","last_became_peered":"2020-01-16T05:44:04.952051+0000","last_unstale":"2020-01-16T05:44:04.953067+0000","last_undegraded":"2020-01-16T05:44:04.953067+0000","last_fullsized":"2020-01-16T05:44:04.953067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071065+0000","last_change":"2020-01-16T05:44:00.597063+0000","last_active":"2020-01-16T05:44:05.071065+0000","last_peered":"2020-01-16T05:44:05.071065+0000","last_clean":"2020-01-16T05:44:05.071065+0000","last_became_active":"2020-01-16T05:44:00.596565+0000","last_became_peered":"2020-01-16T05:44:00.596565+0000","last_unstale":"2020-01-16T05:44:05.071065+0000","last_undegraded":"2020-01-16T05:44:05.071065+0000","last_fullsized":"2020-01-16T05:44:05.071065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'7","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.542445+0000","last_change":"2020-01-16T05:44:03.632507+0000","last_active":"2020-01-16T05:44:06.542445+0000","last_peered":"2020-01-16T05:44:06.542445+0000","last_clean":"2020-01-16T05:44:06.542445+0000","last_became_active":"2020-01-16T05:44:03.632098+0000","last_became_peered":"2020-01-16T05:44:03.632098+0000","last_unstale":"2020-01-16T05:44:06.542445+0000","last_undegraded":"2020-01-16T05:44:06.542445+0000","last_fullsized":"2020-01-16T05:44:06.542445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.953441+0000","last_change":"2020-01-16T05:44:04.953106+0000","last_active":"2020-01-16T05:44:04.953441+0000","last_peered":"2020-01-16T05:44:04.953441+0000","last_clean":"2020-01-16T05:44:04.953441+0000","last_became_active":"2020-01-16T05:44:04.952727+0000","last_became_peered":"2020-01-16T05:44:04.952727+0000","last_unstale":"2020-01-16T05:44:04.953441+0000","last_undegraded":"2020-01-16T05:44:04.953441+0000","last_fullsized":"2020-01-16T05:44:04.953441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946717+0000","last_change":"2020-01-16T05:44:00.596549+0000","last_active":"2020-01-16T05:44:04.946717+0000","last_peered":"2020-01-16T05:44:04.946717+0000","last_clean":"2020-01-16T05:44:04.946717+0000","last_became_active":"2020-01-16T05:44:00.596161+0000","last_became_peered":"2020-01-16T05:44:00.596161+0000","last_unstale":"2020-01-16T05:44:04.946717+0000","last_undegraded":"2020-01-16T05:44:04.946717+0000","last_fullsized":"2020-01-16T05:44:04.946717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"24'8","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.542801+0000","last_change":"2020-01-16T05:44:03.634762+0000","last_active":"2020-01-16T05:44:06.542801+0000","last_peered":"2020-01-16T05:44:06.542801+0000","last_clean":"2020-01-16T05:44:06.542801+0000","last_became_active":"2020-01-16T05:44:03.634363+0000","last_became_peered":"2020-01-16T05:44:03.634363+0000","last_unstale":"2020-01-16T05:44:06.542801+0000","last_undegraded":"2020-01-16T05:44:06.542801+0000","last_fullsized":"2020-01-16T05:44:06.542801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.947002+0000","last_change":"2020-01-16T05:44:03.945012+0000","last_active":"2020-01-16T05:44:04.947002+0000","last_peered":"2020-01-16T05:44:04.947002+0000","last_clean":"2020-01-16T05:44:04.947002+0000","last_became_active":"2020-01-16T05:44:03.943844+0000","last_became_peered":"2020-01-16T05:44:03.943844+0000","last_unstale":"2020-01-16T05:44:04.947002+0000","last_undegraded":"2020-01-16T05:44:04.947002+0000","last_fullsized":"2020-01-16T05:44:04.947002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.072178+0000","last_change":"2020-01-16T05:44:00.670887+0000","last_active":"2020-01-16T05:44:05.072178+0000","last_peered":"2020-01-16T05:44:05.072178+0000","last_clean":"2020-01-16T05:44:05.072178+0000","last_became_active":"2020-01-16T05:44:00.670249+0000","last_became_peered":"2020-01-16T05:44:00.670249+0000","last_unstale":"2020-01-16T05:44:05.072178+0000","last_undegraded":"2020-01-16T05:44:05.072178+0000","last_fullsized":"2020-01-16T05:44:05.072178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071522+0000","last_change":"2020-01-16T05:44:03.631816+0000","last_active":"2020-01-16T05:44:05.071522+0000","last_peered":"2020-01-16T05:44:05.071522+0000","last_clean":"2020-01-16T05:44:05.071522+0000","last_became_active":"2020-01-16T05:44:03.631369+0000","last_became_peered":"2020-01-16T05:44:03.631369+0000","last_unstale":"2020-01-16T05:44:05.071522+0000","last_undegraded":"2020-01-16T05:44:05.071522+0000","last_fullsized":"2020-01-16T05:44:05.071522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071217+0000","last_change":"2020-01-16T05:44:03.944993+0000","last_active":"2020-01-16T05:44:05.071217+0000","last_peered":"2020-01-16T05:44:05.071217+0000","last_clean":"2020-01-16T05:44:05.071217+0000","last_became_active":"2020-01-16T05:44:03.944613+0000","last_became_peered":"2020-01-16T05:44:03.944613+0000","last_unstale":"2020-01-16T05:44:05.071217+0000","last_undegraded":"2020-01-16T05:44:05.071217+0000","last_fullsized":"2020-01-16T05:44:05.071217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.072173+0000","last_change":"2020-01-16T05:44:00.670906+0000","last_active":"2020-01-16T05:44:05.072173+0000","last_peered":"2020-01-16T05:44:05.072173+0000","last_clean":"2020-01-16T05:44:05.072173+0000","last_became_active":"2020-01-16T05:44:00.670248+0000","last_became_peered":"2020-01-16T05:44:00.670248+0000","last_unstale":"2020-01-16T05:44:05.072173+0000","last_undegraded":"2020-01-16T05:44:05.072173+0000","last_fullsized":"2020-01-16T05:44:05.072173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"24'5","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.538666+0000","last_change":"2020-01-16T05:44:03.631549+0000","last_active":"2020-01-16T05:44:06.538666+0000","last_peered":"2020-01-16T05:44:06.538666+0000","last_clean":"2020-01-16T05:44:06.538666+0000","last_became_active":"2020-01-16T05:44:03.630553+0000","last_became_peered":"2020-01-16T05:44:03.630553+0000","last_unstale":"2020-01-16T05:44:06.538666+0000","last_undegraded":"2020-01-16T05:44:06.538666+0000","last_fullsized":"2020-01-16T05:44:06.538666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.954205+0000","last_change":"2020-01-16T05:44:04.953780+0000","last_active":"2020-01-16T05:44:04.954205+0000","last_peered":"2020-01-16T05:44:04.954205+0000","last_clean":"2020-01-16T05:44:04.954205+0000","last_became_active":"2020-01-16T05:44:04.952922+0000","last_became_peered":"2020-01-16T05:44:04.952922+0000","last_unstale":"2020-01-16T05:44:04.954205+0000","last_undegraded":"2020-01-16T05:44:04.954205+0000","last_fullsized":"2020-01-16T05:44:04.954205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946768+0000","last_change":"2020-01-16T05:44:00.668880+0000","last_active":"2020-01-16T05:44:04.946768+0000","last_peered":"2020-01-16T05:44:04.946768+0000","last_clean":"2020-01-16T05:44:04.946768+0000","last_became_active":"2020-01-16T05:44:00.668292+0000","last_became_peered":"2020-01-16T05:44:00.668292+0000","last_unstale":"2020-01-16T05:44:04.946768+0000","last_undegraded":"2020-01-16T05:44:04.946768+0000","last_fullsized":"2020-01-16T05:44:04.946768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:05.949358+0000","last_change":"2020-01-16T05:44:03.633445+0000","last_active":"2020-01-16T05:44:05.949358+0000","last_peered":"2020-01-16T05:44:05.949358+0000","last_clean":"2020-01-16T05:44:05.949358+0000","last_became_active":"2020-01-16T05:44:03.633080+0000","last_became_peered":"2020-01-16T05:44:03.633080+0000","last_unstale":"2020-01-16T05:44:05.949358+0000","last_undegraded":"2020-01-16T05:44:05.949358+0000","last_fullsized":"2020-01-16T05:44:05.949358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946675+0000","last_change":"2020-01-16T05:44:03.943418+0000","last_active":"2020-01-16T05:44:04.946675+0000","last_peered":"2020-01-16T05:44:04.946675+0000","last_clean":"2020-01-16T05:44:04.946675+0000","last_became_active":"2020-01-16T05:44:03.943039+0000","last_became_peered":"2020-01-16T05:44:03.943039+0000","last_unstale":"2020-01-16T05:44:04.946675+0000","last_undegraded":"2020-01-16T05:44:04.946675+0000","last_fullsized":"2020-01-16T05:44:04.946675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946567+0000","last_change":"2020-01-16T05:44:00.670445+0000","last_active":"2020-01-16T05:44:04.946567+0000","last_peered":"2020-01-16T05:44:04.946567+0000","last_clean":"2020-01-16T05:44:04.946567+0000","last_became_active":"2020-01-16T05:44:00.670082+0000","last_became_peered":"2020-01-16T05:44:00.670082+0000","last_unstale":"2020-01-16T05:44:04.946567+0000","last_undegraded":"2020-01-16T05:44:04.946567+0000","last_fullsized":"2020-01-16T05:44:04.946567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"24'6","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.540786+0000","last_change":"2020-01-16T05:44:03.942740+0000","last_active":"2020-01-16T05:44:06.540786+0000","last_peered":"2020-01-16T05:44:06.540786+0000","last_clean":"2020-01-16T05:44:06.540786+0000","last_became_active":"2020-01-16T05:44:03.942316+0000","last_became_peered":"2020-01-16T05:44:03.942316+0000","last_unstale":"2020-01-16T05:44:06.540786+0000","last_undegraded":"2020-01-16T05:44:06.540786+0000","last_fullsized":"2020-01-16T05:44:06.540786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946887+0000","last_change":"2020-01-16T05:44:03.944413+0000","last_active":"2020-01-16T05:44:04.946887+0000","last_peered":"2020-01-16T05:44:04.946887+0000","last_clean":"2020-01-16T05:44:04.946887+0000","last_became_active":"2020-01-16T05:44:03.943334+0000","last_became_peered":"2020-01-16T05:44:03.943334+0000","last_unstale":"2020-01-16T05:44:04.946887+0000","last_undegraded":"2020-01-16T05:44:04.946887+0000","last_fullsized":"2020-01-16T05:44:04.946887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946988+0000","last_change":"2020-01-16T05:44:00.596442+0000","last_active":"2020-01-16T05:44:04.946988+0000","last_peered":"2020-01-16T05:44:04.946988+0000","last_clean":"2020-01-16T05:44:04.946988+0000","last_became_active":"2020-01-16T05:44:00.596082+0000","last_became_peered":"2020-01-16T05:44:00.596082+0000","last_unstale":"2020-01-16T05:44:04.946988+0000","last_undegraded":"2020-01-16T05:44:04.946988+0000","last_fullsized":"2020-01-16T05:44:04.946988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"24'8","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.902221+0000","last_change":"2020-01-16T05:44:03.945176+0000","last_active":"2020-01-16T05:44:06.902221+0000","last_peered":"2020-01-16T05:44:06.902221+0000","last_clean":"2020-01-16T05:44:06.902221+0000","last_became_active":"2020-01-16T05:44:03.944396+0000","last_became_peered":"2020-01-16T05:44:03.944396+0000","last_unstale":"2020-01-16T05:44:06.902221+0000","last_undegraded":"2020-01-16T05:44:06.902221+0000","last_fullsized":"2020-01-16T05:44:06.902221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":90949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":90257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":90223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":90223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":90789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":91909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":91749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":90257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}]}} 2020-01-16T05:44:18.753 INFO:tasks.mds_thrash.ceph_manager:clean! 2020-01-16T05:44:18.753 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-01-16T05:44:18.868 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7decce1700 1 Processor -- start 2020-01-16T05:44:18.868 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7decce1700 1 -- start start 2020-01-16T05:44:18.868 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7decce1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7de80a9b30 0x7f7de80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:18.868 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7decce1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de8066880 con 0x7f7de80a4250 2020-01-16T05:44:18.869 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7decce1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de8066ab0 con 0x7f7de807ff10 2020-01-16T05:44:18.869 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7decce1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de80a4830 con 0x7f7de80a9b30 2020-01-16T05:44:18.869 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7de7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7de80a9b30 0x7f7de80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:18.869 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7dedf43700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7de80a4250 0x7f7de814fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51918/0 (socket says 172.21.15.84:51918) 2020-01-16T05:44:18.869 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7de7fff700 1 --2- 172.21.15.84:0/1445792407 >> v2:172.21.15.84:3300/0 conn(0x7f7de80a9b30 0x7f7de80abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34716/0 (socket says 172.21.15.84:34716) 2020-01-16T05:44:18.870 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7dedf43700 1 -- 172.21.15.84:0/1445792407 learned_addr learned my addr 172.21.15.84:0/1445792407 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:18.870 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7de7fff700 1 -- 172.21.15.84:0/1445792407 >> v1:172.21.15.142:6789/0 conn(0x7f7de807ff10 legacy=0x7f7de80a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.870 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7de7fff700 1 -- 172.21.15.84:0/1445792407 >> v1:172.21.15.84:6789/0 conn(0x7f7de80a4250 legacy=0x7f7de814fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.870 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7de6ffd700 1 -- 172.21.15.84:0/1445792407 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901429396 0 0) 0x7f7de8066880 con 0x7f7de80a4250 2020-01-16T05:44:18.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7de7fff700 1 -- 172.21.15.84:0/1445792407 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de8066ce0 con 0x7f7de80a9b30 2020-01-16T05:44:18.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7de7fff700 1 --2- 172.21.15.84:0/1445792407 >> v2:172.21.15.84:3300/0 conn(0x7f7de80a9b30 0x7f7de80abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7dd0008c90 tx=0x7f7dd00100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7de7fff700 1 --2- 172.21.15.84:0/1445792407 >> v2:172.21.15.84:3300/0 conn(0x7f7de80a9b30 0x7f7de80abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7dd0008c90 tx=0x7f7dd00100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7de7fff700 1 --2- 172.21.15.84:0/1445792407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de80a9b30 0x7f7de80abdd0 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f7dd0008c90 tx=0x7f7dd00100f0).ready entity=mon.0 client_cookie=d4990033bf581598 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:18.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7de7fff700 1 --2- 172.21.15.84:0/1445792407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de80a9b30 0x7f7de80abdd0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f7dd0008c90 tx=0x7f7dd00100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7de6ffd700 1 -- 172.21.15.84:0/1445792407 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dd000a160 con 0x7f7de80a9b30 2020-01-16T05:44:18.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7de7fff700 1 --2- 172.21.15.84:0/1445792407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de80a9b30 0x7f7de80abdd0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f7dd0008c90 tx=0x7f7dd00100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7de6ffd700 1 -- 172.21.15.84:0/1445792407 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd0011b60 con 0x7f7de80a9b30 2020-01-16T05:44:18.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7de7fff700 1 --2- 172.21.15.84:0/1445792407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de80a9b30 0x7f7de80abdd0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f7dd0008c90 tx=0x7f7dd00100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7de6ffd700 1 -- 172.21.15.84:0/1445792407 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dd000a740 con 0x7f7de80a9b30 2020-01-16T05:44:18.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7decce1700 1 -- 172.21.15.84:0/1445792407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de80a9b30 msgr2=0x7f7de80abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.863+0000 7f7decce1700 1 --2- 172.21.15.84:0/1445792407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de80a9b30 0x7f7de80abdd0 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f7dd0008c90 tx=0x7f7dd00100f0).stop 2020-01-16T05:44:18.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7decce1700 1 -- 172.21.15.84:0/1445792407 shutdown_connections 2020-01-16T05:44:18.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7decce1700 1 --2- 172.21.15.84:0/1445792407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de80a9b30 0x7f7de80abdd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7decce1700 1 -- 172.21.15.84:0/1445792407 shutdown_connections 2020-01-16T05:44:18.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7decce1700 1 -- 172.21.15.84:0/1445792407 wait complete. 2020-01-16T05:44:18.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7decce1700 1 -- 172.21.15.84:0/1445792407 >> 172.21.15.84:0/1445792407 conn(0x7f7de80acfc0 msgr2=0x7f7de80a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:18.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7decce1700 1 Processor -- start 2020-01-16T05:44:18.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7decce1700 1 -- start start 2020-01-16T05:44:18.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7decce1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7de805bef0 0x7f7de808efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:18.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7decce1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7de808f500 0x7f7de80a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:18.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7decce1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de80a3480 con 0x7f7de80a5870 2020-01-16T05:44:18.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7decce1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de8129c20 con 0x7f7de808f500 2020-01-16T05:44:18.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7decce1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de8091b30 con 0x7f7de805bef0 2020-01-16T05:44:18.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7de77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7de808f500 0x7f7de80a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:18.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7de77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7de808f500 0x7f7de80a5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34720/0 (socket says 172.21.15.84:34720) 2020-01-16T05:44:18.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7de77fe700 1 -- 172.21.15.84:0/2066554428 learned_addr learned my addr 172.21.15.84:0/2066554428 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:18.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7de7fff700 1 --2- 172.21.15.84:0/2066554428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7de805bef0 0x7f7de808efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:18.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7de77fe700 1 -- 172.21.15.84:0/2066554428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7de805bef0 msgr2=0x7f7de808efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7de77fe700 1 --2- 172.21.15.84:0/2066554428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7de805bef0 0x7f7de808efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7de77fe700 1 -- 172.21.15.84:0/2066554428 >> v1:172.21.15.142:6789/0 conn(0x7f7de80a5870 legacy=0x7f7de8139220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7de77fe700 1 -- 172.21.15.84:0/2066554428 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de81296b0 con 0x7f7de808f500 2020-01-16T05:44:18.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7de77fe700 1 --2- 172.21.15.84:0/2066554428 >> v2:172.21.15.84:3300/0 conn(0x7f7de808f500 0x7f7de80a5320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7de80a36b0 tx=0x7f7dd8010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7de77fe700 1 --2- 172.21.15.84:0/2066554428 >> v2:172.21.15.84:3300/0 conn(0x7f7de808f500 0x7f7de80a5320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7de80a36b0 tx=0x7f7dd8010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7de77fe700 1 --2- 172.21.15.84:0/2066554428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de808f500 0x7f7de80a5320 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7f7de80a36b0 tx=0x7f7dd8010b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:18.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7de77fe700 1 --2- 172.21.15.84:0/2066554428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de808f500 0x7f7de80a5320 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f7de80a36b0 tx=0x7f7dd8010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.884 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7de77fe700 1 --2- 172.21.15.84:0/2066554428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de808f500 0x7f7de80a5320 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f7de80a36b0 tx=0x7f7dd8010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.884 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7de4ff9700 1 -- 172.21.15.84:0/2066554428 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dd800cc20 con 0x7f7de808f500 2020-01-16T05:44:18.884 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7de77fe700 1 --2- 172.21.15.84:0/2066554428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de808f500 0x7f7de80a5320 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f7de80a36b0 tx=0x7f7dd8010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.884 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7de4ff9700 1 -- 172.21.15.84:0/2066554428 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd800c840 con 0x7f7de808f500 2020-01-16T05:44:18.884 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7de4ff9700 1 -- 172.21.15.84:0/2066554428 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dd8012540 con 0x7f7de808f500 2020-01-16T05:44:18.885 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7decce1700 1 -- 172.21.15.84:0/2066554428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de8090740 con 0x7f7de808f500 2020-01-16T05:44:18.885 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.867+0000 7f7decce1700 1 -- 172.21.15.84:0/2066554428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de8128830 con 0x7f7de808f500 2020-01-16T05:44:18.885 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.871+0000 7f7de77fe700 1 --2- 172.21.15.84:0/2066554428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de808f500 0x7f7de80a5320 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f7de80a36b0 tx=0x7f7dd8010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.885 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.871+0000 7f7decce1700 1 -- 172.21.15.84:0/2066554428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de805e1c0 con 0x7f7de808f500 2020-01-16T05:44:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.871+0000 7f7de4ff9700 1 -- 172.21.15.84:0/2066554428 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f7dd8012850 con 0x7f7de808f500 2020-01-16T05:44:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.871+0000 7f7de77fe700 1 --2- 172.21.15.84:0/2066554428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de808f500 0x7f7de80a5320 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f7de80a36b0 tx=0x7f7dd8010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.871+0000 7f7de4ff9700 1 --2- 172.21.15.84:0/2066554428 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7dc003c2f0 0x7f7dc003e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.871+0000 7f7de4ff9700 1 -- 172.21.15.84:0/2066554428 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f7dd804c810 con 0x7f7de808f500 2020-01-16T05:44:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.871+0000 7f7de7fff700 1 --2- 172.21.15.84:0/2066554428 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7dc003c2f0 0x7f7dc003e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.871+0000 7f7de7fff700 1 --2- 172.21.15.84:0/2066554428 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7dc003c2f0 0x7f7dc003e800 crc :-1 s=READY pgs=91 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:18.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.875+0000 7f7de77fe700 1 --2- 172.21.15.84:0/2066554428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de808f500 0x7f7de80a5320 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f7de80a36b0 tx=0x7f7dd8010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:18.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.875+0000 7f7de4ff9700 1 -- 172.21.15.84:0/2066554428 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f7dd8030350 con 0x7f7de808f500 2020-01-16T05:44:18.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.983+0000 7f7decce1700 1 -- 172.21.15.84:0/2066554428 --> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7de8091900 con 0x7f7dc003c2f0 2020-01-16T05:44:18.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.987+0000 7f7de4ff9700 1 -- 172.21.15.84:0/2066554428 <== mgr.4104 v2:172.21.15.84:6800/12486 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66284 (crc 0 0 0) 0x7f7de8091900 con 0x7f7dc003c2f0 2020-01-16T05:44:18.991 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:18.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.987+0000 7f7decce1700 1 -- 172.21.15.84:0/2066554428 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7dc003c2f0 msgr2=0x7f7dc003e800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.987+0000 7f7decce1700 1 --2- 172.21.15.84:0/2066554428 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7dc003c2f0 0x7f7dc003e800 crc :-1 s=READY pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.987+0000 7f7decce1700 1 -- 172.21.15.84:0/2066554428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de808f500 msgr2=0x7f7de80a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:18.993 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.987+0000 7f7decce1700 1 --2- 172.21.15.84:0/2066554428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de808f500 0x7f7de80a5320 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7f7de80a36b0 tx=0x7f7dd8010b20).stop 2020-01-16T05:44:18.993 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.987+0000 7f7decce1700 1 -- 172.21.15.84:0/2066554428 shutdown_connections 2020-01-16T05:44:18.993 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.987+0000 7f7decce1700 1 --2- 172.21.15.84:0/2066554428 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7dc003c2f0 0x7f7dc003e800 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.993 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.987+0000 7f7decce1700 1 --2- 172.21.15.84:0/2066554428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7de805bef0 0x7f7de808efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.993 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.987+0000 7f7decce1700 1 --2- 172.21.15.84:0/2066554428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de808f500 0x7f7de80a5320 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:18.994 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.987+0000 7f7decce1700 1 -- 172.21.15.84:0/2066554428 shutdown_connections 2020-01-16T05:44:18.994 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.987+0000 7f7decce1700 1 -- 172.21.15.84:0/2066554428 wait complete. 2020-01-16T05:44:18.994 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:18.987+0000 7f7decce1700 1 -- 172.21.15.84:0/2066554428 >> 172.21.15.84:0/2066554428 conn(0x7f7de80a9b30 msgr2=0x7f7de80246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:18.994 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2020-01-16T05:44:19.001 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2020-01-16T05:44:18.476461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390688,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584032,"statfs":{"total":773094113280,"available":764502048768,"internally_reserved":8589934592,"allocated":2064384,"data_stored":726356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":760,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003000"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071093+0000","last_change":"2020-01-16T05:44:03.942686+0000","last_active":"2020-01-16T05:44:05.071093+0000","last_peered":"2020-01-16T05:44:05.071093+0000","last_clean":"2020-01-16T05:44:05.071093+0000","last_became_active":"2020-01-16T05:44:03.942333+0000","last_became_peered":"2020-01-16T05:44:03.942333+0000","last_unstale":"2020-01-16T05:44:05.071093+0000","last_undegraded":"2020-01-16T05:44:05.071093+0000","last_fullsized":"2020-01-16T05:44:05.071093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.949151+0000","last_change":"2020-01-16T05:44:00.598349+0000","last_active":"2020-01-16T05:44:04.949151+0000","last_peered":"2020-01-16T05:44:04.949151+0000","last_clean":"2020-01-16T05:44:04.949151+0000","last_became_active":"2020-01-16T05:44:00.597979+0000","last_became_peered":"2020-01-16T05:44:00.597979+0000","last_unstale":"2020-01-16T05:44:04.949151+0000","last_undegraded":"2020-01-16T05:44:04.949151+0000","last_fullsized":"2020-01-16T05:44:04.949151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'4","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.539081+0000","last_change":"2020-01-16T05:44:03.633337+0000","last_active":"2020-01-16T05:44:06.539081+0000","last_peered":"2020-01-16T05:44:06.539081+0000","last_clean":"2020-01-16T05:44:06.539081+0000","last_became_active":"2020-01-16T05:44:03.632748+0000","last_became_peered":"2020-01-16T05:44:03.632748+0000","last_unstale":"2020-01-16T05:44:06.539081+0000","last_undegraded":"2020-01-16T05:44:06.539081+0000","last_fullsized":"2020-01-16T05:44:06.539081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.953067+0000","last_change":"2020-01-16T05:44:04.952513+0000","last_active":"2020-01-16T05:44:04.953067+0000","last_peered":"2020-01-16T05:44:04.953067+0000","last_clean":"2020-01-16T05:44:04.953067+0000","last_became_active":"2020-01-16T05:44:04.952051+0000","last_became_peered":"2020-01-16T05:44:04.952051+0000","last_unstale":"2020-01-16T05:44:04.953067+0000","last_undegraded":"2020-01-16T05:44:04.953067+0000","last_fullsized":"2020-01-16T05:44:04.953067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071065+0000","last_change":"2020-01-16T05:44:00.597063+0000","last_active":"2020-01-16T05:44:05.071065+0000","last_peered":"2020-01-16T05:44:05.071065+0000","last_clean":"2020-01-16T05:44:05.071065+0000","last_became_active":"2020-01-16T05:44:00.596565+0000","last_became_peered":"2020-01-16T05:44:00.596565+0000","last_unstale":"2020-01-16T05:44:05.071065+0000","last_undegraded":"2020-01-16T05:44:05.071065+0000","last_fullsized":"2020-01-16T05:44:05.071065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'7","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.542445+0000","last_change":"2020-01-16T05:44:03.632507+0000","last_active":"2020-01-16T05:44:06.542445+0000","last_peered":"2020-01-16T05:44:06.542445+0000","last_clean":"2020-01-16T05:44:06.542445+0000","last_became_active":"2020-01-16T05:44:03.632098+0000","last_became_peered":"2020-01-16T05:44:03.632098+0000","last_unstale":"2020-01-16T05:44:06.542445+0000","last_undegraded":"2020-01-16T05:44:06.542445+0000","last_fullsized":"2020-01-16T05:44:06.542445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.953441+0000","last_change":"2020-01-16T05:44:04.953106+0000","last_active":"2020-01-16T05:44:04.953441+0000","last_peered":"2020-01-16T05:44:04.953441+0000","last_clean":"2020-01-16T05:44:04.953441+0000","last_became_active":"2020-01-16T05:44:04.952727+0000","last_became_peered":"2020-01-16T05:44:04.952727+0000","last_unstale":"2020-01-16T05:44:04.953441+0000","last_undegraded":"2020-01-16T05:44:04.953441+0000","last_fullsized":"2020-01-16T05:44:04.953441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946717+0000","last_change":"2020-01-16T05:44:00.596549+0000","last_active":"2020-01-16T05:44:04.946717+0000","last_peered":"2020-01-16T05:44:04.946717+0000","last_clean":"2020-01-16T05:44:04.946717+0000","last_became_active":"2020-01-16T05:44:00.596161+0000","last_became_peered":"2020-01-16T05:44:00.596161+0000","last_unstale":"2020-01-16T05:44:04.946717+0000","last_undegraded":"2020-01-16T05:44:04.946717+0000","last_fullsized":"2020-01-16T05:44:04.946717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"24'8","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.542801+0000","last_change":"2020-01-16T05:44:03.634762+0000","last_active":"2020-01-16T05:44:06.542801+0000","last_peered":"2020-01-16T05:44:06.542801+0000","last_clean":"2020-01-16T05:44:06.542801+0000","last_became_active":"2020-01-16T05:44:03.634363+0000","last_became_peered":"2020-01-16T05:44:03.634363+0000","last_unstale":"2020-01-16T05:44:06.542801+0000","last_undegraded":"2020-01-16T05:44:06.542801+0000","last_fullsized":"2020-01-16T05:44:06.542801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.947002+0000","last_change":"2020-01-16T05:44:03.945012+0000","last_active":"2020-01-16T05:44:04.947002+0000","last_peered":"2020-01-16T05:44:04.947002+0000","last_clean":"2020-01-16T05:44:04.947002+0000","last_became_active":"2020-01-16T05:44:03.943844+0000","last_became_peered":"2020-01-16T05:44:03.943844+0000","last_unstale":"2020-01-16T05:44:04.947002+0000","last_undegraded":"2020-01-16T05:44:04.947002+0000","last_fullsized":"2020-01-16T05:44:04.947002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.072178+0000","last_change":"2020-01-16T05:44:00.670887+0000","last_active":"2020-01-16T05:44:05.072178+0000","last_peered":"2020-01-16T05:44:05.072178+0000","last_clean":"2020-01-16T05:44:05.072178+0000","last_became_active":"2020-01-16T05:44:00.670249+0000","last_became_peered":"2020-01-16T05:44:00.670249+0000","last_unstale":"2020-01-16T05:44:05.072178+0000","last_undegraded":"2020-01-16T05:44:05.072178+0000","last_fullsized":"2020-01-16T05:44:05.072178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071522+0000","last_change":"2020-01-16T05:44:03.631816+0000","last_active":"2020-01-16T05:44:05.071522+0000","last_peered":"2020-01-16T05:44:05.071522+0000","last_clean":"2020-01-16T05:44:05.071522+0000","last_became_active":"2020-01-16T05:44:03.631369+0000","last_became_peered":"2020-01-16T05:44:03.631369+0000","last_unstale":"2020-01-16T05:44:05.071522+0000","last_undegraded":"2020-01-16T05:44:05.071522+0000","last_fullsized":"2020-01-16T05:44:05.071522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.071217+0000","last_change":"2020-01-16T05:44:03.944993+0000","last_active":"2020-01-16T05:44:05.071217+0000","last_peered":"2020-01-16T05:44:05.071217+0000","last_clean":"2020-01-16T05:44:05.071217+0000","last_became_active":"2020-01-16T05:44:03.944613+0000","last_became_peered":"2020-01-16T05:44:03.944613+0000","last_unstale":"2020-01-16T05:44:05.071217+0000","last_undegraded":"2020-01-16T05:44:05.071217+0000","last_fullsized":"2020-01-16T05:44:05.071217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:05.072173+0000","last_change":"2020-01-16T05:44:00.670906+0000","last_active":"2020-01-16T05:44:05.072173+0000","last_peered":"2020-01-16T05:44:05.072173+0000","last_clean":"2020-01-16T05:44:05.072173+0000","last_became_active":"2020-01-16T05:44:00.670248+0000","last_became_peered":"2020-01-16T05:44:00.670248+0000","last_unstale":"2020-01-16T05:44:05.072173+0000","last_undegraded":"2020-01-16T05:44:05.072173+0000","last_fullsized":"2020-01-16T05:44:05.072173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"24'5","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.538666+0000","last_change":"2020-01-16T05:44:03.631549+0000","last_active":"2020-01-16T05:44:06.538666+0000","last_peered":"2020-01-16T05:44:06.538666+0000","last_clean":"2020-01-16T05:44:06.538666+0000","last_became_active":"2020-01-16T05:44:03.630553+0000","last_became_peered":"2020-01-16T05:44:03.630553+0000","last_unstale":"2020-01-16T05:44:06.538666+0000","last_undegraded":"2020-01-16T05:44:06.538666+0000","last_fullsized":"2020-01-16T05:44:06.538666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.954205+0000","last_change":"2020-01-16T05:44:04.953780+0000","last_active":"2020-01-16T05:44:04.954205+0000","last_peered":"2020-01-16T05:44:04.954205+0000","last_clean":"2020-01-16T05:44:04.954205+0000","last_became_active":"2020-01-16T05:44:04.952922+0000","last_became_peered":"2020-01-16T05:44:04.952922+0000","last_unstale":"2020-01-16T05:44:04.954205+0000","last_undegraded":"2020-01-16T05:44:04.954205+0000","last_fullsized":"2020-01-16T05:44:04.954205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946768+0000","last_change":"2020-01-16T05:44:00.668880+0000","last_active":"2020-01-16T05:44:04.946768+0000","last_peered":"2020-01-16T05:44:04.946768+0000","last_clean":"2020-01-16T05:44:04.946768+0000","last_became_active":"2020-01-16T05:44:00.668292+0000","last_became_peered":"2020-01-16T05:44:00.668292+0000","last_unstale":"2020-01-16T05:44:04.946768+0000","last_undegraded":"2020-01-16T05:44:04.946768+0000","last_fullsized":"2020-01-16T05:44:04.946768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:05.949358+0000","last_change":"2020-01-16T05:44:03.633445+0000","last_active":"2020-01-16T05:44:05.949358+0000","last_peered":"2020-01-16T05:44:05.949358+0000","last_clean":"2020-01-16T05:44:05.949358+0000","last_became_active":"2020-01-16T05:44:03.633080+0000","last_became_peered":"2020-01-16T05:44:03.633080+0000","last_unstale":"2020-01-16T05:44:05.949358+0000","last_undegraded":"2020-01-16T05:44:05.949358+0000","last_fullsized":"2020-01-16T05:44:05.949358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946675+0000","last_change":"2020-01-16T05:44:03.943418+0000","last_active":"2020-01-16T05:44:04.946675+0000","last_peered":"2020-01-16T05:44:04.946675+0000","last_clean":"2020-01-16T05:44:04.946675+0000","last_became_active":"2020-01-16T05:44:03.943039+0000","last_became_peered":"2020-01-16T05:44:03.943039+0000","last_unstale":"2020-01-16T05:44:04.946675+0000","last_undegraded":"2020-01-16T05:44:04.946675+0000","last_fullsized":"2020-01-16T05:44:04.946675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946567+0000","last_change":"2020-01-16T05:44:00.670445+0000","last_active":"2020-01-16T05:44:04.946567+0000","last_peered":"2020-01-16T05:44:04.946567+0000","last_clean":"2020-01-16T05:44:04.946567+0000","last_became_active":"2020-01-16T05:44:00.670082+0000","last_became_peered":"2020-01-16T05:44:00.670082+0000","last_unstale":"2020-01-16T05:44:04.946567+0000","last_undegraded":"2020-01-16T05:44:04.946567+0000","last_fullsized":"2020-01-16T05:44:04.946567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"24'6","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.540786+0000","last_change":"2020-01-16T05:44:03.942740+0000","last_active":"2020-01-16T05:44:06.540786+0000","last_peered":"2020-01-16T05:44:06.540786+0000","last_clean":"2020-01-16T05:44:06.540786+0000","last_became_active":"2020-01-16T05:44:03.942316+0000","last_became_peered":"2020-01-16T05:44:03.942316+0000","last_unstale":"2020-01-16T05:44:06.540786+0000","last_undegraded":"2020-01-16T05:44:06.540786+0000","last_fullsized":"2020-01-16T05:44:06.540786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946887+0000","last_change":"2020-01-16T05:44:03.944413+0000","last_active":"2020-01-16T05:44:04.946887+0000","last_peered":"2020-01-16T05:44:04.946887+0000","last_clean":"2020-01-16T05:44:04.946887+0000","last_became_active":"2020-01-16T05:44:03.943334+0000","last_became_peered":"2020-01-16T05:44:03.943334+0000","last_unstale":"2020-01-16T05:44:04.946887+0000","last_undegraded":"2020-01-16T05:44:04.946887+0000","last_fullsized":"2020-01-16T05:44:04.946887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:03.617386+0000","last_clean_scrub_stamp":"2020-01-16T05:44:03.617386+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-01-16T05:44:04.946988+0000","last_change":"2020-01-16T05:44:00.596442+0000","last_active":"2020-01-16T05:44:04.946988+0000","last_peered":"2020-01-16T05:44:04.946988+0000","last_clean":"2020-01-16T05:44:04.946988+0000","last_became_active":"2020-01-16T05:44:00.596082+0000","last_became_peered":"2020-01-16T05:44:00.596082+0000","last_unstale":"2020-01-16T05:44:04.946988+0000","last_undegraded":"2020-01-16T05:44:04.946988+0000","last_fullsized":"2020-01-16T05:44:04.946988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:43:59.571776+0000","last_clean_scrub_stamp":"2020-01-16T05:43:59.571776+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"24'8","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2020-01-16T05:44:06.902221+0000","last_change":"2020-01-16T05:44:03.945176+0000","last_active":"2020-01-16T05:44:06.902221+0000","last_peered":"2020-01-16T05:44:06.902221+0000","last_clean":"2020-01-16T05:44:06.902221+0000","last_became_active":"2020-01-16T05:44:03.944396+0000","last_became_peered":"2020-01-16T05:44:03.944396+0000","last_unstale":"2020-01-16T05:44:06.902221+0000","last_undegraded":"2020-01-16T05:44:06.902221+0000","last_fullsized":"2020-01-16T05:44:06.902221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-16T05:44:02.607687+0000","last_clean_scrub_stamp":"2020-01-16T05:44:02.607687+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":90949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":90257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":90223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":90223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":90789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":91909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":91749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":90257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}]}} 2020-01-16T05:44:19.004 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-16T05:44:19.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a320e1700 1 Processor -- start 2020-01-16T05:44:19.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a320e1700 1 -- start start 2020-01-16T05:44:19.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a320e1700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a2c0a2f60 0x7f6a2c05b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:19.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a320e1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a2c08fd80 0x7f6a2c1503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:19.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a320e1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2c07cd60 con 0x7f6a2c0a8ff0 2020-01-16T05:44:19.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a320e1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c0a3390 con 0x7f6a2c08fd80 2020-01-16T05:44:19.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a320e1700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c0905b0 con 0x7f6a2c0a2f60 2020-01-16T05:44:19.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a30e7f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a2c08fd80 0x7f6a2c1503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a30e7f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a2c08fd80 0x7f6a2c1503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34728/0 (socket says 172.21.15.84:34728) 2020-01-16T05:44:19.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a30e7f700 1 -- 172.21.15.84:0/539110183 learned_addr learned my addr 172.21.15.84:0/539110183 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:19.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a2bfff700 1 --2- 172.21.15.84:0/539110183 >> v2:172.21.15.142:3300/0 conn(0x7f6a2c0a2f60 0x7f6a2c05b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a30e7f700 1 -- 172.21.15.84:0/539110183 >> v2:172.21.15.142:3300/0 conn(0x7f6a2c0a2f60 msgr2=0x7f6a2c05b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:19.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/539110183 >> v2:172.21.15.142:3300/0 conn(0x7f6a2c0a2f60 0x7f6a2c05b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:19.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a30e7f700 1 -- 172.21.15.84:0/539110183 >> v1:172.21.15.142:6789/0 conn(0x7f6a2c0a8ff0 legacy=0x7f6a2c07c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a30e7f700 1 -- 172.21.15.84:0/539110183 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c0a9420 con 0x7f6a2c08fd80 2020-01-16T05:44:19.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/539110183 >> v2:172.21.15.84:3300/0 conn(0x7f6a2c08fd80 0x7f6a2c1503f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6a2c0a2530 tx=0x7f6a2400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/539110183 >> v2:172.21.15.84:3300/0 conn(0x7f6a2c08fd80 0x7f6a2c1503f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6a2c0a2530 tx=0x7f6a2400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/539110183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c08fd80 0x7f6a2c1503f0 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f6a2c0a2530 tx=0x7f6a2400feb0).ready entity=mon.0 client_cookie=2b555c9ab51083e8 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:19.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/539110183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c08fd80 0x7f6a2c1503f0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f6a2c0a2530 tx=0x7f6a2400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/539110183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c08fd80 0x7f6a2c1503f0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f6a2c0a2530 tx=0x7f6a2400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a2affd700 1 -- 172.21.15.84:0/539110183 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a240116e0 con 0x7f6a2c08fd80 2020-01-16T05:44:19.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/539110183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c08fd80 0x7f6a2c1503f0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f6a2c0a2530 tx=0x7f6a2400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.122 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a2affd700 1 -- 172.21.15.84:0/539110183 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a24008d30 con 0x7f6a2c08fd80 2020-01-16T05:44:19.122 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a2affd700 1 -- 172.21.15.84:0/539110183 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a24011cc0 con 0x7f6a2c08fd80 2020-01-16T05:44:19.122 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a320e1700 1 -- 172.21.15.84:0/539110183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c08fd80 msgr2=0x7f6a2c1503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.111+0000 7f6a320e1700 1 --2- 172.21.15.84:0/539110183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c08fd80 0x7f6a2c1503f0 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f6a2c0a2530 tx=0x7f6a2400feb0).stop 2020-01-16T05:44:19.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.115+0000 7f6a320e1700 1 -- 172.21.15.84:0/539110183 shutdown_connections 2020-01-16T05:44:19.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.115+0000 7f6a320e1700 1 --2- 172.21.15.84:0/539110183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c08fd80 0x7f6a2c1503f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:19.124 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.115+0000 7f6a320e1700 1 --2- 172.21.15.84:0/539110183 >> v2:172.21.15.142:3300/0 conn(0x7f6a2c0a2f60 0x7f6a2c05b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:19.124 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.115+0000 7f6a320e1700 1 -- 172.21.15.84:0/539110183 shutdown_connections 2020-01-16T05:44:19.124 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.115+0000 7f6a320e1700 1 -- 172.21.15.84:0/539110183 wait complete. 2020-01-16T05:44:19.124 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.115+0000 7f6a320e1700 1 -- 172.21.15.84:0/539110183 >> 172.21.15.84:0/539110183 conn(0x7f6a2c0abc10 msgr2=0x7f6a2c05a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:19.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.115+0000 7f6a320e1700 1 Processor -- start 2020-01-16T05:44:19.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.115+0000 7f6a320e1700 1 -- start start 2020-01-16T05:44:19.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a320e1700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a2c132e20 0x7f6a2c133250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:19.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a320e1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a2c138260 0x7f6a2c13a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:19.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a320e1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2c07e9f0 con 0x7f6a2c1496b0 2020-01-16T05:44:19.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a320e1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c07ed30 con 0x7f6a2c138260 2020-01-16T05:44:19.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a320e1700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c0aa040 con 0x7f6a2c132e20 2020-01-16T05:44:19.131 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a2bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6a2c1496b0 0x7f6a2c07ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51934/0 (socket says 172.21.15.84:51934) 2020-01-16T05:44:19.131 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a2bfff700 1 -- 172.21.15.84:0/2282289496 learned_addr learned my addr 172.21.15.84:0/2282289496 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:19.131 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/2282289496 >> v2:172.21.15.84:3300/0 conn(0x7f6a2c138260 0x7f6a2c13a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.131 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a2b7fe700 1 --2- 172.21.15.84:0/2282289496 >> v2:172.21.15.142:3300/0 conn(0x7f6a2c132e20 0x7f6a2c133250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.131 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a28ff9700 1 -- 172.21.15.84:0/2282289496 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822366666 0 0) 0x7f6a2c07e9f0 con 0x7f6a2c1496b0 2020-01-16T05:44:19.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a28ff9700 1 -- 172.21.15.84:0/2282289496 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a10003230 con 0x7f6a2c1496b0 2020-01-16T05:44:19.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a30e7f700 1 -- 172.21.15.84:0/2282289496 >> v2:172.21.15.142:3300/0 conn(0x7f6a2c132e20 msgr2=0x7f6a2c133250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/2282289496 >> v2:172.21.15.142:3300/0 conn(0x7f6a2c132e20 0x7f6a2c133250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:19.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a30e7f700 1 -- 172.21.15.84:0/2282289496 >> v1:172.21.15.84:6789/0 conn(0x7f6a2c1496b0 legacy=0x7f6a2c07ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a28ff9700 1 -- 172.21.15.84:0/2282289496 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3513846064 0 0) 0x7f6a10003230 con 0x7f6a2c1496b0 2020-01-16T05:44:19.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a30e7f700 1 -- 172.21.15.84:0/2282289496 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c149ae0 con 0x7f6a2c138260 2020-01-16T05:44:19.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/2282289496 >> v2:172.21.15.84:3300/0 conn(0x7f6a2c138260 0x7f6a2c13a6a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6a1c001a50 tx=0x7f6a1c0032f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/2282289496 >> v2:172.21.15.84:3300/0 conn(0x7f6a2c138260 0x7f6a2c13a6a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6a1c001a50 tx=0x7f6a1c0032f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/2282289496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c138260 0x7f6a2c13a6a0 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7f6a1c001a50 tx=0x7f6a1c0032f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:19.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/2282289496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c138260 0x7f6a2c13a6a0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f6a1c001a50 tx=0x7f6a1c0032f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a28ff9700 1 -- 172.21.15.84:0/2282289496 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a1c001810 con 0x7f6a2c138260 2020-01-16T05:44:19.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/2282289496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c138260 0x7f6a2c13a6a0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f6a1c001a50 tx=0x7f6a1c0032f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a28ff9700 1 -- 172.21.15.84:0/2282289496 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1c001620 con 0x7f6a2c138260 2020-01-16T05:44:19.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a320e1700 1 -- 172.21.15.84:0/2282289496 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2c07c250 con 0x7f6a2c138260 2020-01-16T05:44:19.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/2282289496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c138260 0x7f6a2c13a6a0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f6a1c001a50 tx=0x7f6a1c0032f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a28ff9700 1 -- 172.21.15.84:0/2282289496 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a24007150 con 0x7f6a2c138260 2020-01-16T05:44:19.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a320e1700 1 -- 172.21.15.84:0/2282289496 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2c07fba0 con 0x7f6a2c138260 2020-01-16T05:44:19.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/2282289496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c138260 0x7f6a2c13a6a0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f6a1c001a50 tx=0x7f6a1c0032f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a320e1700 1 -- 172.21.15.84:0/2282289496 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2c05e1c0 con 0x7f6a2c138260 2020-01-16T05:44:19.135 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a28ff9700 1 -- 172.21.15.84:0/2282289496 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f6a240073f0 con 0x7f6a2c138260 2020-01-16T05:44:19.135 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/2282289496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c138260 0x7f6a2c13a6a0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f6a1c001a50 tx=0x7f6a1c0032f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.135 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a28ff9700 1 --2- 172.21.15.84:0/2282289496 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6a1003c790 0x7f6a1003eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:19.135 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.119+0000 7f6a28ff9700 1 -- 172.21.15.84:0/2282289496 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f6a2404cac0 con 0x7f6a2c138260 2020-01-16T05:44:19.135 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.123+0000 7f6a2bfff700 1 --2- 172.21.15.84:0/2282289496 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6a1003c790 0x7f6a1003eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.135 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.123+0000 7f6a2bfff700 1 --2- 172.21.15.84:0/2282289496 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6a1003c790 0x7f6a1003eca0 crc :-1 s=READY pgs=92 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:19.135 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.127+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/2282289496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c138260 0x7f6a2c13a6a0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f6a1c001a50 tx=0x7f6a1c0032f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.136 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.127+0000 7f6a28ff9700 1 -- 172.21.15.84:0/2282289496 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f6a240330c0 con 0x7f6a2c138260 2020-01-16T05:44:19.243 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.243+0000 7f6a320e1700 1 -- 172.21.15.84:0/2282289496 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a2c08f350 con 0x7f6a2c138260 2020-01-16T05:44:19.244 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.243+0000 7f6a30e7f700 1 --2- 172.21.15.84:0/2282289496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c138260 0x7f6a2c13a6a0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f6a1c001a50 tx=0x7f6a1c0032f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.245 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.243+0000 7f6a28ff9700 1 -- 172.21.15.84:0/2282289496 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14672 (secure 0 0 0) 0x7f6a24033320 con 0x7f6a2c138260 2020-01-16T05:44:19.245 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:19.245 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"cbc67508-4d2a-4483-a1fc-95d371063ac4","created":"2020-01-16T05:43:46.771497+0000","modified":"2020-01-16T05:44:05.941278+0000","last_up_change":"2020-01-16T05:43:55.529492+0000","last_in_change":"2020-01-16T05:43:55.529492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-16T05:43:59.152708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-16T05:44:01.682783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-16T05:44:02.930765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15da60bb-4d16-44cc-80c6-cd2c7fa77364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":12644},{"type":"v1","addr":"172.21.15.84:6812","nonce":12644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":12644},{"type":"v1","addr":"172.21.15.84:6816","nonce":12644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":12644},{"type":"v1","addr":"172.21.15.84:6824","nonce":12644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":12644},{"type":"v1","addr":"172.21.15.84:6820","nonce":12644}]},"public_addr":"172.21.15.84:6812/12644","cluster_addr":"172.21.15.84:6816/12644","heartbeat_back_addr":"172.21.15.84:6824/12644","heartbeat_front_addr":"172.21.15.84:6820/12644","state":["exists","up"]},{"osd":1,"uuid":"0800533c-1d5b-4f9f-99bb-34b8133c8b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":12645},{"type":"v1","addr":"172.21.15.84:6803","nonce":12645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":12645},{"type":"v1","addr":"172.21.15.84:6805","nonce":12645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":12645},{"type":"v1","addr":"172.21.15.84:6809","nonce":12645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":12645},{"type":"v1","addr":"172.21.15.84:6807","nonce":12645}]},"public_addr":"172.21.15.84:6803/12645","cluster_addr":"172.21.15.84:6805/12645","heartbeat_back_addr":"172.21.15.84:6809/12645","heartbeat_front_addr":"172.21.15.84:6807/12645","state":["exists","up"]},{"osd":2,"uuid":"519cc27f-5cf9-4ecf-ad66-f722c37339df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":12646},{"type":"v1","addr":"172.21.15.84:6813","nonce":12646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6815","nonce":12646},{"type":"v1","addr":"172.21.15.84:6817","nonce":12646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":12646},{"type":"v1","addr":"172.21.15.84:6825","nonce":12646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":12646},{"type":"v1","addr":"172.21.15.84:6821","nonce":12646}]},"public_addr":"172.21.15.84:6813/12646","cluster_addr":"172.21.15.84:6817/12646","heartbeat_back_addr":"172.21.15.84:6825/12646","heartbeat_front_addr":"172.21.15.84:6821/12646","state":["exists","up"]},{"osd":3,"uuid":"aec305a6-bbac-4e01-8ea1-6077d49e27e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":12647},{"type":"v1","addr":"172.21.15.84:6827","nonce":12647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":12647},{"type":"v1","addr":"172.21.15.84:6829","nonce":12647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":12647},{"type":"v1","addr":"172.21.15.84:6833","nonce":12647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":12647},{"type":"v1","addr":"172.21.15.84:6831","nonce":12647}]},"public_addr":"172.21.15.84:6827/12647","cluster_addr":"172.21.15.84:6829/12647","heartbeat_back_addr":"172.21.15.84:6833/12647","heartbeat_front_addr":"172.21.15.84:6831/12647","state":["exists","up"]},{"osd":4,"uuid":"aaec7f3e-299a-4546-8406-207bcc4b3afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":12842},{"type":"v1","addr":"172.21.15.142:6801","nonce":12842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12842},{"type":"v1","addr":"172.21.15.142:6803","nonce":12842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12842},{"type":"v1","addr":"172.21.15.142:6807","nonce":12842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12842},{"type":"v1","addr":"172.21.15.142:6805","nonce":12842}]},"public_addr":"172.21.15.142:6801/12842","cluster_addr":"172.21.15.142:6803/12842","heartbeat_back_addr":"172.21.15.142:6807/12842","heartbeat_front_addr":"172.21.15.142:6805/12842","state":["exists","up"]},{"osd":5,"uuid":"5a942a47-7346-46d4-adf8-dad2bdb95aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12843},{"type":"v1","addr":"172.21.15.142:6809","nonce":12843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12843},{"type":"v1","addr":"172.21.15.142:6811","nonce":12843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12843},{"type":"v1","addr":"172.21.15.142:6815","nonce":12843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12843},{"type":"v1","addr":"172.21.15.142:6813","nonce":12843}]},"public_addr":"172.21.15.142:6809/12843","cluster_addr":"172.21.15.142:6811/12843","heartbeat_back_addr":"172.21.15.142:6815/12843","heartbeat_front_addr":"172.21.15.142:6813/12843","state":["exists","up"]},{"osd":6,"uuid":"c69fca67-66e4-4c31-ab03-1419e2a83e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12844},{"type":"v1","addr":"172.21.15.142:6818","nonce":12844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":12844},{"type":"v1","addr":"172.21.15.142:6823","nonce":12844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":12844},{"type":"v1","addr":"172.21.15.142:6831","nonce":12844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":12844},{"type":"v1","addr":"172.21.15.142:6827","nonce":12844}]},"public_addr":"172.21.15.142:6818/12844","cluster_addr":"172.21.15.142:6823/12844","heartbeat_back_addr":"172.21.15.142:6831/12844","heartbeat_front_addr":"172.21.15.142:6827/12844","state":["exists","up"]},{"osd":7,"uuid":"c436f64e-aa1f-435b-ac7b-85633e297591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":12845},{"type":"v1","addr":"172.21.15.142:6819","nonce":12845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12845},{"type":"v1","addr":"172.21.15.142:6822","nonce":12845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12845},{"type":"v1","addr":"172.21.15.142:6830","nonce":12845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12845},{"type":"v1","addr":"172.21.15.142:6826","nonce":12845}]},"public_addr":"172.21.15.142:6819/12845","cluster_addr":"172.21.15.142:6822/12845","heartbeat_back_addr":"172.21.15.142:6830/12845","heartbeat_front_addr":"172.21.15.142:6826/12845","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.534744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.505453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.485516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.333028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.483323+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.567824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.273268+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.559741+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-16T05:44:19.248 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.247+0000 7f6a320e1700 1 -- 172.21.15.84:0/2282289496 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6a1003c790 msgr2=0x7f6a1003eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.248 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.247+0000 7f6a320e1700 1 --2- 172.21.15.84:0/2282289496 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6a1003c790 0x7f6a1003eca0 crc :-1 s=READY pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:19.248 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.247+0000 7f6a320e1700 1 -- 172.21.15.84:0/2282289496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c138260 msgr2=0x7f6a2c13a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.248 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.247+0000 7f6a320e1700 1 --2- 172.21.15.84:0/2282289496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c138260 0x7f6a2c13a6a0 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7f6a1c001a50 tx=0x7f6a1c0032f0).stop 2020-01-16T05:44:19.248 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.247+0000 7f6a320e1700 1 -- 172.21.15.84:0/2282289496 shutdown_connections 2020-01-16T05:44:19.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.247+0000 7f6a320e1700 1 --2- 172.21.15.84:0/2282289496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c138260 0x7f6a2c13a6a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:19.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.247+0000 7f6a320e1700 1 --2- 172.21.15.84:0/2282289496 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6a1003c790 0x7f6a1003eca0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:19.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.247+0000 7f6a320e1700 1 --2- 172.21.15.84:0/2282289496 >> v2:172.21.15.142:3300/0 conn(0x7f6a2c132e20 0x7f6a2c133250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:19.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.247+0000 7f6a320e1700 1 -- 172.21.15.84:0/2282289496 shutdown_connections 2020-01-16T05:44:19.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.247+0000 7f6a320e1700 1 -- 172.21.15.84:0/2282289496 wait complete. 2020-01-16T05:44:19.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.247+0000 7f6a320e1700 1 -- 172.21.15.84:0/2282289496 >> 172.21.15.84:0/2282289496 conn(0x7f6a2c0a2ec0 msgr2=0x7f6a2c09d270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:19.265 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:43:59.152708+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:44:01.682783+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:44:02.930765+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-16T05:44:19.266 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-16T05:44:19.382 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26c071e700 1 Processor -- start 2020-01-16T05:44:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26c071e700 1 -- start start 2020-01-16T05:44:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26c071e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b80a2f60 0x7f26b805b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26c071e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26b80a8ff0 0x7f26b808fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26c071e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b80902d0 con 0x7f26b807c560 2020-01-16T05:44:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26c071e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b80a3390 con 0x7f26b80a8ff0 2020-01-16T05:44:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26c071e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b80905b0 con 0x7f26b80a2f60 2020-01-16T05:44:19.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26be4ba700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26b80a8ff0 0x7f26b808fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26be4ba700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26b80a8ff0 0x7f26b808fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34742/0 (socket says 172.21.15.84:34742) 2020-01-16T05:44:19.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26be4ba700 1 -- 172.21.15.84:0/2784420873 learned_addr learned my addr 172.21.15.84:0/2784420873 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:19.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26becbb700 1 --2- 172.21.15.84:0/2784420873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b80a2f60 0x7f26b805b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26be4ba700 1 -- 172.21.15.84:0/2784420873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b80a2f60 msgr2=0x7f26b805b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:19.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26be4ba700 1 --2- 172.21.15.84:0/2784420873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b80a2f60 0x7f26b805b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:19.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26be4ba700 1 -- 172.21.15.84:0/2784420873 >> v1:172.21.15.142:6789/0 conn(0x7f26b807c560 legacy=0x7f26b8149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26be4ba700 1 -- 172.21.15.84:0/2784420873 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b80a9420 con 0x7f26b80a8ff0 2020-01-16T05:44:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26be4ba700 1 --2- 172.21.15.84:0/2784420873 >> v2:172.21.15.84:3300/0 conn(0x7f26b80a8ff0 0x7f26b808fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f26b8090770 tx=0x7f26ac00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26be4ba700 1 --2- 172.21.15.84:0/2784420873 >> v2:172.21.15.84:3300/0 conn(0x7f26b80a8ff0 0x7f26b808fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f26b8090770 tx=0x7f26ac00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26be4ba700 1 --2- 172.21.15.84:0/2784420873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26b80a8ff0 0x7f26b808fd80 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7f26b8090770 tx=0x7f26ac00feb0).ready entity=mon.0 client_cookie=ac0e1b91f4326be1 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26be4ba700 1 --2- 172.21.15.84:0/2784420873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26b80a8ff0 0x7f26b808fd80 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f26b8090770 tx=0x7f26ac00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26be4ba700 1 --2- 172.21.15.84:0/2784420873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26b80a8ff0 0x7f26b808fd80 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f26b8090770 tx=0x7f26ac00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26be4ba700 1 --2- 172.21.15.84:0/2784420873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26b80a8ff0 0x7f26b808fd80 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f26b8090770 tx=0x7f26ac00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26bdcb9700 1 -- 172.21.15.84:0/2784420873 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26ac011720 con 0x7f26b80a8ff0 2020-01-16T05:44:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26bdcb9700 1 -- 172.21.15.84:0/2784420873 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac008d30 con 0x7f26b80a8ff0 2020-01-16T05:44:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26bdcb9700 1 -- 172.21.15.84:0/2784420873 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26ac011d00 con 0x7f26b80a8ff0 2020-01-16T05:44:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26c071e700 1 -- 172.21.15.84:0/2784420873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26b80a8ff0 msgr2=0x7f26b808fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26c071e700 1 --2- 172.21.15.84:0/2784420873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26b80a8ff0 0x7f26b808fd80 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7f26b8090770 tx=0x7f26ac00feb0).stop 2020-01-16T05:44:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26c071e700 1 -- 172.21.15.84:0/2784420873 shutdown_connections 2020-01-16T05:44:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26c071e700 1 --2- 172.21.15.84:0/2784420873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b80a2f60 0x7f26b805b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26c071e700 1 --2- 172.21.15.84:0/2784420873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26b80a8ff0 0x7f26b808fd80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26c071e700 1 -- 172.21.15.84:0/2784420873 shutdown_connections 2020-01-16T05:44:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26c071e700 1 -- 172.21.15.84:0/2784420873 wait complete. 2020-01-16T05:44:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.379+0000 7f26c071e700 1 -- 172.21.15.84:0/2784420873 >> 172.21.15.84:0/2784420873 conn(0x7f26b80abc10 msgr2=0x7f26b805a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:19.390 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.383+0000 7f26c071e700 1 Processor -- start 2020-01-16T05:44:19.390 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.383+0000 7f26c071e700 1 -- start start 2020-01-16T05:44:19.390 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.383+0000 7f26c071e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26b81488f0 0x7f26b8147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:19.390 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.383+0000 7f26c071e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b807f610 0x7f26b807fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:19.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.383+0000 7f26c071e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b80a2180 con 0x7f26b8149320 2020-01-16T05:44:19.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.383+0000 7f26c071e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b8149750 con 0x7f26b81488f0 2020-01-16T05:44:19.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.383+0000 7f26c071e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b8149910 con 0x7f26b807f610 2020-01-16T05:44:19.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.383+0000 7f26becbb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26b81488f0 0x7f26b8147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.383+0000 7f26becbb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26b81488f0 0x7f26b8147d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34748/0 (socket says 172.21.15.84:34748) 2020-01-16T05:44:19.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.383+0000 7f26becbb700 1 -- 172.21.15.84:0/1509012649 learned_addr learned my addr 172.21.15.84:0/1509012649 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:19.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.383+0000 7f26bf4bc700 1 --2- 172.21.15.84:0/1509012649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b807f610 0x7f26b807fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.383+0000 7f26becbb700 1 -- 172.21.15.84:0/1509012649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b807f610 msgr2=0x7f26b807fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.383+0000 7f26becbb700 1 --2- 172.21.15.84:0/1509012649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b807f610 0x7f26b807fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:19.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.383+0000 7f26becbb700 1 -- 172.21.15.84:0/1509012649 >> v1:172.21.15.142:6789/0 conn(0x7f26b8149320 legacy=0x7f26b807e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.383+0000 7f26b77fe700 1 -- 172.21.15.84:0/1509012649 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548301064 0 0) 0x7f26b80a2180 con 0x7f26b8149320 2020-01-16T05:44:19.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.383+0000 7f26becbb700 1 -- 172.21.15.84:0/1509012649 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b8132520 con 0x7f26b81488f0 2020-01-16T05:44:19.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.383+0000 7f26becbb700 1 --2- 172.21.15.84:0/1509012649 >> v2:172.21.15.84:3300/0 conn(0x7f26b81488f0 0x7f26b8147d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26a8007aa0 tx=0x7f26a8011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.383+0000 7f26becbb700 1 --2- 172.21.15.84:0/1509012649 >> v2:172.21.15.84:3300/0 conn(0x7f26b81488f0 0x7f26b8147d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26a8007aa0 tx=0x7f26a8011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.387+0000 7f26becbb700 1 --2- 172.21.15.84:0/1509012649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26b81488f0 0x7f26b8147d20 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7f26a8007aa0 tx=0x7f26a8011010).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:19.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.387+0000 7f26becbb700 1 --2- 172.21.15.84:0/1509012649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26b81488f0 0x7f26b8147d20 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f26a8007aa0 tx=0x7f26a8011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.387+0000 7f26b77fe700 1 -- 172.21.15.84:0/1509012649 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26a8009390 con 0x7f26b81488f0 2020-01-16T05:44:19.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.387+0000 7f26becbb700 1 --2- 172.21.15.84:0/1509012649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26b81488f0 0x7f26b8147d20 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f26a8007aa0 tx=0x7f26a8011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.387+0000 7f26becbb700 1 --2- 172.21.15.84:0/1509012649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26b81488f0 0x7f26b8147d20 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f26a8007aa0 tx=0x7f26a8011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.387+0000 7f26b77fe700 1 -- 172.21.15.84:0/1509012649 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a8011a70 con 0x7f26b81488f0 2020-01-16T05:44:19.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.387+0000 7f26c071e700 1 -- 172.21.15.84:0/1509012649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b80a5ab0 con 0x7f26b81488f0 2020-01-16T05:44:19.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.387+0000 7f26b77fe700 1 -- 172.21.15.84:0/1509012649 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26a8009970 con 0x7f26b81488f0 2020-01-16T05:44:19.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.387+0000 7f26c071e700 1 -- 172.21.15.84:0/1509012649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b80a6000 con 0x7f26b81488f0 2020-01-16T05:44:19.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.387+0000 7f26becbb700 1 --2- 172.21.15.84:0/1509012649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26b81488f0 0x7f26b8147d20 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f26a8007aa0 tx=0x7f26a8011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.387+0000 7f26b77fe700 1 -- 172.21.15.84:0/1509012649 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f26a8009c40 con 0x7f26b81488f0 2020-01-16T05:44:19.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.387+0000 7f26becbb700 1 --2- 172.21.15.84:0/1509012649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26b81488f0 0x7f26b8147d20 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f26a8007aa0 tx=0x7f26a8011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.387+0000 7f26b77fe700 1 --2- 172.21.15.84:0/1509012649 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f269803c1c0 0x7f269803e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:19.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.387+0000 7f26b77fe700 1 -- 172.21.15.84:0/1509012649 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f26a804ece0 con 0x7f26b81488f0 2020-01-16T05:44:19.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.387+0000 7f26be4ba700 1 --2- 172.21.15.84:0/1509012649 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f269803c1c0 0x7f269803e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.387+0000 7f26c071e700 1 -- 172.21.15.84:0/1509012649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b805e1c0 con 0x7f26b81488f0 2020-01-16T05:44:19.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.387+0000 7f26be4ba700 1 --2- 172.21.15.84:0/1509012649 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f269803c1c0 0x7f269803e6d0 crc :-1 s=READY pgs=93 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.395+0000 7f26becbb700 1 --2- 172.21.15.84:0/1509012649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26b81488f0 0x7f26b8147d20 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f26a8007aa0 tx=0x7f26a8011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.395+0000 7f26b77fe700 1 -- 172.21.15.84:0/1509012649 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f26a8035300 con 0x7f26b81488f0 2020-01-16T05:44:19.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.511+0000 7f26c071e700 1 -- 172.21.15.84:0/1509012649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f26b808f350 con 0x7f26b81488f0 2020-01-16T05:44:19.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.511+0000 7f26becbb700 1 --2- 172.21.15.84:0/1509012649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26b81488f0 0x7f26b8147d20 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f26a8007aa0 tx=0x7f26a8011010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.511+0000 7f26b77fe700 1 -- 172.21.15.84:0/1509012649 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f26a8035560 con 0x7f26b81488f0 2020-01-16T05:44:19.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.511+0000 7f26c071e700 1 -- 172.21.15.84:0/1509012649 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f269803c1c0 msgr2=0x7f269803e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.511+0000 7f26c071e700 1 --2- 172.21.15.84:0/1509012649 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f269803c1c0 0x7f269803e6d0 crc :-1 s=READY pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:19.520 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.511+0000 7f26c071e700 1 -- 172.21.15.84:0/1509012649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26b81488f0 msgr2=0x7f26b8147d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.520 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.511+0000 7f26c071e700 1 --2- 172.21.15.84:0/1509012649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26b81488f0 0x7f26b8147d20 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7f26a8007aa0 tx=0x7f26a8011010).stop 2020-01-16T05:44:19.520 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.511+0000 7f26c071e700 1 -- 172.21.15.84:0/1509012649 shutdown_connections 2020-01-16T05:44:19.520 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.511+0000 7f26c071e700 1 --2- 172.21.15.84:0/1509012649 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f269803c1c0 0x7f269803e6d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:19.520 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.511+0000 7f26c071e700 1 --2- 172.21.15.84:0/1509012649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26b807f610 0x7f26b807fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:19.520 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.511+0000 7f26c071e700 1 --2- 172.21.15.84:0/1509012649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26b81488f0 0x7f26b8147d20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:19.520 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.511+0000 7f26c071e700 1 -- 172.21.15.84:0/1509012649 shutdown_connections 2020-01-16T05:44:19.520 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.511+0000 7f26c071e700 1 -- 172.21.15.84:0/1509012649 wait complete. 2020-01-16T05:44:19.521 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.511+0000 7f26c071e700 1 -- 172.21.15.84:0/1509012649 >> 172.21.15.84:0/1509012649 conn(0x7f26b80a86a0 msgr2=0x7f26b808f940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:19.521 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:19.525 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-01-16T05:44:19.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d48e72700 1 Processor -- start 2020-01-16T05:44:19.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d48e72700 1 -- start start 2020-01-16T05:44:19.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d48e72700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d440a4250 0x7f4d440abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:19.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d48e72700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d44066880 con 0x7f4d4407ff10 2020-01-16T05:44:19.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d48e72700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d44066ab0 con 0x7f4d440a9b30 2020-01-16T05:44:19.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d48e72700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d440a4830 con 0x7f4d440a4250 2020-01-16T05:44:19.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d437fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4d4407ff10 0x7f4d4414dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51958/0 (socket says 172.21.15.84:51958) 2020-01-16T05:44:19.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d437fe700 1 -- 172.21.15.84:0/3130492512 learned_addr learned my addr 172.21.15.84:0/3130492512 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:19.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d4a0d4700 1 --2- 172.21.15.84:0/3130492512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d440a4250 0x7f4d440abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d42ffd700 1 -- 172.21.15.84:0/3130492512 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272503537 0 0) 0x7f4d44066880 con 0x7f4d4407ff10 2020-01-16T05:44:19.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d42ffd700 1 -- 172.21.15.84:0/3130492512 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d2c003230 con 0x7f4d4407ff10 2020-01-16T05:44:19.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d42ffd700 1 -- 172.21.15.84:0/3130492512 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192832136 0 0) 0x7f4d44066ab0 con 0x7f4d440a9b30 2020-01-16T05:44:19.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d42ffd700 1 -- 172.21.15.84:0/3130492512 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d44066880 con 0x7f4d440a9b30 2020-01-16T05:44:19.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d42ffd700 1 -- 172.21.15.84:0/3130492512 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3663339800 0 0) 0x7f4d2c003230 con 0x7f4d4407ff10 2020-01-16T05:44:19.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d42ffd700 1 -- 172.21.15.84:0/3130492512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d440a4250 msgr2=0x7f4d440abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:19.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d42ffd700 1 --2- 172.21.15.84:0/3130492512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d440a4250 0x7f4d440abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:19.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d42ffd700 1 -- 172.21.15.84:0/3130492512 >> v1:172.21.15.142:6789/0 conn(0x7f4d440a9b30 legacy=0x7f4d440a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d42ffd700 1 -- 172.21.15.84:0/3130492512 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d44066ce0 con 0x7f4d4407ff10 2020-01-16T05:44:19.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d42ffd700 1 -- 172.21.15.84:0/3130492512 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f4d38001750 con 0x7f4d4407ff10 2020-01-16T05:44:19.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d42ffd700 1 -- 172.21.15.84:0/3130492512 >> v1:172.21.15.84:6789/0 conn(0x7f4d4407ff10 legacy=0x7f4d4414dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d42ffd700 1 --2- 172.21.15.84:0/3130492512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d2c003ac0 0x7f4d2c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:19.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d42ffd700 1 --2- 172.21.15.84:0/3130492512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d2c0045f0 0x7f4d2c004aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:19.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d42ffd700 1 --2- 172.21.15.84:0/3130492512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d2c005100 0x7f4d2c04f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:19.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d42ffd700 1 -- 172.21.15.84:0/3130492512 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d440a4830 con 0x7f4d2c0045f0 2020-01-16T05:44:19.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d437fe700 1 --2- 172.21.15.84:0/3130492512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d2c0045f0 0x7f4d2c004aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d42ffd700 1 -- 172.21.15.84:0/3130492512 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c04fd80 con 0x7f4d2c003ac0 2020-01-16T05:44:19.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d42ffd700 1 -- 172.21.15.84:0/3130492512 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c04ffc0 con 0x7f4d2c005100 2020-01-16T05:44:19.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d43fff700 1 --2- 172.21.15.84:0/3130492512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d2c003ac0 0x7f4d2c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d4a0d4700 1 --2- 172.21.15.84:0/3130492512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d2c005100 0x7f4d2c04f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d437fe700 1 -- 172.21.15.84:0/3130492512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d2c005100 msgr2=0x7f4d2c04f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:19.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d437fe700 1 --2- 172.21.15.84:0/3130492512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d2c005100 0x7f4d2c04f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:19.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d437fe700 1 -- 172.21.15.84:0/3130492512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d2c003ac0 msgr2=0x7f4d2c003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:19.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d437fe700 1 --2- 172.21.15.84:0/3130492512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d2c003ac0 0x7f4d2c003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:19.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d437fe700 1 -- 172.21.15.84:0/3130492512 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c0502c0 con 0x7f4d2c0045f0 2020-01-16T05:44:19.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d437fe700 1 --2- 172.21.15.84:0/3130492512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d2c0045f0 0x7f4d2c004aa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4d38001520 tx=0x7f4d3800c210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d437fe700 1 --2- 172.21.15.84:0/3130492512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d2c0045f0 0x7f4d2c004aa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4d38001520 tx=0x7f4d3800c210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.655+0000 7f4d437fe700 1 --2- 172.21.15.84:0/3130492512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d2c0045f0 0x7f4d2c004aa0 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7f4d38001520 tx=0x7f4d3800c210).ready entity=mon.0 client_cookie=7f7ef93dd44090f2 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:19.670 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.659+0000 7f4d437fe700 1 --2- 172.21.15.84:0/3130492512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d2c0045f0 0x7f4d2c004aa0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7f4d38001520 tx=0x7f4d3800c210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.670 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.659+0000 7f4d42ffd700 1 -- 172.21.15.84:0/3130492512 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d38010350 con 0x7f4d2c0045f0 2020-01-16T05:44:19.670 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.659+0000 7f4d437fe700 1 --2- 172.21.15.84:0/3130492512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d2c0045f0 0x7f4d2c004aa0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7f4d38001520 tx=0x7f4d3800c210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.670 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.659+0000 7f4d437fe700 1 --2- 172.21.15.84:0/3130492512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d2c0045f0 0x7f4d2c004aa0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7f4d38001520 tx=0x7f4d3800c210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.670 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.659+0000 7f4d42ffd700 1 -- 172.21.15.84:0/3130492512 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3800ecf0 con 0x7f4d2c0045f0 2020-01-16T05:44:19.670 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.659+0000 7f4d42ffd700 1 -- 172.21.15.84:0/3130492512 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d380055e0 con 0x7f4d2c0045f0 2020-01-16T05:44:19.671 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.659+0000 7f4d48e72700 1 -- 172.21.15.84:0/3130492512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d2c0045f0 msgr2=0x7f4d2c004aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.671 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.659+0000 7f4d48e72700 1 --2- 172.21.15.84:0/3130492512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d2c0045f0 0x7f4d2c004aa0 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7f4d38001520 tx=0x7f4d3800c210).stop 2020-01-16T05:44:19.671 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.659+0000 7f4d4a0d4700 1 -- 172.21.15.84:0/3130492512 reap_dead start 2020-01-16T05:44:19.671 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.659+0000 7f4d48e72700 1 -- 172.21.15.84:0/3130492512 shutdown_connections 2020-01-16T05:44:19.671 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.659+0000 7f4d48e72700 1 -- 172.21.15.84:0/3130492512 shutdown_connections 2020-01-16T05:44:19.671 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.659+0000 7f4d48e72700 1 -- 172.21.15.84:0/3130492512 wait complete. 2020-01-16T05:44:19.671 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.659+0000 7f4d48e72700 1 -- 172.21.15.84:0/3130492512 >> 172.21.15.84:0/3130492512 conn(0x7f4d440acfc0 msgr2=0x7f4d440a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:19.672 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.659+0000 7f4d48e72700 1 Processor -- start 2020-01-16T05:44:19.672 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.659+0000 7f4d48e72700 1 -- start start 2020-01-16T05:44:19.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d48e72700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4d44123360 0x7f4d44124dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d48e72700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d44122cd0 con 0x7f4d440a3320 2020-01-16T05:44:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d48e72700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4405e730 con 0x7f4d4407cf60 2020-01-16T05:44:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d48e72700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d44122f00 con 0x7f4d44123360 2020-01-16T05:44:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d43fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4d440a3320 0x7f4d4407c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51968/0 (socket says 172.21.15.84:51968) 2020-01-16T05:44:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d43fff700 1 -- 172.21.15.84:0/2212014743 learned_addr learned my addr 172.21.15.84:0/2212014743 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d4a0d4700 1 --2- 172.21.15.84:0/2212014743 >> v2:172.21.15.84:3300/0 conn(0x7f4d44123360 0x7f4d44124dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d4a0d4700 1 -- 172.21.15.84:0/2212014743 >> v1:172.21.15.142:6789/0 conn(0x7f4d4407cf60 legacy=0x7f4d4413af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d4a0d4700 1 -- 172.21.15.84:0/2212014743 >> v1:172.21.15.84:6789/0 conn(0x7f4d440a3320 legacy=0x7f4d4407c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d4a0d4700 1 -- 172.21.15.84:0/2212014743 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d440a37f0 con 0x7f4d44123360 2020-01-16T05:44:19.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d40ff9700 1 -- 172.21.15.84:0/2212014743 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404166559 0 0) 0x7f4d44122cd0 con 0x7f4d440a3320 2020-01-16T05:44:19.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d4a0d4700 1 --2- 172.21.15.84:0/2212014743 >> v2:172.21.15.84:3300/0 conn(0x7f4d44123360 0x7f4d44124dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d34001550 tx=0x7f4d3c00c080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d4a0d4700 1 --2- 172.21.15.84:0/2212014743 >> v2:172.21.15.84:3300/0 conn(0x7f4d44123360 0x7f4d44124dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d34001550 tx=0x7f4d3c00c080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d4a0d4700 1 --2- 172.21.15.84:0/2212014743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d44123360 0x7f4d44124dd0 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7f4d34001550 tx=0x7f4d3c00c080).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:19.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d4a0d4700 1 --2- 172.21.15.84:0/2212014743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d44123360 0x7f4d44124dd0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f4d34001550 tx=0x7f4d3c00c080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d40ff9700 1 -- 172.21.15.84:0/2212014743 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d3c0058d0 con 0x7f4d44123360 2020-01-16T05:44:19.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d4a0d4700 1 --2- 172.21.15.84:0/2212014743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d44123360 0x7f4d44124dd0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f4d34001550 tx=0x7f4d3c00c080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d4a0d4700 1 --2- 172.21.15.84:0/2212014743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d44123360 0x7f4d44124dd0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f4d34001550 tx=0x7f4d3c00c080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d40ff9700 1 -- 172.21.15.84:0/2212014743 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c007160 con 0x7f4d44123360 2020-01-16T05:44:19.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d48e72700 1 -- 172.21.15.84:0/2212014743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4405e960 con 0x7f4d44123360 2020-01-16T05:44:19.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d40ff9700 1 -- 172.21.15.84:0/2212014743 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d3c0080d0 con 0x7f4d44123360 2020-01-16T05:44:19.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d48e72700 1 -- 172.21.15.84:0/2212014743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d44123c20 con 0x7f4d44123360 2020-01-16T05:44:19.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d4a0d4700 1 --2- 172.21.15.84:0/2212014743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d44123360 0x7f4d44124dd0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f4d34001550 tx=0x7f4d3c00c080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d48e72700 1 -- 172.21.15.84:0/2212014743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4405e1c0 con 0x7f4d44123360 2020-01-16T05:44:19.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d40ff9700 1 -- 172.21.15.84:0/2212014743 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f4d3c0082d0 con 0x7f4d44123360 2020-01-16T05:44:19.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d4a0d4700 1 --2- 172.21.15.84:0/2212014743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d44123360 0x7f4d44124dd0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f4d34001550 tx=0x7f4d3c00c080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d40ff9700 1 --2- 172.21.15.84:0/2212014743 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4d2403c1c0 0x7f4d2403e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:19.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d40ff9700 1 -- 172.21.15.84:0/2212014743 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f4d3c04c590 con 0x7f4d44123360 2020-01-16T05:44:19.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.663+0000 7f4d43fff700 1 --2- 172.21.15.84:0/2212014743 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4d2403c1c0 0x7f4d2403e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.667+0000 7f4d43fff700 1 --2- 172.21.15.84:0/2212014743 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4d2403c1c0 0x7f4d2403e6d0 crc :-1 s=READY pgs=94 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:19.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.671+0000 7f4d4a0d4700 1 --2- 172.21.15.84:0/2212014743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d44123360 0x7f4d44124dd0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f4d34001550 tx=0x7f4d3c00c080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.671+0000 7f4d40ff9700 1 -- 172.21.15.84:0/2212014743 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f4d3c032bb0 con 0x7f4d44123360 2020-01-16T05:44:19.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.787+0000 7f4d48e72700 1 -- 172.21.15.84:0/2212014743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4d4405cbc0 con 0x7f4d44123360 2020-01-16T05:44:19.788 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.787+0000 7f4d4a0d4700 1 --2- 172.21.15.84:0/2212014743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d44123360 0x7f4d44124dd0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f4d34001550 tx=0x7f4d3c00c080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.788 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.787+0000 7f4d40ff9700 1 -- 172.21.15.84:0/2212014743 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4d3c032e10 con 0x7f4d44123360 2020-01-16T05:44:19.788 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:19.789 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.787+0000 7f4d48e72700 1 -- 172.21.15.84:0/2212014743 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4d2403c1c0 msgr2=0x7f4d2403e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.789 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.787+0000 7f4d48e72700 1 --2- 172.21.15.84:0/2212014743 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4d2403c1c0 0x7f4d2403e6d0 crc :-1 s=READY pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:19.789 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.787+0000 7f4d48e72700 1 -- 172.21.15.84:0/2212014743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d44123360 msgr2=0x7f4d44124dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.789 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.787+0000 7f4d48e72700 1 --2- 172.21.15.84:0/2212014743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d44123360 0x7f4d44124dd0 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7f4d34001550 tx=0x7f4d3c00c080).stop 2020-01-16T05:44:19.790 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.787+0000 7f4d48e72700 1 -- 172.21.15.84:0/2212014743 shutdown_connections 2020-01-16T05:44:19.790 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.787+0000 7f4d48e72700 1 --2- 172.21.15.84:0/2212014743 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4d2403c1c0 0x7f4d2403e6d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:19.790 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.787+0000 7f4d48e72700 1 --2- 172.21.15.84:0/2212014743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d44123360 0x7f4d44124dd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:19.790 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.787+0000 7f4d48e72700 1 -- 172.21.15.84:0/2212014743 shutdown_connections 2020-01-16T05:44:19.790 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.787+0000 7f4d48e72700 1 -- 172.21.15.84:0/2212014743 wait complete. 2020-01-16T05:44:19.790 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.787+0000 7f4d48e72700 1 -- 172.21.15.84:0/2212014743 >> 172.21.15.84:0/2212014743 conn(0x7f4d440acfc0 msgr2=0x7f4d4407ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:19.801 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-01-16T05:44:19.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f68125a0700 1 Processor -- start 2020-01-16T05:44:19.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f68125a0700 1 -- start start 2020-01-16T05:44:19.925 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f68125a0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f680403c6f0 0x7f68040e66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:19.925 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f68125a0700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f68040e6c30 0x7f6804020c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:19.925 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f68125a0700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68040232a0 con 0x7f68040211e0 2020-01-16T05:44:19.925 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f68125a0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6804022560 con 0x7f680403c6f0 2020-01-16T05:44:19.925 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f68125a0700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6804022800 con 0x7f68040e6c30 2020-01-16T05:44:19.926 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f6811d9f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f680403c6f0 0x7f68040e66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.926 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f6811d9f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f680403c6f0 0x7f68040e66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34776/0 (socket says 172.21.15.84:34776) 2020-01-16T05:44:19.926 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f6811d9f700 1 -- 172.21.15.84:0/1640332756 learned_addr learned my addr 172.21.15.84:0/1640332756 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:19.926 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f681159e700 1 --2- 172.21.15.84:0/1640332756 >> v2:172.21.15.142:3300/0 conn(0x7f68040e6c30 0x7f6804020c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f6811d9f700 1 -- 172.21.15.84:0/1640332756 >> v2:172.21.15.142:3300/0 conn(0x7f68040e6c30 msgr2=0x7f6804020c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:19.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f6811d9f700 1 --2- 172.21.15.84:0/1640332756 >> v2:172.21.15.142:3300/0 conn(0x7f68040e6c30 0x7f6804020c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:19.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f6811d9f700 1 -- 172.21.15.84:0/1640332756 >> v1:172.21.15.142:6789/0 conn(0x7f68040211e0 legacy=0x7f6804022aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:19.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f6811d9f700 1 -- 172.21.15.84:0/1640332756 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68040234d0 con 0x7f680403c6f0 2020-01-16T05:44:19.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f681159e700 1 --2- 172.21.15.84:0/1640332756 >> v2:172.21.15.142:3300/0 conn(0x7f68040e6c30 0x7f6804020c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-01-16T05:44:19.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f6811d9f700 1 --2- 172.21.15.84:0/1640332756 >> v2:172.21.15.84:3300/0 conn(0x7f680403c6f0 0x7f68040e66e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6804022720 tx=0x7f680c05a130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.928 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f6811d9f700 1 --2- 172.21.15.84:0/1640332756 >> v2:172.21.15.84:3300/0 conn(0x7f680403c6f0 0x7f68040e66e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6804022720 tx=0x7f680c05a130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.928 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.919+0000 7f6811d9f700 1 --2- 172.21.15.84:0/1640332756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f680403c6f0 0x7f68040e66e0 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f6804022720 tx=0x7f680c05a130).ready entity=mon.0 client_cookie=88806073267911cd server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:19.928 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f6811d9f700 1 --2- 172.21.15.84:0/1640332756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f680403c6f0 0x7f68040e66e0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f6804022720 tx=0x7f680c05a130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.928 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f6810d9d700 1 -- 172.21.15.84:0/1640332756 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f680c042ec0 con 0x7f680403c6f0 2020-01-16T05:44:19.928 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f6811d9f700 1 --2- 172.21.15.84:0/1640332756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f680403c6f0 0x7f68040e66e0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f6804022720 tx=0x7f680c05a130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.928 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f6811d9f700 1 --2- 172.21.15.84:0/1640332756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f680403c6f0 0x7f68040e66e0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f6804022720 tx=0x7f680c05a130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.929 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f6810d9d700 1 -- 172.21.15.84:0/1640332756 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680c05c920 con 0x7f680403c6f0 2020-01-16T05:44:19.929 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f6810d9d700 1 -- 172.21.15.84:0/1640332756 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f680c0684d0 con 0x7f680403c6f0 2020-01-16T05:44:19.929 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f68125a0700 1 -- 172.21.15.84:0/1640332756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f680403c6f0 msgr2=0x7f68040e66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.929 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f68125a0700 1 --2- 172.21.15.84:0/1640332756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f680403c6f0 0x7f68040e66e0 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f6804022720 tx=0x7f680c05a130).stop 2020-01-16T05:44:19.929 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f68125a0700 1 -- 172.21.15.84:0/1640332756 shutdown_connections 2020-01-16T05:44:19.929 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f68125a0700 1 --2- 172.21.15.84:0/1640332756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f680403c6f0 0x7f68040e66e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:19.930 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f68125a0700 1 --2- 172.21.15.84:0/1640332756 >> v2:172.21.15.142:3300/0 conn(0x7f68040e6c30 0x7f6804020c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:19.930 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f68125a0700 1 -- 172.21.15.84:0/1640332756 shutdown_connections 2020-01-16T05:44:19.930 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f68125a0700 1 -- 172.21.15.84:0/1640332756 wait complete. 2020-01-16T05:44:19.930 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f68125a0700 1 -- 172.21.15.84:0/1640332756 >> 172.21.15.84:0/1640332756 conn(0x7f680403d860 msgr2=0x7f680403dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:19.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f68125a0700 1 Processor -- start 2020-01-16T05:44:19.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f68125a0700 1 -- start start 2020-01-16T05:44:19.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f68125a0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f68040c5a80 0x7f6804032aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:19.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f68125a0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68040c4990 0x7f68040c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:19.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f68125a0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68040c65f0 con 0x7f68040c71c0 2020-01-16T05:44:19.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f68125a0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68040c60b0 con 0x7f68040c5a80 2020-01-16T05:44:19.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.923+0000 7f68125a0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68040c6350 con 0x7f68040c4990 2020-01-16T05:44:19.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f681159e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f68040c5a80 0x7f6804032aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f6811d9f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f68040c71c0 0x7f68040c06a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51982/0 (socket says 172.21.15.84:51982) 2020-01-16T05:44:19.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f6811d9f700 1 -- 172.21.15.84:0/103924481 learned_addr learned my addr 172.21.15.84:0/103924481 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:19.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f6813802700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68040c4990 0x7f68040c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f68027fc700 1 -- 172.21.15.84:0/103924481 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286405253 0 0) 0x7f68040c65f0 con 0x7f68040c71c0 2020-01-16T05:44:19.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f681159e700 1 -- 172.21.15.84:0/103924481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68040c4990 msgr2=0x7f68040c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f681159e700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68040c4990 0x7f68040c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:19.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f681159e700 1 -- 172.21.15.84:0/103924481 >> v1:172.21.15.84:6789/0 conn(0x7f68040c71c0 legacy=0x7f68040c06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:19.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f681159e700 1 -- 172.21.15.84:0/103924481 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68040c5310 con 0x7f68040c5a80 2020-01-16T05:44:19.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f6813802700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68040c4990 0x7f68040c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:44:19.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f681159e700 1 --2- 172.21.15.84:0/103924481 >> v2:172.21.15.84:3300/0 conn(0x7f68040c5a80 0x7f6804032aa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f67fc002f30 tx=0x7f67fc012bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f681159e700 1 --2- 172.21.15.84:0/103924481 >> v2:172.21.15.84:3300/0 conn(0x7f68040c5a80 0x7f6804032aa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f67fc002f30 tx=0x7f67fc012bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f681159e700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68040c5a80 0x7f6804032aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f67fc002f30 tx=0x7f67fc012bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:19.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f681159e700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68040c5a80 0x7f6804032aa0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f67fc002f30 tx=0x7f67fc012bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f68027fc700 1 -- 172.21.15.84:0/103924481 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67fc007160 con 0x7f68040c5a80 2020-01-16T05:44:19.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f68125a0700 1 -- 172.21.15.84:0/103924481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68040056a0 con 0x7f68040c5a80 2020-01-16T05:44:19.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f681159e700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68040c5a80 0x7f6804032aa0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f67fc002f30 tx=0x7f67fc012bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f68027fc700 1 -- 172.21.15.84:0/103924481 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc005ab0 con 0x7f68040c5a80 2020-01-16T05:44:19.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f681159e700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68040c5a80 0x7f6804032aa0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f67fc002f30 tx=0x7f67fc012bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f68027fc700 1 -- 172.21.15.84:0/103924481 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67fc014480 con 0x7f68040c5a80 2020-01-16T05:44:19.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f68125a0700 1 -- 172.21.15.84:0/103924481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6804005ab0 con 0x7f68040c5a80 2020-01-16T05:44:19.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f681159e700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68040c5a80 0x7f6804032aa0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f67fc002f30 tx=0x7f67fc012bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.940 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f681159e700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68040c5a80 0x7f6804032aa0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f67fc002f30 tx=0x7f67fc012bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.940 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f68027fc700 1 -- 172.21.15.84:0/103924481 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f67fc014720 con 0x7f68040c5a80 2020-01-16T05:44:19.940 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f68027fc700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f67f403c140 0x7f67f403e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:19.940 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f68027fc700 1 -- 172.21.15.84:0/103924481 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f67fc04efa0 con 0x7f68040c5a80 2020-01-16T05:44:19.941 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f68125a0700 1 -- 172.21.15.84:0/103924481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68040c5eb0 con 0x7f68040c5a80 2020-01-16T05:44:19.941 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f6811d9f700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f67f403c140 0x7f67f403e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:19.941 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.927+0000 7f6811d9f700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f67f403c140 0x7f67f403e650 crc :-1 s=READY pgs=95 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:19.942 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.935+0000 7f681159e700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68040c5a80 0x7f6804032aa0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f67fc002f30 tx=0x7f67fc012bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:19.942 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:19.935+0000 7f68027fc700 1 -- 172.21.15.84:0/103924481 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f67fc035500 con 0x7f68040c5a80 2020-01-16T05:44:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.047+0000 7f68125a0700 1 -- 172.21.15.84:0/103924481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6804004d20 con 0x7f68040c5a80 2020-01-16T05:44:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.047+0000 7f681159e700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68040c5a80 0x7f6804032aa0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f67fc002f30 tx=0x7f67fc012bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.047+0000 7f68027fc700 1 -- 172.21.15.84:0/103924481 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f67fc035760 con 0x7f68040c5a80 2020-01-16T05:44:20.048 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:20.050 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.047+0000 7f68125a0700 1 -- 172.21.15.84:0/103924481 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f67f403c140 msgr2=0x7f67f403e650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.050 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.047+0000 7f68125a0700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f67f403c140 0x7f67f403e650 crc :-1 s=READY pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.050 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.047+0000 7f68125a0700 1 -- 172.21.15.84:0/103924481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68040c5a80 msgr2=0x7f6804032aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.051 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.047+0000 7f68125a0700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68040c5a80 0x7f6804032aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f67fc002f30 tx=0x7f67fc012bd0).stop 2020-01-16T05:44:20.051 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.047+0000 7f68125a0700 1 -- 172.21.15.84:0/103924481 shutdown_connections 2020-01-16T05:44:20.051 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.047+0000 7f68125a0700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f67f403c140 0x7f67f403e650 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.051 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.047+0000 7f68125a0700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68040c4990 0x7f68040c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.051 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.047+0000 7f68125a0700 1 --2- 172.21.15.84:0/103924481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68040c5a80 0x7f6804032aa0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.052 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.047+0000 7f68125a0700 1 -- 172.21.15.84:0/103924481 shutdown_connections 2020-01-16T05:44:20.052 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.047+0000 7f68125a0700 1 -- 172.21.15.84:0/103924481 wait complete. 2020-01-16T05:44:20.052 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.047+0000 7f68125a0700 1 -- 172.21.15.84:0/103924481 >> 172.21.15.84:0/103924481 conn(0x7f6804004530 msgr2=0x7f6804030820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:20.062 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:44:20.184 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91b494c700 1 Processor -- start 2020-01-16T05:44:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91b494c700 1 -- start start 2020-01-16T05:44:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91b494c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91b00a8ff0 0x7f91b008fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91b494c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b00902d0 con 0x7f91b005b0f0 2020-01-16T05:44:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91b494c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b007cd60 con 0x7f91b00a2f60 2020-01-16T05:44:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91b494c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00a3390 con 0x7f91b00a8ff0 2020-01-16T05:44:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91ae59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f91b005b0f0 0x7f91b014e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51992/0 (socket says 172.21.15.84:51992) 2020-01-16T05:44:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91ae59c700 1 -- 172.21.15.84:0/3553409627 learned_addr learned my addr 172.21.15.84:0/3553409627 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:20.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91af59e700 1 --2- 172.21.15.84:0/3553409627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91b00a8ff0 0x7f91b008fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91add9b700 1 -- 172.21.15.84:0/3553409627 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782537961 0 0) 0x7f91980010d0 con 0x7f91b005b0f0 2020-01-16T05:44:20.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91add9b700 1 -- 172.21.15.84:0/3553409627 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f919c003230 con 0x7f91b005b0f0 2020-01-16T05:44:20.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91add9b700 1 -- 172.21.15.84:0/3553409627 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013441036 0 0) 0x7f91b007cd60 con 0x7f91b00a2f60 2020-01-16T05:44:20.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91add9b700 1 -- 172.21.15.84:0/3553409627 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91980010d0 con 0x7f91b00a2f60 2020-01-16T05:44:20.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91af59e700 1 -- 172.21.15.84:0/3553409627 >> v1:172.21.15.142:6789/0 conn(0x7f91b00a2f60 legacy=0x7f91b007c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.189 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91af59e700 1 -- 172.21.15.84:0/3553409627 >> v1:172.21.15.84:6789/0 conn(0x7f91b005b0f0 legacy=0x7f91b014e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.189 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91af59e700 1 -- 172.21.15.84:0/3553409627 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b005b520 con 0x7f91b00a8ff0 2020-01-16T05:44:20.189 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91af59e700 1 --2- 172.21.15.84:0/3553409627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91b00a8ff0 0x7f91b008fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f91a80032b0 tx=0x7f91a80100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.189 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91af59e700 1 --2- 172.21.15.84:0/3553409627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91b00a8ff0 0x7f91b008fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f91a80032b0 tx=0x7f91a80100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.189 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91af59e700 1 --2- 172.21.15.84:0/3553409627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91b00a8ff0 0x7f91b008fd80 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f91a80032b0 tx=0x7f91a80100f0).ready entity=mon.2 client_cookie=c7c2bfdde67d6d91 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:20.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91af59e700 1 --2- 172.21.15.84:0/3553409627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91b00a8ff0 0x7f91b008fd80 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f91a80032b0 tx=0x7f91a80100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91add9b700 1 -- 172.21.15.84:0/3553409627 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91a800a160 con 0x7f91b00a8ff0 2020-01-16T05:44:20.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.171+0000 7f91af59e700 1 --2- 172.21.15.84:0/3553409627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91b00a8ff0 0x7f91b008fd80 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f91a80032b0 tx=0x7f91a80100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.175+0000 7f91add9b700 1 -- 172.21.15.84:0/3553409627 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a8011b60 con 0x7f91b00a8ff0 2020-01-16T05:44:20.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.175+0000 7f91af59e700 1 --2- 172.21.15.84:0/3553409627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91b00a8ff0 0x7f91b008fd80 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f91a80032b0 tx=0x7f91a80100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.175+0000 7f91add9b700 1 -- 172.21.15.84:0/3553409627 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91a800a740 con 0x7f91b00a8ff0 2020-01-16T05:44:20.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.175+0000 7f91b494c700 1 -- 172.21.15.84:0/3553409627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91b00a8ff0 msgr2=0x7f91b008fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.175+0000 7f91b494c700 1 --2- 172.21.15.84:0/3553409627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91b00a8ff0 0x7f91b008fd80 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f91a80032b0 tx=0x7f91a80100f0).stop 2020-01-16T05:44:20.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.175+0000 7f91b494c700 1 -- 172.21.15.84:0/3553409627 shutdown_connections 2020-01-16T05:44:20.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.175+0000 7f91b494c700 1 --2- 172.21.15.84:0/3553409627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91b00a8ff0 0x7f91b008fd80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.175+0000 7f91b494c700 1 -- 172.21.15.84:0/3553409627 shutdown_connections 2020-01-16T05:44:20.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.175+0000 7f91b494c700 1 -- 172.21.15.84:0/3553409627 wait complete. 2020-01-16T05:44:20.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.175+0000 7f91b494c700 1 -- 172.21.15.84:0/3553409627 >> 172.21.15.84:0/3553409627 conn(0x7f91b00abc10 msgr2=0x7f91b005a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:20.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.175+0000 7f91b494c700 1 Processor -- start 2020-01-16T05:44:20.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.175+0000 7f91b494c700 1 -- start start 2020-01-16T05:44:20.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91b494c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91b00a6920 0x7f91b00a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:20.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91b494c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91b0131f10 0x7f91b0132340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:20.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91b494c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b0131930 con 0x7f91b00658e0 2020-01-16T05:44:20.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91b494c700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b00a63e0 con 0x7f91b00a6920 2020-01-16T05:44:20.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91b494c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00a6680 con 0x7f91b0131f10 2020-01-16T05:44:20.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91aed9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f91b00658e0 0x7f91b0146c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51996/0 (socket says 172.21.15.84:51996) 2020-01-16T05:44:20.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91aed9d700 1 -- 172.21.15.84:0/3792859869 learned_addr learned my addr 172.21.15.84:0/3792859869 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:20.193 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91af59e700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91b0131f10 0x7f91b0132340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.193 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91ae59c700 1 --2- 172.21.15.84:0/3792859869 >> v2:172.21.15.142:3300/0 conn(0x7f91b00a6920 0x7f91b00a6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.193 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 -- 172.21.15.84:0/3792859869 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210102572 0 0) 0x7f91b0131930 con 0x7f91b00658e0 2020-01-16T05:44:20.193 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 -- 172.21.15.84:0/3792859869 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9194003230 con 0x7f91b00658e0 2020-01-16T05:44:20.193 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 -- 172.21.15.84:0/3792859869 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 461428589 0 0) 0x7f9194003230 con 0x7f91b00658e0 2020-01-16T05:44:20.193 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 -- 172.21.15.84:0/3792859869 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f91b0131930 con 0x7f91b00658e0 2020-01-16T05:44:20.194 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 -- 172.21.15.84:0/3792859869 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f91a0001a40 con 0x7f91b00658e0 2020-01-16T05:44:20.194 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 -- 172.21.15.84:0/3792859869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91b0131f10 msgr2=0x7f91b0132340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.194 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91b0131f10 0x7f91b0132340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.194 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 -- 172.21.15.84:0/3792859869 >> v2:172.21.15.142:3300/0 conn(0x7f91b00a6920 msgr2=0x7f91b00a6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.194 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 --2- 172.21.15.84:0/3792859869 >> v2:172.21.15.142:3300/0 conn(0x7f91b00a6920 0x7f91b00a6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.194 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 -- 172.21.15.84:0/3792859869 >> v1:172.21.15.84:6789/0 conn(0x7f91b00658e0 legacy=0x7f91b0146c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.194 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9194003a20 0x7f9194003e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:20.194 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91940045a0 0x7f91940049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:20.195 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9194004fc0 0x7f919400b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:20.195 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 -- 172.21.15.84:0/3792859869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00a63e0 con 0x7f9194004fc0 2020-01-16T05:44:20.195 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 -- 172.21.15.84:0/3792859869 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00a6680 con 0x7f9194003a20 2020-01-16T05:44:20.195 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 -- 172.21.15.84:0/3792859869 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919400bdf0 con 0x7f91940045a0 2020-01-16T05:44:20.195 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91af59e700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9194004fc0 0x7f919400b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.195 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91ae59c700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91940045a0 0x7f91940049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.195 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91aed9d700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9194003a20 0x7f9194003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91af59e700 1 -- 172.21.15.84:0/3792859869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91940045a0 msgr2=0x7f91940049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91af59e700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91940045a0 0x7f91940049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91af59e700 1 -- 172.21.15.84:0/3792859869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9194003a20 msgr2=0x7f9194003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91af59e700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9194003a20 0x7f9194003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91af59e700 1 -- 172.21.15.84:0/3792859869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b0132890 con 0x7f9194004fc0 2020-01-16T05:44:20.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91b494c700 1 -- 172.21.15.84:0/3792859869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b0147470 con 0x7f9194004fc0 2020-01-16T05:44:20.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91b494c700 1 -- 172.21.15.84:0/3792859869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b0147780 con 0x7f9194004fc0 2020-01-16T05:44:20.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91af59e700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9194004fc0 0x7f919400b7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f91a80032b0 tx=0x7f91a800ad50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91af59e700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9194004fc0 0x7f919400b7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f91a80032b0 tx=0x7f91a800ad50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91af59e700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9194004fc0 0x7f919400b7f0 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7f91a80032b0 tx=0x7f91a800ad50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:20.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91af59e700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9194004fc0 0x7f919400b7f0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f91a80032b0 tx=0x7f91a800ad50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 -- 172.21.15.84:0/3792859869 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91a8005c30 con 0x7f9194004fc0 2020-01-16T05:44:20.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91af59e700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9194004fc0 0x7f919400b7f0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f91a80032b0 tx=0x7f91a800ad50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 -- 172.21.15.84:0/3792859869 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a800a360 con 0x7f9194004fc0 2020-01-16T05:44:20.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91af59e700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9194004fc0 0x7f919400b7f0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f91a80032b0 tx=0x7f91a800ad50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91a77fe700 1 -- 172.21.15.84:0/3792859869 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91a800f950 con 0x7f9194004fc0 2020-01-16T05:44:20.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.179+0000 7f91af59e700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9194004fc0 0x7f919400b7f0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f91a80032b0 tx=0x7f91a800ad50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.183+0000 7f91b494c700 1 -- 172.21.15.84:0/3792859869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9188003360 con 0x7f9194004fc0 2020-01-16T05:44:20.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.183+0000 7f91a77fe700 1 -- 172.21.15.84:0/3792859869 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f91a8007150 con 0x7f9194004fc0 2020-01-16T05:44:20.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.183+0000 7f91af59e700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9194004fc0 0x7f919400b7f0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f91a80032b0 tx=0x7f91a800ad50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.183+0000 7f91a77fe700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9194045110 0x7f9194047620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:20.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.183+0000 7f91a77fe700 1 -- 172.21.15.84:0/3792859869 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f91a804d470 con 0x7f9194004fc0 2020-01-16T05:44:20.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.183+0000 7f91aed9d700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9194045110 0x7f9194047620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.183+0000 7f91aed9d700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9194045110 0x7f9194047620 crc :-1 s=READY pgs=96 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:20.200 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.187+0000 7f91af59e700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9194004fc0 0x7f919400b7f0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f91a80032b0 tx=0x7f91a800ad50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.200 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.187+0000 7f91a77fe700 1 -- 172.21.15.84:0/3792859869 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f91b005b520 con 0x7f9194004fc0 2020-01-16T05:44:20.339 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.339+0000 7f91b494c700 1 -- 172.21.15.84:0/3792859869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9188003790 con 0x7f9194004fc0 2020-01-16T05:44:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.339+0000 7f91af59e700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9194004fc0 0x7f919400b7f0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f91a80032b0 tx=0x7f91a800ad50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.339+0000 7f91a77fe700 1 -- 172.21.15.84:0/3792859869 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2102 (secure 0 0 0) 0x7f91a8033a90 con 0x7f9194004fc0 2020-01-16T05:44:20.340 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:20.341 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4359,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:44:07.656087+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4208":{"gid":4208,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.142:6833/1195730666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1195730666},{"type":"v1","addr":"172.21.15.142:6833","nonce":1195730666}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:44:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.339+0000 7f91b494c700 1 -- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9194045110 msgr2=0x7f9194047620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.339+0000 7f91b494c700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9194045110 0x7f9194047620 crc :-1 s=READY pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.339+0000 7f91b494c700 1 -- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9194004fc0 msgr2=0x7f919400b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.339+0000 7f91af59e700 1 -- 172.21.15.84:0/3792859869 reap_dead start 2020-01-16T05:44:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.339+0000 7f91b494c700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9194004fc0 0x7f919400b7f0 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7f91a80032b0 tx=0x7f91a800ad50).stop 2020-01-16T05:44:20.343 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.339+0000 7f91b494c700 1 -- 172.21.15.84:0/3792859869 shutdown_connections 2020-01-16T05:44:20.343 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.339+0000 7f91b494c700 1 --2- 172.21.15.84:0/3792859869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9194004fc0 0x7f919400b7f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.343 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.339+0000 7f91b494c700 1 -- 172.21.15.84:0/3792859869 shutdown_connections 2020-01-16T05:44:20.343 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.343+0000 7f91b494c700 1 -- 172.21.15.84:0/3792859869 wait complete. 2020-01-16T05:44:20.343 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.343+0000 7f91b494c700 1 -- 172.21.15.84:0/3792859869 >> 172.21.15.84:0/3792859869 conn(0x7f91b008fb50 msgr2=0x7f91b009d200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:20.343 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 5 2020-01-16T05:44:20.359 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-16T05:44:20.469 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b3758700 1 Processor -- start 2020-01-16T05:44:20.469 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b3758700 1 -- start start 2020-01-16T05:44:20.469 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b3758700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2ac0a2f60 0x7fa2ac05b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:20.469 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b3758700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2ac08fd80 0x7fa2ac1503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:20.469 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b3758700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ac07cd60 con 0x7fa2ac0a8ff0 2020-01-16T05:44:20.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b3758700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ac0a3390 con 0x7fa2ac08fd80 2020-01-16T05:44:20.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b3758700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0905b0 con 0x7fa2ac0a2f60 2020-01-16T05:44:20.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b24f6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2ac08fd80 0x7fa2ac1503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b1cf5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2ac0a2f60 0x7fa2ac05b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b24f6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2ac08fd80 0x7fa2ac1503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34814/0 (socket says 172.21.15.84:34814) 2020-01-16T05:44:20.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b24f6700 1 -- 172.21.15.84:0/1628105568 learned_addr learned my addr 172.21.15.84:0/1628105568 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:20.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b24f6700 1 -- 172.21.15.84:0/1628105568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2ac0a2f60 msgr2=0x7fa2ac05b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:20.471 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b24f6700 1 --2- 172.21.15.84:0/1628105568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2ac0a2f60 0x7fa2ac05b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:20.471 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b24f6700 1 -- 172.21.15.84:0/1628105568 >> v1:172.21.15.142:6789/0 conn(0x7fa2ac0a8ff0 legacy=0x7fa2ac07c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.471 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b24f6700 1 -- 172.21.15.84:0/1628105568 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac0a9420 con 0x7fa2ac08fd80 2020-01-16T05:44:20.471 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b24f6700 1 --2- 172.21.15.84:0/1628105568 >> v2:172.21.15.84:3300/0 conn(0x7fa2ac08fd80 0x7fa2ac1503f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa2ac090770 tx=0x7fa29c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.471 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b24f6700 1 --2- 172.21.15.84:0/1628105568 >> v2:172.21.15.84:3300/0 conn(0x7fa2ac08fd80 0x7fa2ac1503f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa2ac090770 tx=0x7fa29c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.471 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b24f6700 1 --2- 172.21.15.84:0/1628105568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ac08fd80 0x7fa2ac1503f0 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7fa2ac090770 tx=0x7fa29c00feb0).ready entity=mon.0 client_cookie=b39bbc3c9c5a2469 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:20.471 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b24f6700 1 --2- 172.21.15.84:0/1628105568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ac08fd80 0x7fa2ac1503f0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fa2ac090770 tx=0x7fa29c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.471 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b0cf3700 1 -- 172.21.15.84:0/1628105568 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa29c011720 con 0x7fa2ac08fd80 2020-01-16T05:44:20.472 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b24f6700 1 --2- 172.21.15.84:0/1628105568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ac08fd80 0x7fa2ac1503f0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fa2ac090770 tx=0x7fa29c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.472 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b24f6700 1 --2- 172.21.15.84:0/1628105568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ac08fd80 0x7fa2ac1503f0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fa2ac090770 tx=0x7fa29c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.472 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b0cf3700 1 -- 172.21.15.84:0/1628105568 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c008d30 con 0x7fa2ac08fd80 2020-01-16T05:44:20.472 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b0cf3700 1 -- 172.21.15.84:0/1628105568 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa29c011d00 con 0x7fa2ac08fd80 2020-01-16T05:44:20.472 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b3758700 1 -- 172.21.15.84:0/1628105568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ac08fd80 msgr2=0x7fa2ac1503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.472 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.463+0000 7fa2b3758700 1 --2- 172.21.15.84:0/1628105568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ac08fd80 0x7fa2ac1503f0 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7fa2ac090770 tx=0x7fa29c00feb0).stop 2020-01-16T05:44:20.472 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b3758700 1 -- 172.21.15.84:0/1628105568 shutdown_connections 2020-01-16T05:44:20.473 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b3758700 1 --2- 172.21.15.84:0/1628105568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ac08fd80 0x7fa2ac1503f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.473 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b3758700 1 --2- 172.21.15.84:0/1628105568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2ac0a2f60 0x7fa2ac05b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:20.473 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b3758700 1 -- 172.21.15.84:0/1628105568 shutdown_connections 2020-01-16T05:44:20.473 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b3758700 1 -- 172.21.15.84:0/1628105568 wait complete. 2020-01-16T05:44:20.473 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b3758700 1 -- 172.21.15.84:0/1628105568 >> 172.21.15.84:0/1628105568 conn(0x7fa2ac0abc10 msgr2=0x7fa2ac05a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:20.473 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b3758700 1 Processor -- start 2020-01-16T05:44:20.473 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b3758700 1 -- start start 2020-01-16T05:44:20.484 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b3758700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2ac1492d0 0x7fa2ac1301e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:20.485 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b3758700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2ac09c4b0 0x7fa2ac124ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:20.485 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b3758700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ac125010 con 0x7fa2ac1272d0 2020-01-16T05:44:20.485 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b3758700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ac09afb0 con 0x7fa2ac09c4b0 2020-01-16T05:44:20.486 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b3758700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac12fa00 con 0x7fa2ac1492d0 2020-01-16T05:44:20.486 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b24f6700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa2ac1272d0 0x7fa2ac132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52020/0 (socket says 172.21.15.84:52020) 2020-01-16T05:44:20.486 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b24f6700 1 -- 172.21.15.84:0/1069749586 learned_addr learned my addr 172.21.15.84:0/1069749586 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:20.486 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b14f4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2ac09c4b0 0x7fa2ac124ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b1cf5700 1 --2- 172.21.15.84:0/1069749586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2ac1492d0 0x7fa2ac1301e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b14f4700 1 -- 172.21.15.84:0/1069749586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2ac1492d0 msgr2=0x7fa2ac1301e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b14f4700 1 --2- 172.21.15.84:0/1069749586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2ac1492d0 0x7fa2ac1301e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.494 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2aa7fc700 1 -- 172.21.15.84:0/1069749586 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96684905 0 0) 0x7fa2ac125010 con 0x7fa2ac1272d0 2020-01-16T05:44:20.494 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b14f4700 1 -- 172.21.15.84:0/1069749586 >> v1:172.21.15.84:6789/0 conn(0x7fa2ac1272d0 legacy=0x7fa2ac132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.494 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.467+0000 7fa2b14f4700 1 -- 172.21.15.84:0/1069749586 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac09c8e0 con 0x7fa2ac09c4b0 2020-01-16T05:44:20.494 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2b14f4700 1 --2- 172.21.15.84:0/1069749586 >> v2:172.21.15.84:3300/0 conn(0x7fa2ac09c4b0 0x7fa2ac124ac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa2a0000e90 tx=0x7fa2a0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.494 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2b14f4700 1 --2- 172.21.15.84:0/1069749586 >> v2:172.21.15.84:3300/0 conn(0x7fa2ac09c4b0 0x7fa2ac124ac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa2a0000e90 tx=0x7fa2a0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2b14f4700 1 --2- 172.21.15.84:0/1069749586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ac09c4b0 0x7fa2ac124ac0 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7fa2a0000e90 tx=0x7fa2a0010a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:20.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2b14f4700 1 --2- 172.21.15.84:0/1069749586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ac09c4b0 0x7fa2ac124ac0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7fa2a0000e90 tx=0x7fa2a0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2aa7fc700 1 -- 172.21.15.84:0/1069749586 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2a000cc00 con 0x7fa2ac09c4b0 2020-01-16T05:44:20.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2b14f4700 1 --2- 172.21.15.84:0/1069749586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ac09c4b0 0x7fa2ac124ac0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7fa2a0000e90 tx=0x7fa2a0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2b14f4700 1 --2- 172.21.15.84:0/1069749586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ac09c4b0 0x7fa2ac124ac0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7fa2a0000e90 tx=0x7fa2a0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2aa7fc700 1 -- 172.21.15.84:0/1069749586 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a000c820 con 0x7fa2ac09c4b0 2020-01-16T05:44:20.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2b3758700 1 -- 172.21.15.84:0/1069749586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ac12f680 con 0x7fa2ac09c4b0 2020-01-16T05:44:20.496 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2aa7fc700 1 -- 172.21.15.84:0/1069749586 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2a00124d0 con 0x7fa2ac09c4b0 2020-01-16T05:44:20.496 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2b3758700 1 -- 172.21.15.84:0/1069749586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac127700 con 0x7fa2ac09c4b0 2020-01-16T05:44:20.496 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2b14f4700 1 --2- 172.21.15.84:0/1069749586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ac09c4b0 0x7fa2ac124ac0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7fa2a0000e90 tx=0x7fa2a0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.496 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2b14f4700 1 --2- 172.21.15.84:0/1069749586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ac09c4b0 0x7fa2ac124ac0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7fa2a0000e90 tx=0x7fa2a0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.496 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2aa7fc700 1 -- 172.21.15.84:0/1069749586 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fa2a00127b0 con 0x7fa2ac09c4b0 2020-01-16T05:44:20.496 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2aa7fc700 1 --2- 172.21.15.84:0/1069749586 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa28c03c1b0 0x7fa28c03e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:20.497 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2aa7fc700 1 -- 172.21.15.84:0/1069749586 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7fa2a004c800 con 0x7fa2ac09c4b0 2020-01-16T05:44:20.497 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2b1cf5700 1 --2- 172.21.15.84:0/1069749586 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa28c03c1b0 0x7fa28c03e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.497 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2b1cf5700 1 --2- 172.21.15.84:0/1069749586 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa28c03c1b0 0x7fa28c03e6c0 crc :-1 s=READY pgs=97 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:20.497 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.471+0000 7fa2b3758700 1 -- 172.21.15.84:0/1069749586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ac05e1c0 con 0x7fa2ac09c4b0 2020-01-16T05:44:20.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.479+0000 7fa2b14f4700 1 --2- 172.21.15.84:0/1069749586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ac09c4b0 0x7fa2ac124ac0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7fa2a0000e90 tx=0x7fa2a0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.479+0000 7fa2aa7fc700 1 -- 172.21.15.84:0/1069749586 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fa2a0032d60 con 0x7fa2ac09c4b0 2020-01-16T05:44:20.601 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.595+0000 7fa2b3758700 1 -- 172.21.15.84:0/1069749586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2ac08f350 con 0x7fa2ac09c4b0 2020-01-16T05:44:20.601 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.595+0000 7fa2b14f4700 1 --2- 172.21.15.84:0/1069749586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ac09c4b0 0x7fa2ac124ac0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7fa2a0000e90 tx=0x7fa2a0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.601 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.595+0000 7fa2aa7fc700 1 -- 172.21.15.84:0/1069749586 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14672 (secure 0 0 0) 0x7fa2a0032fc0 con 0x7fa2ac09c4b0 2020-01-16T05:44:20.601 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.599+0000 7fa2b3758700 1 -- 172.21.15.84:0/1069749586 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa28c03c1b0 msgr2=0x7fa28c03e6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.601 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.599+0000 7fa2b3758700 1 --2- 172.21.15.84:0/1069749586 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa28c03c1b0 0x7fa28c03e6c0 crc :-1 s=READY pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.602 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.599+0000 7fa2b3758700 1 -- 172.21.15.84:0/1069749586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ac09c4b0 msgr2=0x7fa2ac124ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.602 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.599+0000 7fa2b3758700 1 --2- 172.21.15.84:0/1069749586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ac09c4b0 0x7fa2ac124ac0 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7fa2a0000e90 tx=0x7fa2a0010a70).stop 2020-01-16T05:44:20.602 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.599+0000 7fa2b3758700 1 -- 172.21.15.84:0/1069749586 shutdown_connections 2020-01-16T05:44:20.602 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.599+0000 7fa2b3758700 1 --2- 172.21.15.84:0/1069749586 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa28c03c1b0 0x7fa28c03e6c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.602 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.599+0000 7fa2b3758700 1 --2- 172.21.15.84:0/1069749586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2ac1492d0 0x7fa2ac1301e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.602 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.599+0000 7fa2b3758700 1 --2- 172.21.15.84:0/1069749586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ac09c4b0 0x7fa2ac124ac0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.599+0000 7fa2b3758700 1 -- 172.21.15.84:0/1069749586 shutdown_connections 2020-01-16T05:44:20.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.599+0000 7fa2b3758700 1 -- 172.21.15.84:0/1069749586 wait complete. 2020-01-16T05:44:20.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.599+0000 7fa2b3758700 1 -- 172.21.15.84:0/1069749586 >> 172.21.15.84:0/1069749586 conn(0x7fa2ac05a9f0 msgr2=0x7fa2ac0aa8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:20.603 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:20.603 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"cbc67508-4d2a-4483-a1fc-95d371063ac4","created":"2020-01-16T05:43:46.771497+0000","modified":"2020-01-16T05:44:05.941278+0000","last_up_change":"2020-01-16T05:43:55.529492+0000","last_in_change":"2020-01-16T05:43:55.529492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-16T05:43:59.152708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-16T05:44:01.682783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-16T05:44:02.930765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15da60bb-4d16-44cc-80c6-cd2c7fa77364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":12644},{"type":"v1","addr":"172.21.15.84:6812","nonce":12644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":12644},{"type":"v1","addr":"172.21.15.84:6816","nonce":12644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":12644},{"type":"v1","addr":"172.21.15.84:6824","nonce":12644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":12644},{"type":"v1","addr":"172.21.15.84:6820","nonce":12644}]},"public_addr":"172.21.15.84:6812/12644","cluster_addr":"172.21.15.84:6816/12644","heartbeat_back_addr":"172.21.15.84:6824/12644","heartbeat_front_addr":"172.21.15.84:6820/12644","state":["exists","up"]},{"osd":1,"uuid":"0800533c-1d5b-4f9f-99bb-34b8133c8b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":12645},{"type":"v1","addr":"172.21.15.84:6803","nonce":12645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":12645},{"type":"v1","addr":"172.21.15.84:6805","nonce":12645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":12645},{"type":"v1","addr":"172.21.15.84:6809","nonce":12645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":12645},{"type":"v1","addr":"172.21.15.84:6807","nonce":12645}]},"public_addr":"172.21.15.84:6803/12645","cluster_addr":"172.21.15.84:6805/12645","heartbeat_back_addr":"172.21.15.84:6809/12645","heartbeat_front_addr":"172.21.15.84:6807/12645","state":["exists","up"]},{"osd":2,"uuid":"519cc27f-5cf9-4ecf-ad66-f722c37339df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":12646},{"type":"v1","addr":"172.21.15.84:6813","nonce":12646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6815","nonce":12646},{"type":"v1","addr":"172.21.15.84:6817","nonce":12646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":12646},{"type":"v1","addr":"172.21.15.84:6825","nonce":12646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":12646},{"type":"v1","addr":"172.21.15.84:6821","nonce":12646}]},"public_addr":"172.21.15.84:6813/12646","cluster_addr":"172.21.15.84:6817/12646","heartbeat_back_addr":"172.21.15.84:6825/12646","heartbeat_front_addr":"172.21.15.84:6821/12646","state":["exists","up"]},{"osd":3,"uuid":"aec305a6-bbac-4e01-8ea1-6077d49e27e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":12647},{"type":"v1","addr":"172.21.15.84:6827","nonce":12647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":12647},{"type":"v1","addr":"172.21.15.84:6829","nonce":12647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":12647},{"type":"v1","addr":"172.21.15.84:6833","nonce":12647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":12647},{"type":"v1","addr":"172.21.15.84:6831","nonce":12647}]},"public_addr":"172.21.15.84:6827/12647","cluster_addr":"172.21.15.84:6829/12647","heartbeat_back_addr":"172.21.15.84:6833/12647","heartbeat_front_addr":"172.21.15.84:6831/12647","state":["exists","up"]},{"osd":4,"uuid":"aaec7f3e-299a-4546-8406-207bcc4b3afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":12842},{"type":"v1","addr":"172.21.15.142:6801","nonce":12842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12842},{"type":"v1","addr":"172.21.15.142:6803","nonce":12842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12842},{"type":"v1","addr":"172.21.15.142:6807","nonce":12842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12842},{"type":"v1","addr":"172.21.15.142:6805","nonce":12842}]},"public_addr":"172.21.15.142:6801/12842","cluster_addr":"172.21.15.142:6803/12842","heartbeat_back_addr":"172.21.15.142:6807/12842","heartbeat_front_addr":"172.21.15.142:6805/12842","state":["exists","up"]},{"osd":5,"uuid":"5a942a47-7346-46d4-adf8-dad2bdb95aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12843},{"type":"v1","addr":"172.21.15.142:6809","nonce":12843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12843},{"type":"v1","addr":"172.21.15.142:6811","nonce":12843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12843},{"type":"v1","addr":"172.21.15.142:6815","nonce":12843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12843},{"type":"v1","addr":"172.21.15.142:6813","nonce":12843}]},"public_addr":"172.21.15.142:6809/12843","cluster_addr":"172.21.15.142:6811/12843","heartbeat_back_addr":"172.21.15.142:6815/12843","heartbeat_front_addr":"172.21.15.142:6813/12843","state":["exists","up"]},{"osd":6,"uuid":"c69fca67-66e4-4c31-ab03-1419e2a83e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12844},{"type":"v1","addr":"172.21.15.142:6818","nonce":12844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":12844},{"type":"v1","addr":"172.21.15.142:6823","nonce":12844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":12844},{"type":"v1","addr":"172.21.15.142:6831","nonce":12844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":12844},{"type":"v1","addr":"172.21.15.142:6827","nonce":12844}]},"public_addr":"172.21.15.142:6818/12844","cluster_addr":"172.21.15.142:6823/12844","heartbeat_back_addr":"172.21.15.142:6831/12844","heartbeat_front_addr":"172.21.15.142:6827/12844","state":["exists","up"]},{"osd":7,"uuid":"c436f64e-aa1f-435b-ac7b-85633e297591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":12845},{"type":"v1","addr":"172.21.15.142:6819","nonce":12845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12845},{"type":"v1","addr":"172.21.15.142:6822","nonce":12845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12845},{"type":"v1","addr":"172.21.15.142:6830","nonce":12845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12845},{"type":"v1","addr":"172.21.15.142:6826","nonce":12845}]},"public_addr":"172.21.15.142:6819/12845","cluster_addr":"172.21.15.142:6822/12845","heartbeat_back_addr":"172.21.15.142:6830/12845","heartbeat_front_addr":"172.21.15.142:6826/12845","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.534744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.505453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.485516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.333028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.483323+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.567824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.273268+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.559741+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-16T05:44:20.612 DEBUG:tasks.mds_thrash:Yielding 2020-01-16T05:44:20.613 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-01-16T05:44:20.644 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-01-16T05:44:20.644 INFO:tasks.ceph_fuse:config is None 2020-01-16T05:44:20.645 INFO:tasks.ceph_fuse:new config is {'client.0': None} 2020-01-16T05:44:20.645 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-01-16T05:44:20.645 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-16T05:44:20.646 INFO:tasks.mds_thrash.fs.[cephfs]:starting mds_do_thrash for fs cephfs 2020-01-16T05:44:20.646 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 52 secs before thrashing 2020-01-16T05:44:20.767 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.759+0000 7f31bf3d0700 1 Processor -- start 2020-01-16T05:44:20.767 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.759+0000 7f31bf3d0700 1 -- start start 2020-01-16T05:44:20.767 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.759+0000 7f31bf3d0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31b807ff10 0x7f31b80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:20.768 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.759+0000 7f31bf3d0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b80a4250 0x7f31b8066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:20.768 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.759+0000 7f31bf3d0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b8066dd0 con 0x7f31b80a9b30 2020-01-16T05:44:20.768 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.759+0000 7f31bf3d0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b80a4830 con 0x7f31b807ff10 2020-01-16T05:44:20.768 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.759+0000 7f31bf3d0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b807f9d0 con 0x7f31b80a4250 2020-01-16T05:44:20.768 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.759+0000 7f31bebcf700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f31b80a9b30 0x7f31b80a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52024/0 (socket says 172.21.15.84:52024) 2020-01-16T05:44:20.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.759+0000 7f31bebcf700 1 -- 172.21.15.84:0/4062357342 learned_addr learned my addr 172.21.15.84:0/4062357342 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:20.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.759+0000 7f31be3ce700 1 --2- 172.21.15.84:0/4062357342 >> v2:172.21.15.84:3300/0 conn(0x7f31b807ff10 0x7f31b80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.759+0000 7f31c0632700 1 --2- 172.21.15.84:0/4062357342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b80a4250 0x7f31b8066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.759+0000 7f31bdbcd700 1 -- 172.21.15.84:0/4062357342 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351048095 0 0) 0x7f31b8066dd0 con 0x7f31b80a9b30 2020-01-16T05:44:20.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.759+0000 7f31bdbcd700 1 -- 172.21.15.84:0/4062357342 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31a0003230 con 0x7f31b80a9b30 2020-01-16T05:44:20.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.759+0000 7f31bdbcd700 1 -- 172.21.15.84:0/4062357342 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 798259744 0 0) 0x7f31a0003230 con 0x7f31b80a9b30 2020-01-16T05:44:20.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bdbcd700 1 -- 172.21.15.84:0/4062357342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b80a4250 msgr2=0x7f31b8066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:20.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bdbcd700 1 --2- 172.21.15.84:0/4062357342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b80a4250 0x7f31b8066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:20.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bdbcd700 1 -- 172.21.15.84:0/4062357342 >> v2:172.21.15.84:3300/0 conn(0x7f31b807ff10 msgr2=0x7f31b80abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:20.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bdbcd700 1 --2- 172.21.15.84:0/4062357342 >> v2:172.21.15.84:3300/0 conn(0x7f31b807ff10 0x7f31b80abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:20.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bdbcd700 1 -- 172.21.15.84:0/4062357342 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b8150ce0 con 0x7f31b80a9b30 2020-01-16T05:44:20.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bdbcd700 1 -- 172.21.15.84:0/4062357342 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f31b0001ad0 con 0x7f31b80a9b30 2020-01-16T05:44:20.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bdbcd700 1 -- 172.21.15.84:0/4062357342 >> v1:172.21.15.84:6789/0 conn(0x7f31b80a9b30 legacy=0x7f31b80a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bdbcd700 1 --2- 172.21.15.84:0/4062357342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31a0003890 0x7f31a0003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:20.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bdbcd700 1 --2- 172.21.15.84:0/4062357342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a00045a0 0x7f31a00049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:20.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bdbcd700 1 --2- 172.21.15.84:0/4062357342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a0004f20 0x7f31a004f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:20.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bdbcd700 1 -- 172.21.15.84:0/4062357342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b80a4830 con 0x7f31a0004f20 2020-01-16T05:44:20.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bdbcd700 1 -- 172.21.15.84:0/4062357342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b807f9d0 con 0x7f31a00045a0 2020-01-16T05:44:20.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bdbcd700 1 -- 172.21.15.84:0/4062357342 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a00053d0 con 0x7f31a0003890 2020-01-16T05:44:20.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31c0632700 1 --2- 172.21.15.84:0/4062357342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a0004f20 0x7f31a004f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bebcf700 1 --2- 172.21.15.84:0/4062357342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31a0003890 0x7f31a0003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31be3ce700 1 --2- 172.21.15.84:0/4062357342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a00045a0 0x7f31a00049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31c0632700 1 -- 172.21.15.84:0/4062357342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31a0003890 msgr2=0x7f31a0003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:20.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31c0632700 1 --2- 172.21.15.84:0/4062357342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31a0003890 0x7f31a0003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:20.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31c0632700 1 -- 172.21.15.84:0/4062357342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a00045a0 msgr2=0x7f31a00049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:20.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31c0632700 1 --2- 172.21.15.84:0/4062357342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a00045a0 0x7f31a00049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:20.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31c0632700 1 -- 172.21.15.84:0/4062357342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a004fe90 con 0x7f31a0004f20 2020-01-16T05:44:20.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31be3ce700 1 --2- 172.21.15.84:0/4062357342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a00045a0 0x7f31a00049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:44:20.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31c0632700 1 --2- 172.21.15.84:0/4062357342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a0004f20 0x7f31a004f800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f31a8002f30 tx=0x7f31a8010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31c0632700 1 --2- 172.21.15.84:0/4062357342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a0004f20 0x7f31a004f800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f31a8002f30 tx=0x7f31a8010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31c0632700 1 --2- 172.21.15.84:0/4062357342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a0004f20 0x7f31a004f800 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7f31a8002f30 tx=0x7f31a8010100).ready entity=mon.0 client_cookie=ed73421e9e2c8b4 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:20.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31c0632700 1 --2- 172.21.15.84:0/4062357342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a0004f20 0x7f31a004f800 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f31a8002f30 tx=0x7f31a8010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bdbcd700 1 -- 172.21.15.84:0/4062357342 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31a8008950 con 0x7f31a0004f20 2020-01-16T05:44:20.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31c0632700 1 --2- 172.21.15.84:0/4062357342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a0004f20 0x7f31a004f800 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f31a8002f30 tx=0x7f31a8010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31c0632700 1 --2- 172.21.15.84:0/4062357342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a0004f20 0x7f31a004f800 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f31a8002f30 tx=0x7f31a8010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bdbcd700 1 -- 172.21.15.84:0/4062357342 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a8010af0 con 0x7f31a0004f20 2020-01-16T05:44:20.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bdbcd700 1 -- 172.21.15.84:0/4062357342 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31a80056c0 con 0x7f31a0004f20 2020-01-16T05:44:20.775 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bf3d0700 1 -- 172.21.15.84:0/4062357342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a0004f20 msgr2=0x7f31a004f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.775 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bf3d0700 1 --2- 172.21.15.84:0/4062357342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a0004f20 0x7f31a004f800 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7f31a8002f30 tx=0x7f31a8010100).stop 2020-01-16T05:44:20.775 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31c0632700 1 -- 172.21.15.84:0/4062357342 reap_dead start 2020-01-16T05:44:20.775 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bf3d0700 1 -- 172.21.15.84:0/4062357342 shutdown_connections 2020-01-16T05:44:20.775 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bf3d0700 1 -- 172.21.15.84:0/4062357342 shutdown_connections 2020-01-16T05:44:20.775 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bf3d0700 1 -- 172.21.15.84:0/4062357342 wait complete. 2020-01-16T05:44:20.776 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.763+0000 7f31bf3d0700 1 -- 172.21.15.84:0/4062357342 >> 172.21.15.84:0/4062357342 conn(0x7f31b80acfc0 msgr2=0x7f31b80a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:20.776 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bf3d0700 1 Processor -- start 2020-01-16T05:44:20.776 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bf3d0700 1 -- start start 2020-01-16T05:44:20.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bf3d0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31b80a8590 0x7f31b80a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:20.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bf3d0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b80a2820 0x7f31b809eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:20.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bf3d0700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b80a1750 con 0x7f31b80a07b0 2020-01-16T05:44:20.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bf3d0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b80a1ae0 con 0x7f31b80a8590 2020-01-16T05:44:20.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bf3d0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b80a1d80 con 0x7f31b80a2820 2020-01-16T05:44:20.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bebcf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31b80a8590 0x7f31b80a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bebcf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31b80a8590 0x7f31b80a0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34836/0 (socket says 172.21.15.84:34836) 2020-01-16T05:44:20.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bebcf700 1 -- 172.21.15.84:0/2161340978 learned_addr learned my addr 172.21.15.84:0/2161340978 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:20.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31c0632700 1 --2- 172.21.15.84:0/2161340978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b80a2820 0x7f31b809eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bebcf700 1 -- 172.21.15.84:0/2161340978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b80a2820 msgr2=0x7f31b809eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bebcf700 1 --2- 172.21.15.84:0/2161340978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b80a2820 0x7f31b809eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bebcf700 1 -- 172.21.15.84:0/2161340978 >> v1:172.21.15.142:6789/0 conn(0x7f31b80a07b0 legacy=0x7f31b80a2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bebcf700 1 -- 172.21.15.84:0/2161340978 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b8091de0 con 0x7f31b80a8590 2020-01-16T05:44:20.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bebcf700 1 --2- 172.21.15.84:0/2161340978 >> v2:172.21.15.84:3300/0 conn(0x7f31b80a8590 0x7f31b80a0260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f31b8132740 tx=0x7f31b00111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bebcf700 1 --2- 172.21.15.84:0/2161340978 >> v2:172.21.15.84:3300/0 conn(0x7f31b80a8590 0x7f31b80a0260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f31b8132740 tx=0x7f31b00111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bebcf700 1 --2- 172.21.15.84:0/2161340978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31b80a8590 0x7f31b80a0260 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7f31b8132740 tx=0x7f31b00111f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:20.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bebcf700 1 --2- 172.21.15.84:0/2161340978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31b80a8590 0x7f31b80a0260 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f31b8132740 tx=0x7f31b00111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bebcf700 1 --2- 172.21.15.84:0/2161340978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31b80a8590 0x7f31b80a0260 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f31b8132740 tx=0x7f31b00111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31b77fe700 1 -- 172.21.15.84:0/2161340978 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31b00054b0 con 0x7f31b80a8590 2020-01-16T05:44:20.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bebcf700 1 --2- 172.21.15.84:0/2161340978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31b80a8590 0x7f31b80a0260 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f31b8132740 tx=0x7f31b00111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31b77fe700 1 -- 172.21.15.84:0/2161340978 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b0012b70 con 0x7f31b80a8590 2020-01-16T05:44:20.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bf3d0700 1 -- 172.21.15.84:0/2161340978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b809f0c0 con 0x7f31b80a8590 2020-01-16T05:44:20.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31b77fe700 1 -- 172.21.15.84:0/2161340978 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31b0005ad0 con 0x7f31b80a8590 2020-01-16T05:44:20.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bf3d0700 1 -- 172.21.15.84:0/2161340978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b809f640 con 0x7f31b80a8590 2020-01-16T05:44:20.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.767+0000 7f31bebcf700 1 --2- 172.21.15.84:0/2161340978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31b80a8590 0x7f31b80a0260 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f31b8132740 tx=0x7f31b00111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.771+0000 7f31b77fe700 1 -- 172.21.15.84:0/2161340978 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f31b000b290 con 0x7f31b80a8590 2020-01-16T05:44:20.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.771+0000 7f31bebcf700 1 --2- 172.21.15.84:0/2161340978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31b80a8590 0x7f31b80a0260 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f31b8132740 tx=0x7f31b00111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.771+0000 7f31bf3d0700 1 -- 172.21.15.84:0/2161340978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b805e1c0 con 0x7f31b80a8590 2020-01-16T05:44:20.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.771+0000 7f31b77fe700 1 --2- 172.21.15.84:0/2161340978 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f319803e4a0 0x7f31980409b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:20.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.771+0000 7f31b77fe700 1 -- 172.21.15.84:0/2161340978 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f31b004cdf0 con 0x7f31b80a8590 2020-01-16T05:44:20.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.771+0000 7f31be3ce700 1 --2- 172.21.15.84:0/2161340978 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f319803e4a0 0x7f31980409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:20.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.771+0000 7f31be3ce700 1 --2- 172.21.15.84:0/2161340978 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f319803e4a0 0x7f31980409b0 crc :-1 s=READY pgs=98 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:20.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.775+0000 7f31bebcf700 1 --2- 172.21.15.84:0/2161340978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31b80a8590 0x7f31b80a0260 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f31b8132740 tx=0x7f31b00111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.775+0000 7f31b77fe700 1 -- 172.21.15.84:0/2161340978 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f31b0033670 con 0x7f31b80a8590 2020-01-16T05:44:20.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.891+0000 7f31bf3d0700 1 -- 172.21.15.84:0/2161340978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31b805cbc0 con 0x7f31b80a8590 2020-01-16T05:44:20.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.895+0000 7f31bebcf700 1 --2- 172.21.15.84:0/2161340978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31b80a8590 0x7f31b80a0260 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f31b8132740 tx=0x7f31b00111f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:20.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.895+0000 7f31b77fe700 1 -- 172.21.15.84:0/2161340978 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14672 (secure 0 0 0) 0x7f31b0005cd0 con 0x7f31b80a8590 2020-01-16T05:44:20.895 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:20.896 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"cbc67508-4d2a-4483-a1fc-95d371063ac4","created":"2020-01-16T05:43:46.771497+0000","modified":"2020-01-16T05:44:05.941278+0000","last_up_change":"2020-01-16T05:43:55.529492+0000","last_in_change":"2020-01-16T05:43:55.529492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-16T05:43:59.152708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-16T05:44:01.682783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-16T05:44:02.930765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15da60bb-4d16-44cc-80c6-cd2c7fa77364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":12644},{"type":"v1","addr":"172.21.15.84:6812","nonce":12644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":12644},{"type":"v1","addr":"172.21.15.84:6816","nonce":12644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":12644},{"type":"v1","addr":"172.21.15.84:6824","nonce":12644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":12644},{"type":"v1","addr":"172.21.15.84:6820","nonce":12644}]},"public_addr":"172.21.15.84:6812/12644","cluster_addr":"172.21.15.84:6816/12644","heartbeat_back_addr":"172.21.15.84:6824/12644","heartbeat_front_addr":"172.21.15.84:6820/12644","state":["exists","up"]},{"osd":1,"uuid":"0800533c-1d5b-4f9f-99bb-34b8133c8b18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":12645},{"type":"v1","addr":"172.21.15.84:6803","nonce":12645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":12645},{"type":"v1","addr":"172.21.15.84:6805","nonce":12645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":12645},{"type":"v1","addr":"172.21.15.84:6809","nonce":12645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":12645},{"type":"v1","addr":"172.21.15.84:6807","nonce":12645}]},"public_addr":"172.21.15.84:6803/12645","cluster_addr":"172.21.15.84:6805/12645","heartbeat_back_addr":"172.21.15.84:6809/12645","heartbeat_front_addr":"172.21.15.84:6807/12645","state":["exists","up"]},{"osd":2,"uuid":"519cc27f-5cf9-4ecf-ad66-f722c37339df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6811","nonce":12646},{"type":"v1","addr":"172.21.15.84:6813","nonce":12646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6815","nonce":12646},{"type":"v1","addr":"172.21.15.84:6817","nonce":12646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":12646},{"type":"v1","addr":"172.21.15.84:6825","nonce":12646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":12646},{"type":"v1","addr":"172.21.15.84:6821","nonce":12646}]},"public_addr":"172.21.15.84:6813/12646","cluster_addr":"172.21.15.84:6817/12646","heartbeat_back_addr":"172.21.15.84:6825/12646","heartbeat_front_addr":"172.21.15.84:6821/12646","state":["exists","up"]},{"osd":3,"uuid":"aec305a6-bbac-4e01-8ea1-6077d49e27e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":12647},{"type":"v1","addr":"172.21.15.84:6827","nonce":12647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":12647},{"type":"v1","addr":"172.21.15.84:6829","nonce":12647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":12647},{"type":"v1","addr":"172.21.15.84:6833","nonce":12647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":12647},{"type":"v1","addr":"172.21.15.84:6831","nonce":12647}]},"public_addr":"172.21.15.84:6827/12647","cluster_addr":"172.21.15.84:6829/12647","heartbeat_back_addr":"172.21.15.84:6833/12647","heartbeat_front_addr":"172.21.15.84:6831/12647","state":["exists","up"]},{"osd":4,"uuid":"aaec7f3e-299a-4546-8406-207bcc4b3afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":12842},{"type":"v1","addr":"172.21.15.142:6801","nonce":12842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12842},{"type":"v1","addr":"172.21.15.142:6803","nonce":12842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12842},{"type":"v1","addr":"172.21.15.142:6807","nonce":12842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12842},{"type":"v1","addr":"172.21.15.142:6805","nonce":12842}]},"public_addr":"172.21.15.142:6801/12842","cluster_addr":"172.21.15.142:6803/12842","heartbeat_back_addr":"172.21.15.142:6807/12842","heartbeat_front_addr":"172.21.15.142:6805/12842","state":["exists","up"]},{"osd":5,"uuid":"5a942a47-7346-46d4-adf8-dad2bdb95aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12843},{"type":"v1","addr":"172.21.15.142:6809","nonce":12843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12843},{"type":"v1","addr":"172.21.15.142:6811","nonce":12843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12843},{"type":"v1","addr":"172.21.15.142:6815","nonce":12843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12843},{"type":"v1","addr":"172.21.15.142:6813","nonce":12843}]},"public_addr":"172.21.15.142:6809/12843","cluster_addr":"172.21.15.142:6811/12843","heartbeat_back_addr":"172.21.15.142:6815/12843","heartbeat_front_addr":"172.21.15.142:6813/12843","state":["exists","up"]},{"osd":6,"uuid":"c69fca67-66e4-4c31-ab03-1419e2a83e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12844},{"type":"v1","addr":"172.21.15.142:6818","nonce":12844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":12844},{"type":"v1","addr":"172.21.15.142:6823","nonce":12844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":12844},{"type":"v1","addr":"172.21.15.142:6831","nonce":12844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":12844},{"type":"v1","addr":"172.21.15.142:6827","nonce":12844}]},"public_addr":"172.21.15.142:6818/12844","cluster_addr":"172.21.15.142:6823/12844","heartbeat_back_addr":"172.21.15.142:6831/12844","heartbeat_front_addr":"172.21.15.142:6827/12844","state":["exists","up"]},{"osd":7,"uuid":"c436f64e-aa1f-435b-ac7b-85633e297591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":12845},{"type":"v1","addr":"172.21.15.142:6819","nonce":12845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12845},{"type":"v1","addr":"172.21.15.142:6822","nonce":12845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12845},{"type":"v1","addr":"172.21.15.142:6830","nonce":12845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12845},{"type":"v1","addr":"172.21.15.142:6826","nonce":12845}]},"public_addr":"172.21.15.142:6819/12845","cluster_addr":"172.21.15.142:6822/12845","heartbeat_back_addr":"172.21.15.142:6830/12845","heartbeat_front_addr":"172.21.15.142:6826/12845","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.534744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.505453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.485516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.333028+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.483323+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.567824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.273268+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-01-16T05:43:53.559741+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-16T05:44:20.897 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.895+0000 7f31bf3d0700 1 -- 172.21.15.84:0/2161340978 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f319803e4a0 msgr2=0x7f31980409b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.897 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.895+0000 7f31bf3d0700 1 --2- 172.21.15.84:0/2161340978 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f319803e4a0 0x7f31980409b0 crc :-1 s=READY pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.897 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.895+0000 7f31bf3d0700 1 -- 172.21.15.84:0/2161340978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31b80a8590 msgr2=0x7f31b80a0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:20.897 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.895+0000 7f31bf3d0700 1 --2- 172.21.15.84:0/2161340978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31b80a8590 0x7f31b80a0260 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7f31b8132740 tx=0x7f31b00111f0).stop 2020-01-16T05:44:20.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.895+0000 7f31bf3d0700 1 -- 172.21.15.84:0/2161340978 shutdown_connections 2020-01-16T05:44:20.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.895+0000 7f31bf3d0700 1 --2- 172.21.15.84:0/2161340978 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f319803e4a0 0x7f31980409b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.895+0000 7f31bf3d0700 1 --2- 172.21.15.84:0/2161340978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b80a2820 0x7f31b809eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.895+0000 7f31bf3d0700 1 --2- 172.21.15.84:0/2161340978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31b80a8590 0x7f31b80a0260 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:20.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.895+0000 7f31bf3d0700 1 -- 172.21.15.84:0/2161340978 shutdown_connections 2020-01-16T05:44:20.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.895+0000 7f31bf3d0700 1 -- 172.21.15.84:0/2161340978 wait complete. 2020-01-16T05:44:20.899 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:20.895+0000 7f31bf3d0700 1 -- 172.21.15.84:0/2161340978 >> 172.21.15.84:0/2161340978 conn(0x7f31b8066880 msgr2=0x7f31b80a4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:20.909 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:43:59.152708+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:44:01.682783+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-16T05:44:02.930765+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-16T05:44:20.910 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-16T05:44:21.043 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97eab9d700 1 Processor -- start 2020-01-16T05:44:21.043 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97eab9d700 1 -- start start 2020-01-16T05:44:21.043 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97eab9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97e40a9b30 0x7f97e40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:21.043 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97eab9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f97e407ff10 0x7f97e4066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:21.044 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97eab9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f97e40a4250 0x7f97e40a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:21.044 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97eab9d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e40a4830 con 0x7f97e407ff10 2020-01-16T05:44:21.044 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97eab9d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e407f9d0 con 0x7f97e40a4250 2020-01-16T05:44:21.044 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97eab9d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e407fc70 con 0x7f97e40a9b30 2020-01-16T05:44:21.044 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97e9b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f97e407ff10 0x7f97e4066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.044 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97e9b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f97e407ff10 0x7f97e4066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34846/0 (socket says 172.21.15.84:34846) 2020-01-16T05:44:21.044 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97e9b9b700 1 -- 172.21.15.84:0/2974396645 learned_addr learned my addr 172.21.15.84:0/2974396645 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:21.044 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97ea39c700 1 --2- 172.21.15.84:0/2974396645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97e40a9b30 0x7f97e40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.045 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97ebdff700 1 --2- 172.21.15.84:0/2974396645 >> v2:172.21.15.142:3300/0 conn(0x7f97e40a4250 0x7f97e40a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.045 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97e9b9b700 1 -- 172.21.15.84:0/2974396645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97e40a9b30 msgr2=0x7f97e40abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:21.045 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/2974396645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97e40a9b30 0x7f97e40abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:21.045 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97e9b9b700 1 -- 172.21.15.84:0/2974396645 >> v2:172.21.15.142:3300/0 conn(0x7f97e40a4250 msgr2=0x7f97e40a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:21.045 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/2974396645 >> v2:172.21.15.142:3300/0 conn(0x7f97e40a4250 0x7f97e40a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:21.045 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97e9b9b700 1 -- 172.21.15.84:0/2974396645 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e4066dd0 con 0x7f97e407ff10 2020-01-16T05:44:21.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/2974396645 >> v2:172.21.15.84:3300/0 conn(0x7f97e407ff10 0x7f97e4066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f97e40a49f0 tx=0x7f97d400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/2974396645 >> v2:172.21.15.84:3300/0 conn(0x7f97e407ff10 0x7f97e4066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f97e40a49f0 tx=0x7f97d400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/2974396645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e407ff10 0x7f97e4066880 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7f97e40a49f0 tx=0x7f97d400ff30).ready entity=mon.0 client_cookie=2c1f3920bb734e server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:21.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/2974396645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e407ff10 0x7f97e4066880 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f97e40a49f0 tx=0x7f97d400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97e939a700 1 -- 172.21.15.84:0/2974396645 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97d4011760 con 0x7f97e407ff10 2020-01-16T05:44:21.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/2974396645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e407ff10 0x7f97e4066880 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f97e40a49f0 tx=0x7f97d400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/2974396645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e407ff10 0x7f97e4066880 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f97e40a49f0 tx=0x7f97d400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97e939a700 1 -- 172.21.15.84:0/2974396645 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d4008d30 con 0x7f97e407ff10 2020-01-16T05:44:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97e939a700 1 -- 172.21.15.84:0/2974396645 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97d4011d40 con 0x7f97e407ff10 2020-01-16T05:44:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97eab9d700 1 -- 172.21.15.84:0/2974396645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e407ff10 msgr2=0x7f97e4066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.039+0000 7f97eab9d700 1 --2- 172.21.15.84:0/2974396645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e407ff10 0x7f97e4066880 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7f97e40a49f0 tx=0x7f97d400ff30).stop 2020-01-16T05:44:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97eab9d700 1 -- 172.21.15.84:0/2974396645 shutdown_connections 2020-01-16T05:44:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97eab9d700 1 --2- 172.21.15.84:0/2974396645 >> v2:172.21.15.142:3300/0 conn(0x7f97e40a4250 0x7f97e40a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97eab9d700 1 --2- 172.21.15.84:0/2974396645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97e40a9b30 0x7f97e40abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:21.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97eab9d700 1 --2- 172.21.15.84:0/2974396645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e407ff10 0x7f97e4066880 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:21.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97eab9d700 1 -- 172.21.15.84:0/2974396645 shutdown_connections 2020-01-16T05:44:21.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97eab9d700 1 -- 172.21.15.84:0/2974396645 wait complete. 2020-01-16T05:44:21.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97eab9d700 1 -- 172.21.15.84:0/2974396645 >> 172.21.15.84:0/2974396645 conn(0x7f97e40acfc0 msgr2=0x7f97e40a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:21.051 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97eab9d700 1 Processor -- start 2020-01-16T05:44:21.051 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97eab9d700 1 -- start start 2020-01-16T05:44:21.051 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97eab9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f97e40a29b0 0x7f97e40a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:21.051 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97eab9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f97e413a040 0x7f97e413c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:21.051 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97eab9d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e40a2de0 con 0x7f97e4127330 2020-01-16T05:44:21.051 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97eab9d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e4127cc0 con 0x7f97e40a29b0 2020-01-16T05:44:21.052 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97eab9d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e40a2710 con 0x7f97e413a040 2020-01-16T05:44:21.052 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97ea39c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f97e4127330 0x7f97e409f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52050/0 (socket says 172.21.15.84:52050) 2020-01-16T05:44:21.052 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97ea39c700 1 -- 172.21.15.84:0/3656254885 learned_addr learned my addr 172.21.15.84:0/3656254885 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:21.052 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/3656254885 >> v2:172.21.15.84:3300/0 conn(0x7f97e40a29b0 0x7f97e40a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.052 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97ebdff700 1 --2- 172.21.15.84:0/3656254885 >> v2:172.21.15.142:3300/0 conn(0x7f97e413a040 0x7f97e413c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.052 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97e9b9b700 1 -- 172.21.15.84:0/3656254885 >> v2:172.21.15.142:3300/0 conn(0x7f97e413a040 msgr2=0x7f97e413c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.052 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/3656254885 >> v2:172.21.15.142:3300/0 conn(0x7f97e413a040 0x7f97e413c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:21.053 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97e9b9b700 1 -- 172.21.15.84:0/3656254885 >> v1:172.21.15.84:6789/0 conn(0x7f97e4127330 legacy=0x7f97e409f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.053 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97e9b9b700 1 -- 172.21.15.84:0/3656254885 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e41279b0 con 0x7f97e40a29b0 2020-01-16T05:44:21.053 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/3656254885 >> v2:172.21.15.84:3300/0 conn(0x7f97e40a29b0 0x7f97e40a19a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f97e40a49f0 tx=0x7f97d40115f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.053 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/3656254885 >> v2:172.21.15.84:3300/0 conn(0x7f97e40a29b0 0x7f97e40a19a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f97e40a49f0 tx=0x7f97d40115f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.053 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/3656254885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e40a29b0 0x7f97e40a19a0 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f97e40a49f0 tx=0x7f97d40115f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:21.053 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/3656254885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e40a29b0 0x7f97e40a19a0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f97e40a49f0 tx=0x7f97d40115f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.053 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.043+0000 7f97daffd700 1 -- 172.21.15.84:0/3656254885 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97d400f760 con 0x7f97e40a29b0 2020-01-16T05:44:21.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.047+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/3656254885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e40a29b0 0x7f97e40a19a0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f97e40a49f0 tx=0x7f97d40115f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.047+0000 7f97daffd700 1 -- 172.21.15.84:0/3656254885 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d4011960 con 0x7f97e40a29b0 2020-01-16T05:44:21.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.047+0000 7f97eab9d700 1 -- 172.21.15.84:0/3656254885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e409fc90 con 0x7f97e40a29b0 2020-01-16T05:44:21.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.047+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/3656254885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e40a29b0 0x7f97e40a19a0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f97e40a49f0 tx=0x7f97d40115f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.047+0000 7f97daffd700 1 -- 172.21.15.84:0/3656254885 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97d4007530 con 0x7f97e40a29b0 2020-01-16T05:44:21.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.047+0000 7f97eab9d700 1 -- 172.21.15.84:0/3656254885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e40a87f0 con 0x7f97e40a29b0 2020-01-16T05:44:21.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.047+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/3656254885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e40a29b0 0x7f97e40a19a0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f97e40a49f0 tx=0x7f97d40115f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.047+0000 7f97eab9d700 1 -- 172.21.15.84:0/3656254885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e405e1c0 con 0x7f97e40a29b0 2020-01-16T05:44:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.047+0000 7f97daffd700 1 -- 172.21.15.84:0/3656254885 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f97d40056c0 con 0x7f97e40a29b0 2020-01-16T05:44:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.047+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/3656254885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e40a29b0 0x7f97e40a19a0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f97e40a49f0 tx=0x7f97d40115f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.047+0000 7f97daffd700 1 --2- 172.21.15.84:0/3656254885 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f97cc03c210 0x7f97cc03e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.047+0000 7f97daffd700 1 -- 172.21.15.84:0/3656254885 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f97d40910b0 con 0x7f97e40a29b0 2020-01-16T05:44:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.047+0000 7f97ea39c700 1 --2- 172.21.15.84:0/3656254885 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f97cc03c210 0x7f97cc03e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.047+0000 7f97ea39c700 1 --2- 172.21.15.84:0/3656254885 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f97cc03c210 0x7f97cc03e720 crc :-1 s=READY pgs=99 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.055+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/3656254885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e40a29b0 0x7f97e40a19a0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f97e40a49f0 tx=0x7f97d40115f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.055+0000 7f97daffd700 1 -- 172.21.15.84:0/3656254885 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f97d4094de0 con 0x7f97e40a29b0 2020-01-16T05:44:21.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.167+0000 7f97eab9d700 1 -- 172.21.15.84:0/3656254885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f97e4127e80 con 0x7f97e40a29b0 2020-01-16T05:44:21.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.167+0000 7f97e9b9b700 1 --2- 172.21.15.84:0/3656254885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e40a29b0 0x7f97e40a19a0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f97e40a49f0 tx=0x7f97d40115f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.167+0000 7f97daffd700 1 -- 172.21.15.84:0/3656254885 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f97d40776b0 con 0x7f97e40a29b0 2020-01-16T05:44:21.170 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:21.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.171+0000 7f97eab9d700 1 -- 172.21.15.84:0/3656254885 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f97cc03c210 msgr2=0x7f97cc03e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.171+0000 7f97eab9d700 1 --2- 172.21.15.84:0/3656254885 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f97cc03c210 0x7f97cc03e720 crc :-1 s=READY pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:21.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.171+0000 7f97eab9d700 1 -- 172.21.15.84:0/3656254885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e40a29b0 msgr2=0x7f97e40a19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.171+0000 7f97eab9d700 1 --2- 172.21.15.84:0/3656254885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e40a29b0 0x7f97e40a19a0 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f97e40a49f0 tx=0x7f97d40115f0).stop 2020-01-16T05:44:21.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.171+0000 7f97eab9d700 1 -- 172.21.15.84:0/3656254885 shutdown_connections 2020-01-16T05:44:21.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.171+0000 7f97eab9d700 1 --2- 172.21.15.84:0/3656254885 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f97cc03c210 0x7f97cc03e720 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:21.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.171+0000 7f97eab9d700 1 --2- 172.21.15.84:0/3656254885 >> v2:172.21.15.142:3300/0 conn(0x7f97e413a040 0x7f97e413c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:21.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.171+0000 7f97eab9d700 1 --2- 172.21.15.84:0/3656254885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e40a29b0 0x7f97e40a19a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:21.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.171+0000 7f97eab9d700 1 -- 172.21.15.84:0/3656254885 shutdown_connections 2020-01-16T05:44:21.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.171+0000 7f97eab9d700 1 -- 172.21.15.84:0/3656254885 wait complete. 2020-01-16T05:44:21.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.171+0000 7f97eab9d700 1 -- 172.21.15.84:0/3656254885 >> 172.21.15.84:0/3656254885 conn(0x7f97e4066650 msgr2=0x7f97e407dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:21.182 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-01-16T05:44:21.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe46759e700 1 Processor -- start 2020-01-16T05:44:21.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe46759e700 1 -- start start 2020-01-16T05:44:21.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe46759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe4680a9b30 0x7fe4680abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:21.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe46759e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe468066880 con 0x7fe46807ff10 2020-01-16T05:44:21.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe46759e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe468066ab0 con 0x7fe4680a4250 2020-01-16T05:44:21.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe46759e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4680a4830 con 0x7fe4680a9b30 2020-01-16T05:44:21.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe46659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe46807ff10 0x7fe4680a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52060/0 (socket says 172.21.15.84:52060) 2020-01-16T05:44:21.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe46659c700 1 -- 172.21.15.84:0/869322567 learned_addr learned my addr 172.21.15.84:0/869322567 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:21.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe466d9d700 1 --2- 172.21.15.84:0/869322567 >> v2:172.21.15.142:3300/0 conn(0x7fe4680a9b30 0x7fe4680abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe465d9b700 1 -- 172.21.15.84:0/869322567 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813016804 0 0) 0x7fe468066880 con 0x7fe46807ff10 2020-01-16T05:44:21.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe465d9b700 1 -- 172.21.15.84:0/869322567 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe454003230 con 0x7fe46807ff10 2020-01-16T05:44:21.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe465d9b700 1 -- 172.21.15.84:0/869322567 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3286165465 0 0) 0x7fe454003230 con 0x7fe46807ff10 2020-01-16T05:44:21.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe465d9b700 1 -- 172.21.15.84:0/869322567 >> v2:172.21.15.142:3300/0 conn(0x7fe4680a9b30 msgr2=0x7fe4680abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:21.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe465d9b700 1 --2- 172.21.15.84:0/869322567 >> v2:172.21.15.142:3300/0 conn(0x7fe4680a9b30 0x7fe4680abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:21.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe465d9b700 1 -- 172.21.15.84:0/869322567 >> v1:172.21.15.142:6789/0 conn(0x7fe4680a4250 legacy=0x7fe46814fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe465d9b700 1 -- 172.21.15.84:0/869322567 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe468066ce0 con 0x7fe46807ff10 2020-01-16T05:44:21.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe465d9b700 1 -- 172.21.15.84:0/869322567 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7fe450001ad0 con 0x7fe46807ff10 2020-01-16T05:44:21.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe465d9b700 1 -- 172.21.15.84:0/869322567 >> v1:172.21.15.84:6789/0 conn(0x7fe46807ff10 legacy=0x7fe4680a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe465d9b700 1 --2- 172.21.15.84:0/869322567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe454003860 0x7fe454003cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:21.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe465d9b700 1 --2- 172.21.15.84:0/869322567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4540045a0 0x7fe4540049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:21.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe465d9b700 1 --2- 172.21.15.84:0/869322567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe454004f20 0x7fe45400b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:21.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe465d9b700 1 -- 172.21.15.84:0/869322567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680a4830 con 0x7fe454003860 2020-01-16T05:44:21.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe465d9b700 1 -- 172.21.15.84:0/869322567 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45404fde0 con 0x7fe454004f20 2020-01-16T05:44:21.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe466d9d700 1 --2- 172.21.15.84:0/869322567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe454003860 0x7fe454003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe465d9b700 1 -- 172.21.15.84:0/869322567 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe454050020 con 0x7fe4540045a0 2020-01-16T05:44:21.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe46c9b1700 1 --2- 172.21.15.84:0/869322567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe454004f20 0x7fe45400b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe46659c700 1 --2- 172.21.15.84:0/869322567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4540045a0 0x7fe4540049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe466d9d700 1 -- 172.21.15.84:0/869322567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4540045a0 msgr2=0x7fe4540049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:21.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe466d9d700 1 --2- 172.21.15.84:0/869322567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4540045a0 0x7fe4540049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:21.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe466d9d700 1 -- 172.21.15.84:0/869322567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe454004f20 msgr2=0x7fe45400b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:21.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe466d9d700 1 --2- 172.21.15.84:0/869322567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe454004f20 0x7fe45400b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:21.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe46c9b1700 1 -- 172.21.15.84:0/869322567 reap_dead start 2020-01-16T05:44:21.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe466d9d700 1 -- 172.21.15.84:0/869322567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe454050320 con 0x7fe454003860 2020-01-16T05:44:21.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe466d9d700 1 --2- 172.21.15.84:0/869322567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe454003860 0x7fe454003cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe460002f30 tx=0x7fe460010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe466d9d700 1 --2- 172.21.15.84:0/869322567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe454003860 0x7fe454003cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe460002f30 tx=0x7fe460010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe466d9d700 1 --2- 172.21.15.84:0/869322567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe454003860 0x7fe454003cd0 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7fe460002f30 tx=0x7fe460010160).ready entity=mon.0 client_cookie=2aeceabda49b829b server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:21.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe466d9d700 1 --2- 172.21.15.84:0/869322567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe454003860 0x7fe454003cd0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7fe460002f30 tx=0x7fe460010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe465d9b700 1 -- 172.21.15.84:0/869322567 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe460008950 con 0x7fe454003860 2020-01-16T05:44:21.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe466d9d700 1 --2- 172.21.15.84:0/869322567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe454003860 0x7fe454003cd0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7fe460002f30 tx=0x7fe460010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe465d9b700 1 -- 172.21.15.84:0/869322567 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe460010ab0 con 0x7fe454003860 2020-01-16T05:44:21.314 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe466d9d700 1 --2- 172.21.15.84:0/869322567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe454003860 0x7fe454003cd0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7fe460002f30 tx=0x7fe460010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.314 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe465d9b700 1 -- 172.21.15.84:0/869322567 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4600056c0 con 0x7fe454003860 2020-01-16T05:44:21.314 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe46759e700 1 -- 172.21.15.84:0/869322567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe454003860 msgr2=0x7fe454003cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.314 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.303+0000 7fe46759e700 1 --2- 172.21.15.84:0/869322567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe454003860 0x7fe454003cd0 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7fe460002f30 tx=0x7fe460010160).stop 2020-01-16T05:44:21.314 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.307+0000 7fe46759e700 1 -- 172.21.15.84:0/869322567 shutdown_connections 2020-01-16T05:44:21.314 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.307+0000 7fe46759e700 1 --2- 172.21.15.84:0/869322567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe454003860 0x7fe454003cd0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:21.314 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.307+0000 7fe46759e700 1 -- 172.21.15.84:0/869322567 shutdown_connections 2020-01-16T05:44:21.315 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.307+0000 7fe46759e700 1 -- 172.21.15.84:0/869322567 wait complete. 2020-01-16T05:44:21.315 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.307+0000 7fe46759e700 1 -- 172.21.15.84:0/869322567 >> 172.21.15.84:0/869322567 conn(0x7fe4680acfc0 msgr2=0x7fe4680a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:21.318 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.307+0000 7fe46759e700 1 Processor -- start 2020-01-16T05:44:21.318 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.307+0000 7fe46759e700 1 -- start start 2020-01-16T05:44:21.318 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.307+0000 7fe46759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe46809fa80 0x7fe468123220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:21.318 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.307+0000 7fe46759e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe46805f350 con 0x7fe4680a82e0 2020-01-16T05:44:21.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.307+0000 7fe46759e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4681248a0 con 0x7fe4680a8710 2020-01-16T05:44:21.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.307+0000 7fe46759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680a8c70 con 0x7fe46809fa80 2020-01-16T05:44:21.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe466d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe4680a82e0 0x7fe46809f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52070/0 (socket says 172.21.15.84:52070) 2020-01-16T05:44:21.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe466d9d700 1 -- 172.21.15.84:0/1757152128 learned_addr learned my addr 172.21.15.84:0/1757152128 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:21.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe46659c700 1 --2- 172.21.15.84:0/1757152128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe46809fa80 0x7fe468123220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe45f7fe700 1 -- 172.21.15.84:0/1757152128 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661050368 0 0) 0x7fe46805f350 con 0x7fe4680a82e0 2020-01-16T05:44:21.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe45f7fe700 1 -- 172.21.15.84:0/1757152128 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe44c003230 con 0x7fe4680a82e0 2020-01-16T05:44:21.320 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe45f7fe700 1 -- 172.21.15.84:0/1757152128 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323996655 0 0) 0x7fe4681248a0 con 0x7fe4680a8710 2020-01-16T05:44:21.320 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe45f7fe700 1 -- 172.21.15.84:0/1757152128 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe46805f350 con 0x7fe4680a8710 2020-01-16T05:44:21.320 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe45f7fe700 1 -- 172.21.15.84:0/1757152128 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 480537517 0 0) 0x7fe46805f350 con 0x7fe4680a8710 2020-01-16T05:44:21.320 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe46659c700 1 -- 172.21.15.84:0/1757152128 >> v1:172.21.15.142:6789/0 conn(0x7fe4680a8710 legacy=0x7fe468123770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.320 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe46659c700 1 -- 172.21.15.84:0/1757152128 >> v1:172.21.15.84:6789/0 conn(0x7fe4680a82e0 legacy=0x7fe46809f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.320 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe46659c700 1 -- 172.21.15.84:0/1757152128 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46813f040 con 0x7fe46809fa80 2020-01-16T05:44:21.320 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe46659c700 1 --2- 172.21.15.84:0/1757152128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe46809fa80 0x7fe468123220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe458001170 tx=0x7fe46000fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.321 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe46659c700 1 --2- 172.21.15.84:0/1757152128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe46809fa80 0x7fe468123220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe458001170 tx=0x7fe46000fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.321 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe46659c700 1 --2- 172.21.15.84:0/1757152128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe46809fa80 0x7fe468123220 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7fe458001170 tx=0x7fe46000fcf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:21.321 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe46659c700 1 --2- 172.21.15.84:0/1757152128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe46809fa80 0x7fe468123220 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fe458001170 tx=0x7fe46000fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.321 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe45f7fe700 1 -- 172.21.15.84:0/1757152128 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4580020f0 con 0x7fe46809fa80 2020-01-16T05:44:21.321 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe46659c700 1 --2- 172.21.15.84:0/1757152128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe46809fa80 0x7fe468123220 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fe458001170 tx=0x7fe46000fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.321 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe45f7fe700 1 -- 172.21.15.84:0/1757152128 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe458001f00 con 0x7fe46809fa80 2020-01-16T05:44:21.322 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe46659c700 1 --2- 172.21.15.84:0/1757152128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe46809fa80 0x7fe468123220 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fe458001170 tx=0x7fe46000fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.322 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe46759e700 1 -- 172.21.15.84:0/1757152128 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe46813d020 con 0x7fe46809fa80 2020-01-16T05:44:21.322 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe45f7fe700 1 -- 172.21.15.84:0/1757152128 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe450004870 con 0x7fe46809fa80 2020-01-16T05:44:21.322 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe46759e700 1 -- 172.21.15.84:0/1757152128 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe46813d570 con 0x7fe46809fa80 2020-01-16T05:44:21.322 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe46659c700 1 --2- 172.21.15.84:0/1757152128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe46809fa80 0x7fe468123220 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fe458001170 tx=0x7fe46000fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.322 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe45f7fe700 1 -- 172.21.15.84:0/1757152128 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fe450004b10 con 0x7fe46809fa80 2020-01-16T05:44:21.322 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe46659c700 1 --2- 172.21.15.84:0/1757152128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe46809fa80 0x7fe468123220 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fe458001170 tx=0x7fe46000fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.323 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe45f7fe700 1 --2- 172.21.15.84:0/1757152128 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe44c03c990 0x7fe44c03eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:21.323 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe46759e700 1 -- 172.21.15.84:0/1757152128 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46805e1c0 con 0x7fe46809fa80 2020-01-16T05:44:21.323 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe45f7fe700 1 -- 172.21.15.84:0/1757152128 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7fe45004c400 con 0x7fe46809fa80 2020-01-16T05:44:21.323 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.311+0000 7fe466d9d700 1 --2- 172.21.15.84:0/1757152128 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe44c03c990 0x7fe44c03eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.323 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.315+0000 7fe466d9d700 1 --2- 172.21.15.84:0/1757152128 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe44c03c990 0x7fe44c03eea0 crc :-1 s=READY pgs=100 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:21.324 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.319+0000 7fe46659c700 1 --2- 172.21.15.84:0/1757152128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe46809fa80 0x7fe468123220 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fe458001170 tx=0x7fe46000fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.324 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.319+0000 7fe45f7fe700 1 -- 172.21.15.84:0/1757152128 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fe450032a00 con 0x7fe46809fa80 2020-01-16T05:44:21.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.439+0000 7fe46759e700 1 -- 172.21.15.84:0/1757152128 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe46805cbc0 con 0x7fe46809fa80 2020-01-16T05:44:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.439+0000 7fe46659c700 1 --2- 172.21.15.84:0/1757152128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe46809fa80 0x7fe468123220 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fe458001170 tx=0x7fe46000fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.439+0000 7fe45f7fe700 1 -- 172.21.15.84:0/1757152128 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe450001530 con 0x7fe46809fa80 2020-01-16T05:44:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.443+0000 7fe46759e700 1 -- 172.21.15.84:0/1757152128 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe44c03c990 msgr2=0x7fe44c03eea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.443+0000 7fe46759e700 1 --2- 172.21.15.84:0/1757152128 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe44c03c990 0x7fe44c03eea0 crc :-1 s=READY pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.443+0000 7fe46759e700 1 -- 172.21.15.84:0/1757152128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe46809fa80 msgr2=0x7fe468123220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.443+0000 7fe46759e700 1 --2- 172.21.15.84:0/1757152128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe46809fa80 0x7fe468123220 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7fe458001170 tx=0x7fe46000fcf0).stop 2020-01-16T05:44:21.449 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.443+0000 7fe46759e700 1 -- 172.21.15.84:0/1757152128 shutdown_connections 2020-01-16T05:44:21.458 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.443+0000 7fe46759e700 1 --2- 172.21.15.84:0/1757152128 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe44c03c990 0x7fe44c03eea0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:21.458 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.443+0000 7fe46759e700 1 --2- 172.21.15.84:0/1757152128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe46809fa80 0x7fe468123220 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:21.458 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.443+0000 7fe46759e700 1 -- 172.21.15.84:0/1757152128 shutdown_connections 2020-01-16T05:44:21.458 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.443+0000 7fe46759e700 1 -- 172.21.15.84:0/1757152128 wait complete. 2020-01-16T05:44:21.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.443+0000 7fe46759e700 1 -- 172.21.15.84:0/1757152128 >> 172.21.15.84:0/1757152128 conn(0x7fe4680a9b30 msgr2=0x7fe468024b20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:21.459 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:21.460 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-01-16T05:44:21.602 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.579+0000 7fefb3fff700 1 Processor -- start 2020-01-16T05:44:21.602 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.579+0000 7fefb3fff700 1 -- start start 2020-01-16T05:44:21.602 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.579+0000 7fefb3fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefb40a9b30 0x7fefb40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:21.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.579+0000 7fefb3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fefb40a4250 0x7fefb4066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:21.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.579+0000 7fefb3fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb4066dd0 con 0x7fefb407ff10 2020-01-16T05:44:21.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.579+0000 7fefb3fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb40a4830 con 0x7fefb40a4250 2020-01-16T05:44:21.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.579+0000 7fefb3fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb407f9d0 con 0x7fefb40a9b30 2020-01-16T05:44:21.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb9953700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fefb40a4250 0x7fefb4066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.604 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb9953700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fefb40a4250 0x7fefb4066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34882/0 (socket says 172.21.15.84:34882) 2020-01-16T05:44:21.604 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb9953700 1 -- 172.21.15.84:0/2957228116 learned_addr learned my addr 172.21.15.84:0/2957228116 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:44:21.604 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb37fe700 1 --2- 172.21.15.84:0/2957228116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefb40a9b30 0x7fefb40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.604 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb9953700 1 -- 172.21.15.84:0/2957228116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefb40a9b30 msgr2=0x7fefb40abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:44:21.604 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb9953700 1 --2- 172.21.15.84:0/2957228116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefb40a9b30 0x7fefb40abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:21.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb9953700 1 -- 172.21.15.84:0/2957228116 >> v1:172.21.15.142:6789/0 conn(0x7fefb407ff10 legacy=0x7fefb40a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb9953700 1 -- 172.21.15.84:0/2957228116 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb4150ce0 con 0x7fefb40a4250 2020-01-16T05:44:21.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb9953700 1 --2- 172.21.15.84:0/2957228116 >> v2:172.21.15.84:3300/0 conn(0x7fefb40a4250 0x7fefb4066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fefac008910 tx=0x7fefac00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb9953700 1 --2- 172.21.15.84:0/2957228116 >> v2:172.21.15.84:3300/0 conn(0x7fefb40a4250 0x7fefb4066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fefac008910 tx=0x7fefac00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb9953700 1 --2- 172.21.15.84:0/2957228116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb40a4250 0x7fefb4066880 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7fefac008910 tx=0x7fefac00feb0).ready entity=mon.0 client_cookie=d0b8e48872674f8b server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:21.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb9953700 1 --2- 172.21.15.84:0/2957228116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb40a4250 0x7fefb4066880 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7fefac008910 tx=0x7fefac00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb27fc700 1 -- 172.21.15.84:0/2957228116 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefac011720 con 0x7fefb40a4250 2020-01-16T05:44:21.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb9953700 1 --2- 172.21.15.84:0/2957228116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb40a4250 0x7fefb4066880 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7fefac008910 tx=0x7fefac00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb27fc700 1 -- 172.21.15.84:0/2957228116 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac008d30 con 0x7fefb40a4250 2020-01-16T05:44:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb9953700 1 --2- 172.21.15.84:0/2957228116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb40a4250 0x7fefb4066880 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7fefac008910 tx=0x7fefac00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb27fc700 1 -- 172.21.15.84:0/2957228116 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefac011d00 con 0x7fefb40a4250 2020-01-16T05:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb3fff700 1 -- 172.21.15.84:0/2957228116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb40a4250 msgr2=0x7fefb4066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb3fff700 1 --2- 172.21.15.84:0/2957228116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb40a4250 0x7fefb4066880 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7fefac008910 tx=0x7fefac00feb0).stop 2020-01-16T05:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb3fff700 1 -- 172.21.15.84:0/2957228116 shutdown_connections 2020-01-16T05:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb3fff700 1 --2- 172.21.15.84:0/2957228116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb40a4250 0x7fefb4066880 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb3fff700 1 --2- 172.21.15.84:0/2957228116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefb40a9b30 0x7fefb40abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:44:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb3fff700 1 -- 172.21.15.84:0/2957228116 shutdown_connections 2020-01-16T05:44:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb3fff700 1 -- 172.21.15.84:0/2957228116 wait complete. 2020-01-16T05:44:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.583+0000 7fefb3fff700 1 -- 172.21.15.84:0/2957228116 >> 172.21.15.84:0/2957228116 conn(0x7fefb40acfc0 msgr2=0x7fefb40a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb3fff700 1 Processor -- start 2020-01-16T05:44:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb3fff700 1 -- start start 2020-01-16T05:44:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fefb413e2e0 0x7fefb4140720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb3fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb4128020 con 0x7fefb405bef0 2020-01-16T05:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb3fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb4127cc0 con 0x7fefb40a5f60 2020-01-16T05:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb3fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb40a5d30 con 0x7fefb413e2e0 2020-01-16T05:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb2ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fefb405bef0 0x7fefb40a81d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52086/0 (socket says 172.21.15.84:52086) 2020-01-16T05:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb2ffd700 1 -- 172.21.15.84:0/4044099225 learned_addr learned my addr 172.21.15.84:0/4044099225 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb9953700 1 --2- 172.21.15.84:0/4044099225 >> v2:172.21.15.84:3300/0 conn(0x7fefb413e2e0 0x7fefb4140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fef9bfff700 1 -- 172.21.15.84:0/4044099225 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873053406 0 0) 0x7fefb4128020 con 0x7fefb405bef0 2020-01-16T05:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fef9bfff700 1 -- 172.21.15.84:0/4044099225 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef94003230 con 0x7fefb405bef0 2020-01-16T05:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb9953700 1 -- 172.21.15.84:0/4044099225 >> v1:172.21.15.142:6789/0 conn(0x7fefb40a5f60 legacy=0x7fefb409f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb9953700 1 -- 172.21.15.84:0/4044099225 >> v1:172.21.15.84:6789/0 conn(0x7fefb405bef0 legacy=0x7fefb40a81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fef9bfff700 1 -- 172.21.15.84:0/4044099225 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169430638 0 0) 0x7fefb4127cc0 con 0x7fefb40a5f60 2020-01-16T05:44:21.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb9953700 1 -- 172.21.15.84:0/4044099225 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb40a89d0 con 0x7fefb413e2e0 2020-01-16T05:44:21.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb9953700 1 --2- 172.21.15.84:0/4044099225 >> v2:172.21.15.84:3300/0 conn(0x7fefb413e2e0 0x7fefb4140720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fefb407f620 tx=0x7fefac011760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb9953700 1 --2- 172.21.15.84:0/4044099225 >> v2:172.21.15.84:3300/0 conn(0x7fefb413e2e0 0x7fefb4140720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fefb407f620 tx=0x7fefac011760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb9953700 1 --2- 172.21.15.84:0/4044099225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb413e2e0 0x7fefb4140720 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7fefb407f620 tx=0x7fefac011760).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:21.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb9953700 1 --2- 172.21.15.84:0/4044099225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb413e2e0 0x7fefb4140720 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fefb407f620 tx=0x7fefac011760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fef9bfff700 1 -- 172.21.15.84:0/4044099225 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefac00f760 con 0x7fefb413e2e0 2020-01-16T05:44:21.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb9953700 1 --2- 172.21.15.84:0/4044099225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb413e2e0 0x7fefb4140720 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fefb407f620 tx=0x7fefac011760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb9953700 1 --2- 172.21.15.84:0/4044099225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb413e2e0 0x7fefb4140720 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fefb407f620 tx=0x7fefac011760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fef9bfff700 1 -- 172.21.15.84:0/4044099225 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac011920 con 0x7fefb413e2e0 2020-01-16T05:44:21.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb3fff700 1 -- 172.21.15.84:0/4044099225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb4140c70 con 0x7fefb413e2e0 2020-01-16T05:44:21.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fef9bfff700 1 -- 172.21.15.84:0/4044099225 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefac007530 con 0x7fefb413e2e0 2020-01-16T05:44:21.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb3fff700 1 -- 172.21.15.84:0/4044099225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb4141140 con 0x7fefb413e2e0 2020-01-16T05:44:21.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb9953700 1 --2- 172.21.15.84:0/4044099225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb413e2e0 0x7fefb4140720 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fefb407f620 tx=0x7fefac011760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fef9bfff700 1 -- 172.21.15.84:0/4044099225 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fefac0056c0 con 0x7fefb413e2e0 2020-01-16T05:44:21.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb9953700 1 --2- 172.21.15.84:0/4044099225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb413e2e0 0x7fefb4140720 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fefb407f620 tx=0x7fefac011760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fef9bfff700 1 --2- 172.21.15.84:0/4044099225 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fef9403c790 0x7fef9403eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:21.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fef9bfff700 1 -- 172.21.15.84:0/4044099225 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7fefac04ce60 con 0x7fefb413e2e0 2020-01-16T05:44:21.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb3fff700 1 -- 172.21.15.84:0/4044099225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb405e1c0 con 0x7fefb413e2e0 2020-01-16T05:44:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.587+0000 7fefb37fe700 1 --2- 172.21.15.84:0/4044099225 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fef9403c790 0x7fef9403eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.591+0000 7fefb37fe700 1 --2- 172.21.15.84:0/4044099225 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fef9403c790 0x7fef9403eca0 crc :-1 s=READY pgs=101 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.595+0000 7fefb9953700 1 --2- 172.21.15.84:0/4044099225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb413e2e0 0x7fefb4140720 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fefb407f620 tx=0x7fefac011760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.595+0000 7fef9bfff700 1 -- 172.21.15.84:0/4044099225 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fefac033480 con 0x7fefb413e2e0 2020-01-16T05:44:21.712 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.711+0000 7fefb3fff700 1 -- 172.21.15.84:0/4044099225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fefb405cbc0 con 0x7fefb413e2e0 2020-01-16T05:44:21.713 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.711+0000 7fefb9953700 1 --2- 172.21.15.84:0/4044099225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb413e2e0 0x7fefb4140720 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fefb407f620 tx=0x7fefac011760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.713 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.711+0000 7fef9bfff700 1 -- 172.21.15.84:0/4044099225 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7fefac0336e0 con 0x7fefb413e2e0 2020-01-16T05:44:21.714 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2020-01-16T05:44:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.715+0000 7fefb3fff700 1 -- 172.21.15.84:0/4044099225 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fef9403c790 msgr2=0x7fef9403eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.715+0000 7fefb3fff700 1 --2- 172.21.15.84:0/4044099225 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fef9403c790 0x7fef9403eca0 crc :-1 s=READY pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.715+0000 7fefb3fff700 1 -- 172.21.15.84:0/4044099225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb413e2e0 msgr2=0x7fefb4140720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.715+0000 7fefb3fff700 1 --2- 172.21.15.84:0/4044099225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb413e2e0 0x7fefb4140720 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7fefb407f620 tx=0x7fefac011760).stop 2020-01-16T05:44:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.715+0000 7fefb3fff700 1 -- 172.21.15.84:0/4044099225 shutdown_connections 2020-01-16T05:44:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.715+0000 7fefb3fff700 1 --2- 172.21.15.84:0/4044099225 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fef9403c790 0x7fef9403eca0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.715+0000 7fefb3fff700 1 --2- 172.21.15.84:0/4044099225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb413e2e0 0x7fefb4140720 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.715+0000 7fefb3fff700 1 -- 172.21.15.84:0/4044099225 shutdown_connections 2020-01-16T05:44:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.715+0000 7fefb3fff700 1 -- 172.21.15.84:0/4044099225 wait complete. 2020-01-16T05:44:21.718 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.715+0000 7fefb3fff700 1 -- 172.21.15.84:0/4044099225 >> 172.21.15.84:0/4044099225 conn(0x7fefb40ab870 msgr2=0x7fefb407cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:21.726 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-01-16T05:44:21.726 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:44:21.843 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f2f66700 1 Processor -- start 2020-01-16T05:44:21.844 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f2f66700 1 -- start start 2020-01-16T05:44:21.844 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f2f66700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f47ec0a4250 0x7f47ec0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:44:21.844 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f2f66700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ec066880 con 0x7f47ec0a9b30 2020-01-16T05:44:21.844 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f2f66700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ec066ab0 con 0x7f47ec07ff10 2020-01-16T05:44:21.845 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f2f66700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ec0a4830 con 0x7f47ec0a4250 2020-01-16T05:44:21.845 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f2765700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f47ec0a9b30 0x7f47ec0a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52092/0 (socket says 172.21.15.84:52092) 2020-01-16T05:44:21.845 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f2765700 1 -- 172.21.15.84:0/562236444 learned_addr learned my addr 172.21.15.84:0/562236444 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:21.845 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f41c8700 1 --2- 172.21.15.84:0/562236444 >> v2:172.21.15.142:3300/0 conn(0x7f47ec0a4250 0x7f47ec0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.845 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f1763700 1 -- 172.21.15.84:0/562236444 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554122121 0 0) 0x7f47ec066880 con 0x7f47ec0a9b30 2020-01-16T05:44:21.846 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f1763700 1 -- 172.21.15.84:0/562236444 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47dc003230 con 0x7f47ec0a9b30 2020-01-16T05:44:21.846 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f1763700 1 -- 172.21.15.84:0/562236444 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949888497 0 0) 0x7f47ec066ab0 con 0x7f47ec07ff10 2020-01-16T05:44:21.846 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f1763700 1 -- 172.21.15.84:0/562236444 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47ec066880 con 0x7f47ec07ff10 2020-01-16T05:44:21.846 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f1763700 1 -- 172.21.15.84:0/562236444 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 596649722 0 0) 0x7f47dc003230 con 0x7f47ec0a9b30 2020-01-16T05:44:21.846 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f41c8700 1 -- 172.21.15.84:0/562236444 >> v1:172.21.15.142:6789/0 conn(0x7f47ec07ff10 legacy=0x7f47ec14dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.846 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f41c8700 1 -- 172.21.15.84:0/562236444 >> v1:172.21.15.84:6789/0 conn(0x7f47ec0a9b30 legacy=0x7f47ec0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.847 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f41c8700 1 -- 172.21.15.84:0/562236444 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec066ce0 con 0x7f47ec0a4250 2020-01-16T05:44:21.847 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f41c8700 1 --2- 172.21.15.84:0/562236444 >> v2:172.21.15.142:3300/0 conn(0x7f47ec0a4250 0x7f47ec0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f47e4008910 tx=0x7f47e0001cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.847 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f41c8700 1 --2- 172.21.15.84:0/562236444 >> v2:172.21.15.142:3300/0 conn(0x7f47ec0a4250 0x7f47ec0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f47e4008910 tx=0x7f47e0001cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.847 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f41c8700 1 --2- 172.21.15.84:0/562236444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47ec0a4250 0x7f47ec0abdd0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f47e4008910 tx=0x7f47e0001cd0).ready entity=mon.1 client_cookie=f2c6f2eafbd44418 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:21.847 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f41c8700 1 --2- 172.21.15.84:0/562236444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47ec0a4250 0x7f47ec0abdd0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f47e4008910 tx=0x7f47e0001cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.848 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f1763700 1 -- 172.21.15.84:0/562236444 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47e0001ad0 con 0x7f47ec0a4250 2020-01-16T05:44:21.848 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f41c8700 1 --2- 172.21.15.84:0/562236444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47ec0a4250 0x7f47ec0abdd0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f47e4008910 tx=0x7f47e0001cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.848 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f1763700 1 -- 172.21.15.84:0/562236444 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e00018e0 con 0x7f47ec0a4250 2020-01-16T05:44:21.848 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f41c8700 1 --2- 172.21.15.84:0/562236444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47ec0a4250 0x7f47ec0abdd0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f47e4008910 tx=0x7f47e0001cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.848 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f2f66700 1 -- 172.21.15.84:0/562236444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47ec0a4250 msgr2=0x7f47ec0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.849 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f1763700 1 -- 172.21.15.84:0/562236444 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47e40116d0 con 0x7f47ec0a4250 2020-01-16T05:44:21.849 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.839+0000 7f47f2f66700 1 --2- 172.21.15.84:0/562236444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47ec0a4250 0x7f47ec0abdd0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f47e4008910 tx=0x7f47e0001cd0).stop 2020-01-16T05:44:21.849 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f2f66700 1 -- 172.21.15.84:0/562236444 shutdown_connections 2020-01-16T05:44:21.849 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f2f66700 1 --2- 172.21.15.84:0/562236444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47ec0a4250 0x7f47ec0abdd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:21.850 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f2f66700 1 -- 172.21.15.84:0/562236444 shutdown_connections 2020-01-16T05:44:21.851 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f2f66700 1 -- 172.21.15.84:0/562236444 wait complete. 2020-01-16T05:44:21.851 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f2f66700 1 -- 172.21.15.84:0/562236444 >> 172.21.15.84:0/562236444 conn(0x7f47ec0acfc0 msgr2=0x7f47ec0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:21.856 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f2f66700 1 Processor -- start 2020-01-16T05:44:21.856 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f2f66700 1 -- start start 2020-01-16T05:44:21.856 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f2f66700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ec07cb10 0x7f47ec09f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:21.856 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f2f66700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ec07d640 con 0x7f47ec07f080 2020-01-16T05:44:21.856 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f2f66700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ec0a34b0 con 0x7f47ec09fa60 2020-01-16T05:44:21.857 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f2f66700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec08f6e0 con 0x7f47ec07cb10 2020-01-16T05:44:21.857 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f1f64700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f47ec07f080 0x7f47ec123ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52098/0 (socket says 172.21.15.84:52098) 2020-01-16T05:44:21.857 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f1f64700 1 -- 172.21.15.84:0/3522695983 learned_addr learned my addr 172.21.15.84:0/3522695983 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:44:21.857 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f2765700 1 --2- 172.21.15.84:0/3522695983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ec07cb10 0x7f47ec09f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.858 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47eaffd700 1 -- 172.21.15.84:0/3522695983 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054740979 0 0) 0x7f47ec07d640 con 0x7f47ec07f080 2020-01-16T05:44:21.858 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47eaffd700 1 -- 172.21.15.84:0/3522695983 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47d4003230 con 0x7f47ec07f080 2020-01-16T05:44:21.858 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47eaffd700 1 -- 172.21.15.84:0/3522695983 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982339069 0 0) 0x7f47ec0a34b0 con 0x7f47ec09fa60 2020-01-16T05:44:21.858 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47eaffd700 1 -- 172.21.15.84:0/3522695983 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47ec07d640 con 0x7f47ec09fa60 2020-01-16T05:44:21.858 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f2765700 1 -- 172.21.15.84:0/3522695983 >> v1:172.21.15.142:6789/0 conn(0x7f47ec09fa60 legacy=0x7f47ec13d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.859 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f2765700 1 -- 172.21.15.84:0/3522695983 >> v1:172.21.15.84:6789/0 conn(0x7f47ec07f080 legacy=0x7f47ec123ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:21.859 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f2765700 1 -- 172.21.15.84:0/3522695983 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec1244e0 con 0x7f47ec07cb10 2020-01-16T05:44:21.859 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f2765700 1 --2- 172.21.15.84:0/3522695983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ec07cb10 0x7f47ec09f510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47e0001320 tx=0x7f47e000c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.859 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.843+0000 7f47f2765700 1 --2- 172.21.15.84:0/3522695983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ec07cb10 0x7f47ec09f510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47e0001320 tx=0x7f47e000c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.859 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.847+0000 7f47f2765700 1 --2- 172.21.15.84:0/3522695983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ec07cb10 0x7f47ec09f510 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f47e0001320 tx=0x7f47e000c910).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.847+0000 7f47f2765700 1 --2- 172.21.15.84:0/3522695983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ec07cb10 0x7f47ec09f510 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f47e0001320 tx=0x7f47e000c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.847+0000 7f47eaffd700 1 -- 172.21.15.84:0/3522695983 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47e0004b20 con 0x7f47ec07cb10 2020-01-16T05:44:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.847+0000 7f47f2765700 1 --2- 172.21.15.84:0/3522695983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ec07cb10 0x7f47ec09f510 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f47e0001320 tx=0x7f47e000c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.847+0000 7f47f2765700 1 --2- 172.21.15.84:0/3522695983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ec07cb10 0x7f47ec09f510 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f47e0001320 tx=0x7f47e000c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.847+0000 7f47eaffd700 1 -- 172.21.15.84:0/3522695983 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e000cd80 con 0x7f47ec07cb10 2020-01-16T05:44:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.847+0000 7f47f2f66700 1 -- 172.21.15.84:0/3522695983 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ec13e850 con 0x7f47ec07cb10 2020-01-16T05:44:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.847+0000 7f47eaffd700 1 -- 172.21.15.84:0/3522695983 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47e000d2b0 con 0x7f47ec07cb10 2020-01-16T05:44:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.847+0000 7f47f2f66700 1 -- 172.21.15.84:0/3522695983 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ec13ea60 con 0x7f47ec07cb10 2020-01-16T05:44:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.847+0000 7f47f2765700 1 --2- 172.21.15.84:0/3522695983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ec07cb10 0x7f47ec09f510 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f47e0001320 tx=0x7f47e000c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.847+0000 7f47f2f66700 1 -- 172.21.15.84:0/3522695983 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ec05e1c0 con 0x7f47ec07cb10 2020-01-16T05:44:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.847+0000 7f47eaffd700 1 -- 172.21.15.84:0/3522695983 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f47e000d580 con 0x7f47ec07cb10 2020-01-16T05:44:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.847+0000 7f47f2765700 1 --2- 172.21.15.84:0/3522695983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ec07cb10 0x7f47ec09f510 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f47e0001320 tx=0x7f47e000c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.847+0000 7f47eaffd700 1 --2- 172.21.15.84:0/3522695983 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f47d403ca40 0x7f47d403ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:44:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.847+0000 7f47eaffd700 1 -- 172.21.15.84:0/3522695983 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5673+0+0 (secure 0 0 0) 0x7f47e004c970 con 0x7f47ec07cb10 2020-01-16T05:44:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.847+0000 7f47f1f64700 1 --2- 172.21.15.84:0/3522695983 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f47d403ca40 0x7f47d403ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:44:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.847+0000 7f47f1f64700 1 --2- 172.21.15.84:0/3522695983 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f47d403ca40 0x7f47d403ef50 crc :-1 s=READY pgs=102 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:44:21.864 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.855+0000 7f47f2765700 1 --2- 172.21.15.84:0/3522695983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ec07cb10 0x7f47ec09f510 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f47e0001320 tx=0x7f47e000c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:21.855+0000 7f47eaffd700 1 -- 172.21.15.84:0/3522695983 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f47e0032f90 con 0x7f47ec07cb10 2020-01-16T05:44:22.008 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:22.007+0000 7f47f2f66700 1 -- 172.21.15.84:0/3522695983 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47ec08fdc0 con 0x7f47ec07cb10 2020-01-16T05:44:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:22.007+0000 7f47f2765700 1 --2- 172.21.15.84:0/3522695983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ec07cb10 0x7f47ec09f510 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f47e0001320 tx=0x7f47e000c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:44:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:22.007+0000 7f47eaffd700 1 -- 172.21.15.84:0/3522695983 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2102 (secure 0 0 0) 0x7f47e00331f0 con 0x7f47ec07cb10 2020-01-16T05:44:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:22.011+0000 7f47f2f66700 1 -- 172.21.15.84:0/3522695983 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f47d403ca40 msgr2=0x7f47d403ef50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:22.011+0000 7f47f2f66700 1 --2- 172.21.15.84:0/3522695983 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f47d403ca40 0x7f47d403ef50 crc :-1 s=READY pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:22.011+0000 7f47f2f66700 1 -- 172.21.15.84:0/3522695983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ec07cb10 msgr2=0x7f47ec09f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:44:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:22.011+0000 7f47f2f66700 1 --2- 172.21.15.84:0/3522695983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ec07cb10 0x7f47ec09f510 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f47e0001320 tx=0x7f47e000c910).stop 2020-01-16T05:44:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:22.011+0000 7f47f2f66700 1 -- 172.21.15.84:0/3522695983 shutdown_connections 2020-01-16T05:44:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:22.011+0000 7f47f2f66700 1 --2- 172.21.15.84:0/3522695983 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f47d403ca40 0x7f47d403ef50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:22.011+0000 7f47f2f66700 1 --2- 172.21.15.84:0/3522695983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ec07cb10 0x7f47ec09f510 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:44:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:22.011+0000 7f47f2f66700 1 -- 172.21.15.84:0/3522695983 shutdown_connections 2020-01-16T05:44:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:22.011+0000 7f47f2f66700 1 -- 172.21.15.84:0/3522695983 wait complete. 2020-01-16T05:44:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:44:22.011+0000 7f47f2f66700 1 -- 172.21.15.84:0/3522695983 >> 172.21.15.84:0/3522695983 conn(0x7f47ec0ab6b0 msgr2=0x7f47ec0a8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:44:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 5 2020-01-16T05:44:22.023 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:44:22.023 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4359,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:44:07.656087+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4208":{"gid":4208,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.142:6833/1195730666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1195730666},{"type":"v1","addr":"172.21.15.142:6833","nonce":1195730666}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:44:22.248 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4208}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 5, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4208': {u'export_targets': [], u'name': u'b', u'incarnation': 4, u'state_seq': 2, u'state': u'up:active', u'gid': 4208, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1195730666, u'type': u'v2', u'addr': u'172.21.15.142:6832'}, {u'nonce': 1195730666, u'type': u'v1', u'addr': u'172.21.15.142:6833'}]}, u'addr': u'172.21.15.142:6833/1195730666'}}, u'fs_name': u'cephfs', u'created': u'2020-01-16T05:44:03.929689+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-16T05:44:07.656087+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-16T05:44:22.248 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-01-16T05:44:22.249 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-01-16T05:44:22.364 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-01-16T05:44:22.364 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "cbc67508-4d2a-4483-a1fc-95d371063ac4", 2020-01-16T05:44:22.364 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 0, 2020-01-16T05:44:22.364 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 4208, 2020-01-16T05:44:22.365 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2020-01-16T05:44:22.365 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2020-01-16T05:44:22.365 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 15.848048529, 2020-01-16T05:44:22.365 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 5, 2020-01-16T05:44:22.365 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 24, 2020-01-16T05:44:22.365 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 24, 2020-01-16T05:44:22.365 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 16.047505180000002 2020-01-16T05:44:22.365 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-01-16T05:44:22.374 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "cbc67508-4d2a-4483-a1fc-95d371063ac4", "whoami": 0, "id": 4208, "want_state": "up:active", "state": "up:active", "rank_uptime": 15.848048529, "mdsmap_epoch": 5, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "uptime": 16.047505180000002 } 2020-01-16T05:44:22.374 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-01-16T05:44:22.374 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-01-16T05:44:22.375 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi084.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-01-16T05:44:22.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:22.375 INFO:teuthology.orchestra.run.smithi084:> mkdir -p /home/ubuntu/cephtest/mnt.0 2020-01-16T05:44:22.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:22.389 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-16T05:44:22.447 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-16T05:44:22.453 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-16T05:44:22.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:22.454 INFO:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2020-01-16T05:44:22.500 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-01-16T05:44:22.501 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0 2020-01-16T05:44:22.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:22.540 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-16T05:44:22.555 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-16T05:44:22.558 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-16T05:44:22.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:22.559 INFO:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2020-01-16T05:44:22.622 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:2020-01-16T05:44:22.619+0000 7f893d68b0c0 -1 init, newargv = 0x55d7020d9020 newargc=7ceph-fuse[15237]: starting ceph client 2020-01-16T05:44:22.622 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr: 2020-01-16T05:44:22.832 INFO:tasks.ceph.mds.b.smithi142.stderr:*** Caught signal (Segmentation fault) ** 2020-01-16T05:44:22.832 INFO:tasks.ceph.mds.b.smithi142.stderr: in thread 7fcbb8168700 thread_name:MR_Finisher 2020-01-16T05:44:22.834 INFO:tasks.ceph.mds.b.smithi142.stderr: ceph version 15.0.0-9376-g0771362 (07713629e135b47dc5ec2a85f60649826e17a6cd) octopus (dev) 2020-01-16T05:44:22.834 INFO:tasks.ceph.mds.b.smithi142.stderr: 1: (()+0x12890) [0x7fcbc5366890] 2020-01-16T05:44:22.834 INFO:tasks.ceph.mds.b.smithi142.stderr: 2: (Server::_session_logged(Session*, unsigned long, bool, unsigned long, interval_set, std::allocator > > >&, unsigned long, interval_set, std::allocator > > >&, LogSegment*)+0x9d6) [0x55887dfee706] 2020-01-16T05:44:22.834 INFO:tasks.ceph.mds.b.smithi142.stderr: 3: (C_MDS_session_finish::finish(int)+0x3d) [0x55887e065e6d] 2020-01-16T05:44:22.834 INFO:tasks.ceph.mds.b.smithi142.stderr: 4: (MDSContext::complete(int)+0x52) [0x55887e26ba62] 2020-01-16T05:44:22.835 INFO:tasks.ceph.mds.b.smithi142.stderr: 5: (MDSIOContextBase::complete(int)+0x181) [0x55887e26bd41] 2020-01-16T05:44:22.835 INFO:tasks.ceph.mds.b.smithi142.stderr: 6: (MDSLogContextBase::complete(int)+0x40) [0x55887e26c030] 2020-01-16T05:44:22.835 INFO:tasks.ceph.mds.b.smithi142.stderr: 7: (Finisher::finisher_thread_entry()+0x195) [0x7fcbc5aa3a95] 2020-01-16T05:44:22.835 INFO:tasks.ceph.mds.b.smithi142.stderr: 8: (()+0x76db) [0x7fcbc535b6db] 2020-01-16T05:44:22.836 INFO:tasks.ceph.mds.b.smithi142.stderr: 9: (clone()+0x3f) [0x7fcbc454188f] 2020-01-16T05:44:22.836 INFO:tasks.ceph.mds.b.smithi142.stderr:2020-01-16T05:44:22.834+0000 7fcbb8168700 -1 *** Caught signal (Segmentation fault) ** 2020-01-16T05:44:22.836 INFO:tasks.ceph.mds.b.smithi142.stderr: in thread 7fcbb8168700 thread_name:MR_Finisher 2020-01-16T05:44:22.837 INFO:tasks.ceph.mds.b.smithi142.stderr: 2020-01-16T05:44:22.837 INFO:tasks.ceph.mds.b.smithi142.stderr: ceph version 15.0.0-9376-g0771362 (07713629e135b47dc5ec2a85f60649826e17a6cd) octopus (dev) 2020-01-16T05:44:22.837 INFO:tasks.ceph.mds.b.smithi142.stderr: 1: (()+0x12890) [0x7fcbc5366890] 2020-01-16T05:44:22.837 INFO:tasks.ceph.mds.b.smithi142.stderr: 2: (Server::_session_logged(Session*, unsigned long, bool, unsigned long, interval_set, std::allocator > > >&, unsigned long, interval_set, std::allocator > > >&, LogSegment*)+0x9d6) [0x55887dfee706] 2020-01-16T05:44:22.837 INFO:tasks.ceph.mds.b.smithi142.stderr: 3: (C_MDS_session_finish::finish(int)+0x3d) [0x55887e065e6d] 2020-01-16T05:44:22.838 INFO:tasks.ceph.mds.b.smithi142.stderr: 4: (MDSContext::complete(int)+0x52) [0x55887e26ba62] 2020-01-16T05:44:22.838 INFO:tasks.ceph.mds.b.smithi142.stderr: 5: (MDSIOContextBase::complete(int)+0x181) [0x55887e26bd41] 2020-01-16T05:44:22.838 INFO:tasks.ceph.mds.b.smithi142.stderr: 6: (MDSLogContextBase::complete(int)+0x40) [0x55887e26c030] 2020-01-16T05:44:22.838 INFO:tasks.ceph.mds.b.smithi142.stderr: 7: (Finisher::finisher_thread_entry()+0x195) [0x7fcbc5aa3a95] 2020-01-16T05:44:22.838 INFO:tasks.ceph.mds.b.smithi142.stderr: 8: (()+0x76db) [0x7fcbc535b6db] 2020-01-16T05:44:22.839 INFO:tasks.ceph.mds.b.smithi142.stderr: 9: (clone()+0x3f) [0x7fcbc454188f] 2020-01-16T05:44:22.839 INFO:tasks.ceph.mds.b.smithi142.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-16T05:44:22.839 INFO:tasks.ceph.mds.b.smithi142.stderr: 2020-01-16T05:44:22.842 INFO:tasks.ceph.mds.b.smithi142.stderr: 0> 2020-01-16T05:44:22.834+0000 7fcbb8168700 -1 *** Caught signal (Segmentation fault) ** 2020-01-16T05:44:22.842 INFO:tasks.ceph.mds.b.smithi142.stderr: in thread 7fcbb8168700 thread_name:MR_Finisher 2020-01-16T05:44:22.842 INFO:tasks.ceph.mds.b.smithi142.stderr: 2020-01-16T05:44:22.842 INFO:tasks.ceph.mds.b.smithi142.stderr: ceph version 15.0.0-9376-g0771362 (07713629e135b47dc5ec2a85f60649826e17a6cd) octopus (dev) 2020-01-16T05:44:22.843 INFO:tasks.ceph.mds.b.smithi142.stderr: 1: (()+0x12890) [0x7fcbc5366890] 2020-01-16T05:44:22.843 INFO:tasks.ceph.mds.b.smithi142.stderr: 2: (Server::_session_logged(Session*, unsigned long, bool, unsigned long, interval_set, std::allocator > > >&, unsigned long, interval_set, std::allocator > > >&, LogSegment*)+0x9d6) [0x55887dfee706] 2020-01-16T05:44:22.843 INFO:tasks.ceph.mds.b.smithi142.stderr: 3: (C_MDS_session_finish::finish(int)+0x3d) [0x55887e065e6d] 2020-01-16T05:44:22.843 INFO:tasks.ceph.mds.b.smithi142.stderr: 4: (MDSContext::complete(int)+0x52) [0x55887e26ba62] 2020-01-16T05:44:22.844 INFO:tasks.ceph.mds.b.smithi142.stderr: 5: (MDSIOContextBase::complete(int)+0x181) [0x55887e26bd41] 2020-01-16T05:44:22.844 INFO:tasks.ceph.mds.b.smithi142.stderr: 6: (MDSLogContextBase::complete(int)+0x40) [0x55887e26c030] 2020-01-16T05:44:22.844 INFO:tasks.ceph.mds.b.smithi142.stderr: 7: (Finisher::finisher_thread_entry()+0x195) [0x7fcbc5aa3a95] 2020-01-16T05:44:22.844 INFO:tasks.ceph.mds.b.smithi142.stderr: 8: (()+0x76db) [0x7fcbc535b6db] 2020-01-16T05:44:22.845 INFO:tasks.ceph.mds.b.smithi142.stderr: 9: (clone()+0x3f) [0x7fcbc454188f] 2020-01-16T05:44:22.845 INFO:tasks.ceph.mds.b.smithi142.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-16T05:44:22.845 INFO:tasks.ceph.mds.b.smithi142.stderr: 2020-01-16T05:44:22.846 INFO:tasks.ceph.mds.b.smithi142.stderr: 0> 2020-01-16T05:44:22.834+0000 7fcbb8168700 -1 *** Caught signal (Segmentation fault) ** 2020-01-16T05:44:22.846 INFO:tasks.ceph.mds.b.smithi142.stderr: in thread 7fcbb8168700 thread_name:MR_Finisher 2020-01-16T05:44:22.846 INFO:tasks.ceph.mds.b.smithi142.stderr: 2020-01-16T05:44:22.846 INFO:tasks.ceph.mds.b.smithi142.stderr: ceph version 15.0.0-9376-g0771362 (07713629e135b47dc5ec2a85f60649826e17a6cd) octopus (dev) 2020-01-16T05:44:22.846 INFO:tasks.ceph.mds.b.smithi142.stderr: 1: (()+0x12890) [0x7fcbc5366890] 2020-01-16T05:44:22.846 INFO:tasks.ceph.mds.b.smithi142.stderr: 2: (Server::_session_logged(Session*, unsigned long, bool, unsigned long, interval_set, std::allocator > > >&, unsigned long, interval_set, std::allocator > > >&, LogSegment*)+0x9d6) [0x55887dfee706] 2020-01-16T05:44:22.847 INFO:tasks.ceph.mds.b.smithi142.stderr: 3: (C_MDS_session_finish::finish(int)+0x3d) [0x55887e065e6d] 2020-01-16T05:44:22.847 INFO:tasks.ceph.mds.b.smithi142.stderr: 4: (MDSContext::complete(int)+0x52) [0x55887e26ba62] 2020-01-16T05:44:22.847 INFO:tasks.ceph.mds.b.smithi142.stderr: 5: (MDSIOContextBase::complete(int)+0x181) [0x55887e26bd41] 2020-01-16T05:44:22.847 INFO:tasks.ceph.mds.b.smithi142.stderr: 6: (MDSLogContextBase::complete(int)+0x40) [0x55887e26c030] 2020-01-16T05:44:22.847 INFO:tasks.ceph.mds.b.smithi142.stderr: 7: (Finisher::finisher_thread_entry()+0x195) [0x7fcbc5aa3a95] 2020-01-16T05:44:22.847 INFO:tasks.ceph.mds.b.smithi142.stderr: 8: (()+0x76db) [0x7fcbc535b6db] 2020-01-16T05:44:22.847 INFO:tasks.ceph.mds.b.smithi142.stderr: 9: (clone()+0x3f) [0x7fcbc454188f] 2020-01-16T05:44:22.848 INFO:tasks.ceph.mds.b.smithi142.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-16T05:44:22.848 INFO:tasks.ceph.mds.b.smithi142.stderr: 2020-01-16T05:44:22.918 INFO:tasks.ceph.mds.b.smithi142.stderr:daemon-helper: command crashed with signal 11 2020-01-16T05:44:23.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:23.705 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-16T05:44:23.721 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-16T05:44:23.726 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-16T05:44:23.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:23.727 INFO:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2020-01-16T05:44:24.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:24.872 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-16T05:44:24.888 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-16T05:44:24.892 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-16T05:44:24.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:24.893 INFO:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2020-01-16T05:44:26.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:26.042 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-16T05:44:26.059 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-16T05:44:26.061 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-16T05:44:26.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:26.062 INFO:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2020-01-16T05:44:27.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:27.214 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-16T05:44:27.231 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-16T05:44:27.233 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-16T05:44:27.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:27.234 INFO:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2020-01-16T05:44:27.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2020-01-16T05:44:28.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:28.383 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-16T05:44:28.399 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-16T05:44:28.402 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-16T05:44:28.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:28.403 INFO:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2020-01-16T05:44:29.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:29.558 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-16T05:44:29.577 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-16T05:44:29.579 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-16T05:44:29.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:29.580 INFO:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2020-01-16T05:44:30.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:30.729 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-16T05:44:30.746 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-16T05:44:30.748 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-16T05:44:30.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:30.749 INFO:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2020-01-16T05:44:31.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:31.902 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-16T05:44:31.919 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-16T05:44:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-16T05:44:31.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:31.923 INFO:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2020-01-16T05:44:33.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:33.074 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-16T05:44:33.091 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-16T05:44:33.093 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-16T05:44:33.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:33.094 INFO:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2020-01-16T05:44:33.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~6s 2020-01-16T05:44:34.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:34.244 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-16T05:44:34.265 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-16T05:44:34.268 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-16T05:44:34.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:34.268 INFO:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2020-01-16T05:44:35.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:35.421 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-16T05:44:35.438 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-16T05:44:35.440 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-16T05:44:35.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:35.440 INFO:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2020-01-16T05:44:36.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:36.592 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-16T05:44:36.607 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-16T05:44:36.611 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-16T05:44:36.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:36.612 INFO:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2020-01-16T05:44:37.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:37.762 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-16T05:44:37.781 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-16T05:44:37.785 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-16T05:44:37.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:37.786 INFO:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2020-01-16T05:44:38.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:38.942 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-16T05:44:38.961 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-16T05:44:38.963 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-16T05:44:38.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:38.964 INFO:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2020-01-16T05:44:39.567 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[15237]: starting fuse 2020-01-16T05:44:40.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~13s 2020-01-16T05:44:40.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:40.112 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-16T05:44:40.130 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-16T05:44:40.132 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-16T05:44:40.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:40.133 INFO:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2020-01-16T05:44:40.183 INFO:teuthology.orchestra.run.smithi084.stdout:49 2020-01-16T05:44:40.184 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-01-16T05:44:40.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:40.184 INFO:teuthology.orchestra.run.smithi084:> sudo python3 -c ' 2020-01-16T05:44:40.184 INFO:teuthology.orchestra.run.smithi084:> import glob 2020-01-16T05:44:40.184 INFO:teuthology.orchestra.run.smithi084:> import re 2020-01-16T05:44:40.184 INFO:teuthology.orchestra.run.smithi084:> import os 2020-01-16T05:44:40.184 INFO:teuthology.orchestra.run.smithi084:> import subprocess 2020-01-16T05:44:40.185 INFO:teuthology.orchestra.run.smithi084:> 2020-01-16T05:44:40.185 INFO:teuthology.orchestra.run.smithi084:> def find_socket(client_name): 2020-01-16T05:44:40.185 INFO:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-01-16T05:44:40.185 INFO:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2020-01-16T05:44:40.185 INFO:teuthology.orchestra.run.smithi084:> 2020-01-16T05:44:40.185 INFO:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2020-01-16T05:44:40.185 INFO:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2020-01-16T05:44:40.186 INFO:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2020-01-16T05:44:40.186 INFO:teuthology.orchestra.run.smithi084:> return files[0] 2020-01-16T05:44:40.186 INFO:teuthology.orchestra.run.smithi084:> 2020-01-16T05:44:40.186 INFO:teuthology.orchestra.run.smithi084:> for f in files: 2020-01-16T05:44:40.186 INFO:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-01-16T05:44:40.186 INFO:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2020-01-16T05:44:40.186 INFO:teuthology.orchestra.run.smithi084:> return f 2020-01-16T05:44:40.186 INFO:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-01-16T05:44:40.186 INFO:teuthology.orchestra.run.smithi084:> 2020-01-16T05:44:40.187 INFO:teuthology.orchestra.run.smithi084:> print(find_socket("client.0")) 2020-01-16T05:44:40.187 INFO:teuthology.orchestra.run.smithi084:> ' 2020-01-16T05:44:40.289 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.0.15237.asok 2020-01-16T05:44:40.290 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15237.asok 2020-01-16T05:44:40.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:40.290 INFO:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15237.asok status 2020-01-16T05:44:40.412 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2020-01-16T05:44:40.412 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2020-01-16T05:44:40.413 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "07713629e135b47dc5ec2a85f60649826e17a6cd", 2020-01-16T05:44:40.413 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 15.0.0-9376-g0771362 (07713629e135b47dc5ec2a85f60649826e17a6cd) octopus (dev)", 2020-01-16T05:44:40.413 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "0", 2020-01-16T05:44:40.413 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2020-01-16T05:44:40.413 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-01-16T05:44:40.413 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "15237", 2020-01-16T05:44:40.413 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2020-01-16T05:44:40.414 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2020-01-16T05:44:40.414 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2020-01-16T05:44:40.414 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2020-01-16T05:44:40.414 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4797, 2020-01-16T05:44:40.414 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2020-01-16T05:44:40.414 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2020-01-16T05:44:40.414 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2020-01-16T05:44:40.415 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 4797 2020-01-16T05:44:40.415 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2020-01-16T05:44:40.415 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2020-01-16T05:44:40.415 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2020-01-16T05:44:40.415 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2020-01-16T05:44:40.415 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 3504759367 2020-01-16T05:44:40.415 INFO:teuthology.orchestra.run.smithi084.stdout: } 2020-01-16T05:44:40.415 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2020-01-16T05:44:40.416 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2020-01-16T05:44:40.416 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2020-01-16T05:44:40.416 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2020-01-16T05:44:40.416 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 3504759367 2020-01-16T05:44:40.416 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2020-01-16T05:44:40.416 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.4797 172.21.15.84:0/3504759367", 2020-01-16T05:44:40.416 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "172.21.15.84:0/3504759367", 2020-01-16T05:44:40.417 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2020-01-16T05:44:40.417 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 9, 2020-01-16T05:44:40.417 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 24, 2020-01-16T05:44:40.417 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2020-01-16T05:44:40.417 INFO:teuthology.orchestra.run.smithi084.stdout: "blacklisted": false 2020-01-16T05:44:40.417 INFO:teuthology.orchestra.run.smithi084.stdout:} 2020-01-16T05:44:40.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:40.418 INFO:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2020-01-16T05:44:40.418 INFO:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.0 2020-01-16T05:44:40.427 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2020-01-16T05:44:40.428 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-01-16T05:44:40.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-16T05:44:40.428 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2020-01-16T05:44:40.487 INFO:teuthology.run_tasks:Running task workunit... 2020-01-16T05:44:40.504 INFO:tasks.workunit:Pulling workunits from ref 07713629e135b47dc5ec2a85f60649826e17a6cd 2020-01-16T05:44:40.504 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-01-16T05:44:40.505 INFO:tasks.workunit:timeout=3h 2020-01-16T05:44:40.505 INFO:tasks.workunit:cleanup=True 2020-01-16T05:44:40.506 INFO:teuthology.orchestra.run.smithi084:> stat -- /home/ubuntu/cephtest/mnt.0 2020-01-16T05:44:40.535 INFO:teuthology.orchestra.run.smithi084.stdout: File: /home/ubuntu/cephtest/mnt.0 2020-01-16T05:44:40.535 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2020-01-16T05:44:40.535 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 31h/49d Inode: 1 Links: 2 2020-01-16T05:44:40.536 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2020-01-16T05:44:40.536 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2020-01-16T05:44:40.536 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2020-01-16 05:44:06.520456148 +0000 2020-01-16T05:44:40.536 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2020-01-16 05:44:40.480621736 +0000 2020-01-16T05:44:40.536 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2020-01-16T05:44:40.536 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2020-01-16T05:44:40.536 INFO:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2020-01-16T05:44:40.605 INFO:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 07713629e135b47dc5ec2a85f60649826e17a6cd 2020-01-16T05:44:40.711 INFO:tasks.workunit.client.0.smithi084.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-01-16T05:44:43.886 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:44:43.889 INFO:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:44:46.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~19s 2020-01-16T05:44:52.913 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~26s 2020-01-16T05:44:59.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~32s 2020-01-16T05:45:05.746 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~38s 2020-01-16T05:45:12.158 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~45s 2020-01-16T05:45:12.646 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.764+0000 7f21f891e700 1 Processor -- start 2020-01-16T05:45:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.764+0000 7f21f891e700 1 -- start start 2020-01-16T05:45:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.764+0000 7f21f891e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f21f40a9b30 0x7f21f40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.764+0000 7f21f891e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21f407ff10 0x7f21f4066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.764+0000 7f21f891e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f4066dd0 con 0x7f21f40a4250 2020-01-16T05:45:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.764+0000 7f21f891e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f40a4830 con 0x7f21f407ff10 2020-01-16T05:45:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.764+0000 7f21f891e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f407f9d0 con 0x7f21f40a9b30 2020-01-16T05:45:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.764+0000 7f21f37fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21f407ff10 0x7f21f4066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.764+0000 7f21f37fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21f407ff10 0x7f21f4066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34972/0 (socket says 172.21.15.84:34972) 2020-01-16T05:45:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.764+0000 7f21f37fe700 1 -- 172.21.15.84:0/2992111714 learned_addr learned my addr 172.21.15.84:0/2992111714 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:45:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.764+0000 7f21f3fff700 1 --2- 172.21.15.84:0/2992111714 >> v2:172.21.15.142:3300/0 conn(0x7f21f40a9b30 0x7f21f40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f37fe700 1 -- 172.21.15.84:0/2992111714 >> v2:172.21.15.142:3300/0 conn(0x7f21f40a9b30 msgr2=0x7f21f40abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f37fe700 1 --2- 172.21.15.84:0/2992111714 >> v2:172.21.15.142:3300/0 conn(0x7f21f40a9b30 0x7f21f40abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f37fe700 1 -- 172.21.15.84:0/2992111714 >> v1:172.21.15.84:6789/0 conn(0x7f21f40a4250 legacy=0x7f21f40a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:12.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f2ffd700 1 -- 172.21.15.84:0/2992111714 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602874556 0 0) 0x7f21f4066dd0 con 0x7f21f40a4250 2020-01-16T05:45:12.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f37fe700 1 -- 172.21.15.84:0/2992111714 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f4150ce0 con 0x7f21f407ff10 2020-01-16T05:45:12.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f37fe700 1 --2- 172.21.15.84:0/2992111714 >> v2:172.21.15.84:3300/0 conn(0x7f21f407ff10 0x7f21f4066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f21f40a49f0 tx=0x7f21e400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:12.776 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f37fe700 1 --2- 172.21.15.84:0/2992111714 >> v2:172.21.15.84:3300/0 conn(0x7f21f407ff10 0x7f21f4066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f21f40a49f0 tx=0x7f21e400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:12.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f37fe700 1 --2- 172.21.15.84:0/2992111714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f407ff10 0x7f21f4066880 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7f21f40a49f0 tx=0x7f21e400feb0).ready entity=mon.0 client_cookie=89cbf8dfb552a7fe server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:12.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f37fe700 1 --2- 172.21.15.84:0/2992111714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f407ff10 0x7f21f4066880 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f21f40a49f0 tx=0x7f21e400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:12.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f2ffd700 1 -- 172.21.15.84:0/2992111714 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21e40116e0 con 0x7f21f407ff10 2020-01-16T05:45:12.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f37fe700 1 --2- 172.21.15.84:0/2992111714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f407ff10 0x7f21f4066880 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f21f40a49f0 tx=0x7f21e400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:12.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f2ffd700 1 -- 172.21.15.84:0/2992111714 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e4008d30 con 0x7f21f407ff10 2020-01-16T05:45:12.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f37fe700 1 --2- 172.21.15.84:0/2992111714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f407ff10 0x7f21f4066880 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f21f40a49f0 tx=0x7f21e400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:12.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f2ffd700 1 -- 172.21.15.84:0/2992111714 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21e4011cc0 con 0x7f21f407ff10 2020-01-16T05:45:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f891e700 1 -- 172.21.15.84:0/2992111714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f407ff10 msgr2=0x7f21f4066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f891e700 1 --2- 172.21.15.84:0/2992111714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f407ff10 0x7f21f4066880 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7f21f40a49f0 tx=0x7f21e400feb0).stop 2020-01-16T05:45:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f891e700 1 -- 172.21.15.84:0/2992111714 shutdown_connections 2020-01-16T05:45:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f891e700 1 --2- 172.21.15.84:0/2992111714 >> v2:172.21.15.142:3300/0 conn(0x7f21f40a9b30 0x7f21f40abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f891e700 1 --2- 172.21.15.84:0/2992111714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f407ff10 0x7f21f4066880 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f891e700 1 -- 172.21.15.84:0/2992111714 shutdown_connections 2020-01-16T05:45:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f891e700 1 -- 172.21.15.84:0/2992111714 wait complete. 2020-01-16T05:45:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f891e700 1 -- 172.21.15.84:0/2992111714 >> 172.21.15.84:0/2992111714 conn(0x7f21f40acfc0 msgr2=0x7f21f40a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:12.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f891e700 1 Processor -- start 2020-01-16T05:45:12.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.768+0000 7f21f891e700 1 -- start start 2020-01-16T05:45:12.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f891e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21f41264f0 0x7f21f40a7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:12.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f891e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f21f40a84a0 0x7f21f409f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:12.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f891e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f4126010 con 0x7f21f405bef0 2020-01-16T05:45:12.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f891e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f41269c0 con 0x7f21f40a84a0 2020-01-16T05:45:12.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f891e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f4126c60 con 0x7f21f41264f0 2020-01-16T05:45:12.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f3fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21f41264f0 0x7f21f40a7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:12.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f37fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f21f40a84a0 0x7f21f409f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:12.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f3fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21f41264f0 0x7f21f40a7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:47226/0 (socket says 172.21.15.84:47226) 2020-01-16T05:45:12.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f3fff700 1 -- 172.21.15.84:0/2409538086 learned_addr learned my addr 172.21.15.84:0/2409538086 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:45:12.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f37fe700 1 -- 172.21.15.84:0/2409538086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21f41264f0 msgr2=0x7f21f40a7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:12.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f37fe700 1 --2- 172.21.15.84:0/2409538086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21f41264f0 0x7f21f40a7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:12.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f37fe700 1 -- 172.21.15.84:0/2409538086 >> v1:172.21.15.142:6789/0 conn(0x7f21f405bef0 legacy=0x7f21f408ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:12.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f37fe700 1 -- 172.21.15.84:0/2409538086 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f4090740 con 0x7f21f40a84a0 2020-01-16T05:45:12.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f37fe700 1 --2- 172.21.15.84:0/2409538086 >> v2:172.21.15.142:3300/0 conn(0x7f21f40a84a0 0x7f21f409f460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f21f40a49f0 tx=0x7f21e40117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:12.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f37fe700 1 --2- 172.21.15.84:0/2409538086 >> v2:172.21.15.142:3300/0 conn(0x7f21f40a84a0 0x7f21f409f460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f21f40a49f0 tx=0x7f21e40117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:12.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f37fe700 1 --2- 172.21.15.84:0/2409538086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21f40a84a0 0x7f21f409f460 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f21f40a49f0 tx=0x7f21e40117a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:12.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f37fe700 1 --2- 172.21.15.84:0/2409538086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21f40a84a0 0x7f21f409f460 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f21f40a49f0 tx=0x7f21e40117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:12.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f0ff9700 1 -- 172.21.15.84:0/2409538086 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21e400f780 con 0x7f21f40a84a0 2020-01-16T05:45:12.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f37fe700 1 --2- 172.21.15.84:0/2409538086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21f40a84a0 0x7f21f409f460 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f21f40a49f0 tx=0x7f21e40117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:12.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f37fe700 1 --2- 172.21.15.84:0/2409538086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21f40a84a0 0x7f21f409f460 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f21f40a49f0 tx=0x7f21e40117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:12.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f0ff9700 1 -- 172.21.15.84:0/2409538086 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e40118e0 con 0x7f21f40a84a0 2020-01-16T05:45:12.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f0ff9700 1 -- 172.21.15.84:0/2409538086 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21e40056c0 con 0x7f21f40a84a0 2020-01-16T05:45:12.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f891e700 1 -- 172.21.15.84:0/2409538086 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f409f9b0 con 0x7f21f40a84a0 2020-01-16T05:45:12.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f891e700 1 -- 172.21.15.84:0/2409538086 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f413bf30 con 0x7f21f40a84a0 2020-01-16T05:45:12.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f37fe700 1 --2- 172.21.15.84:0/2409538086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21f40a84a0 0x7f21f409f460 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f21f40a49f0 tx=0x7f21e40117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:12.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.772+0000 7f21f891e700 1 -- 172.21.15.84:0/2409538086 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f405e1c0 con 0x7f21f40a84a0 2020-01-16T05:45:12.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.776+0000 7f21f0ff9700 1 -- 172.21.15.84:0/2409538086 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f21e4005990 con 0x7f21f40a84a0 2020-01-16T05:45:12.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.776+0000 7f21f37fe700 1 --2- 172.21.15.84:0/2409538086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21f40a84a0 0x7f21f409f460 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f21f40a49f0 tx=0x7f21e40117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:12.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.776+0000 7f21f0ff9700 1 --2- 172.21.15.84:0/2409538086 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f21cc03c260 0x7f21cc03e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:12.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.776+0000 7f21f0ff9700 1 -- 172.21.15.84:0/2409538086 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f21e4090e90 con 0x7f21f40a84a0 2020-01-16T05:45:12.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.776+0000 7f21f3fff700 1 --2- 172.21.15.84:0/2409538086 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f21cc03c260 0x7f21cc03e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:12.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.776+0000 7f21f3fff700 1 --2- 172.21.15.84:0/2409538086 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f21cc03c260 0x7f21cc03e770 crc :-1 s=READY pgs=103 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:12.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.784+0000 7f21f37fe700 1 --2- 172.21.15.84:0/2409538086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21f40a84a0 0x7f21f409f460 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f21f40a49f0 tx=0x7f21e40117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:12.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.784+0000 7f21f0ff9700 1 -- 172.21.15.84:0/2409538086 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f21e4005ca0 con 0x7f21f40a84a0 2020-01-16T05:45:12.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.932+0000 7f21f891e700 1 -- 172.21.15.84:0/2409538086 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21f405cbc0 con 0x7f21f40a84a0 2020-01-16T05:45:12.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.936+0000 7f21f37fe700 1 --2- 172.21.15.84:0/2409538086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21f40a84a0 0x7f21f409f460 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f21f40a49f0 tx=0x7f21e40117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:12.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.936+0000 7f21f0ff9700 1 -- 172.21.15.84:0/2409538086 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+1766 (secure 0 0 0) 0x7f21e4079920 con 0x7f21f40a84a0 2020-01-16T05:45:12.938 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:12.938 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:44:39.544825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:12.948 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.936+0000 7f21f891e700 1 -- 172.21.15.84:0/2409538086 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f21cc03c260 msgr2=0x7f21cc03e770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:12.948 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.936+0000 7f21f891e700 1 --2- 172.21.15.84:0/2409538086 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f21cc03c260 0x7f21cc03e770 crc :-1 s=READY pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:12.948 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.936+0000 7f21f891e700 1 -- 172.21.15.84:0/2409538086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21f40a84a0 msgr2=0x7f21f409f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:12.948 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.936+0000 7f21f891e700 1 --2- 172.21.15.84:0/2409538086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21f40a84a0 0x7f21f409f460 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f21f40a49f0 tx=0x7f21e40117a0).stop 2020-01-16T05:45:12.948 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.936+0000 7f21f891e700 1 -- 172.21.15.84:0/2409538086 shutdown_connections 2020-01-16T05:45:12.948 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.936+0000 7f21f891e700 1 --2- 172.21.15.84:0/2409538086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21f41264f0 0x7f21f40a7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:12.949 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.936+0000 7f21f891e700 1 --2- 172.21.15.84:0/2409538086 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f21cc03c260 0x7f21cc03e770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:12.949 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.936+0000 7f21f891e700 1 --2- 172.21.15.84:0/2409538086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21f40a84a0 0x7f21f409f460 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:12.949 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.936+0000 7f21f891e700 1 -- 172.21.15.84:0/2409538086 shutdown_connections 2020-01-16T05:45:12.949 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.936+0000 7f21f891e700 1 -- 172.21.15.84:0/2409538086 wait complete. 2020-01-16T05:45:12.949 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:12.936+0000 7f21f891e700 1 -- 172.21.15.84:0/2409538086 >> 172.21.15.84:0/2409538086 conn(0x7f21f4066650 msgr2=0x7f21f40248f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:12.949 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2020-01-16T05:45:12.958 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.a (rank=0) 2020-01-16T05:45:12.958 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-01-16T05:45:12.959 INFO:teuthology.orchestra.run:waiting for 300 2020-01-16T05:45:12.971 INFO:tasks.ceph.mds.a:Stopped 2020-01-16T05:45:12.971 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:13.137 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d80a59700 1 Processor -- start 2020-01-16T05:45:13.138 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d80a59700 1 -- start start 2020-01-16T05:45:13.138 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d80a59700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9d7c0a9b30 0x7f9d7c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:13.138 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d80a59700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c0a4250 0x7f9d7c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:13.138 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d80a59700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c066dd0 con 0x7f9d7c07ff10 2020-01-16T05:45:13.139 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d80a59700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7c0a4830 con 0x7f9d7c0a9b30 2020-01-16T05:45:13.139 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d80a59700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c07f9d0 con 0x7f9d7c0a4250 2020-01-16T05:45:13.139 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d7bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9d7c0a9b30 0x7f9d7c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:13.139 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d7bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9d7c0a9b30 0x7f9d7c0abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34988/0 (socket says 172.21.15.84:34988) 2020-01-16T05:45:13.140 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d7bfff700 1 -- 172.21.15.84:0/682427269 learned_addr learned my addr 172.21.15.84:0/682427269 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:45:13.140 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d81cbb700 1 --2- 172.21.15.84:0/682427269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c0a4250 0x7f9d7c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:13.140 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d7bfff700 1 -- 172.21.15.84:0/682427269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c0a4250 msgr2=0x7f9d7c066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:13.140 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d7bfff700 1 --2- 172.21.15.84:0/682427269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c0a4250 0x7f9d7c066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:13.140 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d7bfff700 1 -- 172.21.15.84:0/682427269 >> v1:172.21.15.142:6789/0 conn(0x7f9d7c07ff10 legacy=0x7f9d7c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:13.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d7bfff700 1 -- 172.21.15.84:0/682427269 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c150ce0 con 0x7f9d7c0a9b30 2020-01-16T05:45:13.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d7bfff700 1 --2- 172.21.15.84:0/682427269 >> v2:172.21.15.84:3300/0 conn(0x7f9d7c0a9b30 0x7f9d7c0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9d7c0a49f0 tx=0x7f9d6c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:13.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d7bfff700 1 --2- 172.21.15.84:0/682427269 >> v2:172.21.15.84:3300/0 conn(0x7f9d7c0a9b30 0x7f9d7c0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9d7c0a49f0 tx=0x7f9d6c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:13.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d7bfff700 1 --2- 172.21.15.84:0/682427269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d7c0a9b30 0x7f9d7c0abdd0 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7f9d7c0a49f0 tx=0x7f9d6c00feb0).ready entity=mon.0 client_cookie=e453d954e876cc44 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:13.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d7bfff700 1 --2- 172.21.15.84:0/682427269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d7c0a9b30 0x7f9d7c0abdd0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f9d7c0a49f0 tx=0x7f9d6c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:13.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d7affd700 1 -- 172.21.15.84:0/682427269 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d6c011720 con 0x7f9d7c0a9b30 2020-01-16T05:45:13.142 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d7bfff700 1 --2- 172.21.15.84:0/682427269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d7c0a9b30 0x7f9d7c0abdd0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f9d7c0a49f0 tx=0x7f9d6c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:13.142 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d7affd700 1 -- 172.21.15.84:0/682427269 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c008d30 con 0x7f9d7c0a9b30 2020-01-16T05:45:13.142 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d7bfff700 1 --2- 172.21.15.84:0/682427269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d7c0a9b30 0x7f9d7c0abdd0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f9d7c0a49f0 tx=0x7f9d6c00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:13.142 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d80a59700 1 -- 172.21.15.84:0/682427269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d7c0a9b30 msgr2=0x7f9d7c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:13.142 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d7affd700 1 -- 172.21.15.84:0/682427269 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d6c011d00 con 0x7f9d7c0a9b30 2020-01-16T05:45:13.142 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.124+0000 7f9d80a59700 1 --2- 172.21.15.84:0/682427269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d7c0a9b30 0x7f9d7c0abdd0 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7f9d7c0a49f0 tx=0x7f9d6c00feb0).stop 2020-01-16T05:45:13.142 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.128+0000 7f9d80a59700 1 -- 172.21.15.84:0/682427269 shutdown_connections 2020-01-16T05:45:13.143 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.128+0000 7f9d80a59700 1 --2- 172.21.15.84:0/682427269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c0a4250 0x7f9d7c066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:13.143 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.128+0000 7f9d80a59700 1 --2- 172.21.15.84:0/682427269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d7c0a9b30 0x7f9d7c0abdd0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:13.143 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.128+0000 7f9d80a59700 1 -- 172.21.15.84:0/682427269 shutdown_connections 2020-01-16T05:45:13.143 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.128+0000 7f9d80a59700 1 -- 172.21.15.84:0/682427269 wait complete. 2020-01-16T05:45:13.143 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.128+0000 7f9d80a59700 1 -- 172.21.15.84:0/682427269 >> 172.21.15.84:0/682427269 conn(0x7f9d7c0acfc0 msgr2=0x7f9d7c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:13.143 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.128+0000 7f9d80a59700 1 Processor -- start 2020-01-16T05:45:13.143 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.128+0000 7f9d80a59700 1 -- start start 2020-01-16T05:45:13.143 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.128+0000 7f9d80a59700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c127b70 0x7f9d7c0a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:13.144 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.128+0000 7f9d80a59700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c0a80a0 con 0x7f9d7c0a7740 2020-01-16T05:45:13.144 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.128+0000 7f9d80a59700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c0a8aa0 con 0x7f9d7c128540 2020-01-16T05:45:13.144 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.128+0000 7f9d80a59700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c127fa0 con 0x7f9d7c127b70 2020-01-16T05:45:13.144 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.128+0000 7f9d81cbb700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9d7c0a7740 0x7f9d7c13d020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52196/0 (socket says 172.21.15.84:52196) 2020-01-16T05:45:13.144 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.128+0000 7f9d81cbb700 1 -- 172.21.15.84:0/3528869356 learned_addr learned my addr 172.21.15.84:0/3528869356 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:13.144 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d7b7fe700 1 --2- 172.21.15.84:0/3528869356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c127b70 0x7f9d7c0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:13.144 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d7bfff700 1 -- 172.21.15.84:0/3528869356 >> v1:172.21.15.142:6789/0 conn(0x7f9d7c128540 legacy=0x7f9d7c09f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-01-16T05:45:13.145 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d7bfff700 1 -- 172.21.15.84:0/3528869356 >> v1:172.21.15.142:6789/0 conn(0x7f9d7c128540 legacy=0x7f9d7c09f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-01-16T05:45:13.145 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d7bfff700 1 --1- 172.21.15.84:0/3528869356 >> v1:172.21.15.142:6789/0 conn(0x7f9d7c128540 0x7f9d7c09f480 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2020-01-16T05:45:13.145 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d7bfff700 1 --1- 172.21.15.84:0/3528869356 >> v1:172.21.15.142:6789/0 conn(0x7f9d7c128540 0x7f9d7c09f480 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2020-01-16T05:45:13.145 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d78ff9700 1 -- 172.21.15.84:0/3528869356 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258927310 0 0) 0x7f9d7c0a80a0 con 0x7f9d7c0a7740 2020-01-16T05:45:13.145 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d78ff9700 1 -- 172.21.15.84:0/3528869356 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d5c003230 con 0x7f9d7c0a7740 2020-01-16T05:45:13.145 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d7b7fe700 1 -- 172.21.15.84:0/3528869356 >> v1:172.21.15.142:6789/0 conn(0x7f9d7c128540 legacy=0x7f9d7c09f480 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-01-16T05:45:13.145 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d7b7fe700 1 -- 172.21.15.84:0/3528869356 >> v1:172.21.15.84:6789/0 conn(0x7f9d7c0a7740 legacy=0x7f9d7c13d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:13.146 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d7b7fe700 1 -- 172.21.15.84:0/3528869356 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c140850 con 0x7f9d7c127b70 2020-01-16T05:45:13.146 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d7b7fe700 1 --2- 172.21.15.84:0/3528869356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c127b70 0x7f9d7c0a71f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9d70001430 tx=0x7f9d7000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:13.146 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d7b7fe700 1 --2- 172.21.15.84:0/3528869356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c127b70 0x7f9d7c0a71f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9d70001430 tx=0x7f9d7000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:13.146 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d7b7fe700 1 --2- 172.21.15.84:0/3528869356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c127b70 0x7f9d7c0a71f0 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f9d70001430 tx=0x7f9d7000c4a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:13.146 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d7b7fe700 1 --2- 172.21.15.84:0/3528869356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c127b70 0x7f9d7c0a71f0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f9d70001430 tx=0x7f9d7000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:13.146 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d78ff9700 1 -- 172.21.15.84:0/3528869356 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d7000ccf0 con 0x7f9d7c127b70 2020-01-16T05:45:13.146 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d7b7fe700 1 --2- 172.21.15.84:0/3528869356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c127b70 0x7f9d7c0a71f0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f9d70001430 tx=0x7f9d7000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:13.146 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d7b7fe700 1 --2- 172.21.15.84:0/3528869356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c127b70 0x7f9d7c0a71f0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f9d70001430 tx=0x7f9d7000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:13.147 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d78ff9700 1 -- 172.21.15.84:0/3528869356 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7000c910 con 0x7f9d7c127b70 2020-01-16T05:45:13.147 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d78ff9700 1 -- 172.21.15.84:0/3528869356 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d70012450 con 0x7f9d7c127b70 2020-01-16T05:45:13.147 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d80a59700 1 -- 172.21.15.84:0/3528869356 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7c13e830 con 0x7f9d7c127b70 2020-01-16T05:45:13.147 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d80a59700 1 -- 172.21.15.84:0/3528869356 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c13ed30 con 0x7f9d7c127b70 2020-01-16T05:45:13.147 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d7b7fe700 1 --2- 172.21.15.84:0/3528869356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c127b70 0x7f9d7c0a71f0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f9d70001430 tx=0x7f9d7000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:13.147 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d80a59700 1 -- 172.21.15.84:0/3528869356 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7c125ff0 con 0x7f9d7c127b70 2020-01-16T05:45:13.147 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d78ff9700 1 -- 172.21.15.84:0/3528869356 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f9d70012720 con 0x7f9d7c127b70 2020-01-16T05:45:13.148 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.132+0000 7f9d7b7fe700 1 --2- 172.21.15.84:0/3528869356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c127b70 0x7f9d7c0a71f0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f9d70001430 tx=0x7f9d7000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:13.148 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.136+0000 7f9d78ff9700 1 --2- 172.21.15.84:0/3528869356 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9d5c03c7d0 0x7f9d5c03ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:13.148 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.136+0000 7f9d78ff9700 1 -- 172.21.15.84:0/3528869356 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f9d7004c5f0 con 0x7f9d7c127b70 2020-01-16T05:45:13.148 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.136+0000 7f9d7bfff700 1 --2- 172.21.15.84:0/3528869356 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9d5c03c7d0 0x7f9d5c03ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:13.148 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.136+0000 7f9d7bfff700 1 --2- 172.21.15.84:0/3528869356 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9d5c03c7d0 0x7f9d5c03ece0 crc :-1 s=READY pgs=104 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:13.148 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.144+0000 7f9d7b7fe700 1 --2- 172.21.15.84:0/3528869356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c127b70 0x7f9d7c0a71f0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f9d70001430 tx=0x7f9d7000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:13.149 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.144+0000 7f9d78ff9700 1 -- 172.21.15.84:0/3528869356 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f9d70032c10 con 0x7f9d7c127b70 2020-01-16T05:45:13.296 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.292+0000 7f9d80a59700 1 -- 172.21.15.84:0/3528869356 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d7c09fc80 con 0x7f9d7c127b70 2020-01-16T05:45:13.297 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.296+0000 7f9d7b7fe700 1 --2- 172.21.15.84:0/3528869356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c127b70 0x7f9d7c0a71f0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f9d70001430 tx=0x7f9d7000c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:13.297 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.296+0000 7f9d78ff9700 1 -- 172.21.15.84:0/3528869356 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+1766 (secure 0 0 0) 0x7f9d70032e70 con 0x7f9d7c127b70 2020-01-16T05:45:13.297 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:13.297 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:44:39.544825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:13.299 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.296+0000 7f9d80a59700 1 -- 172.21.15.84:0/3528869356 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9d5c03c7d0 msgr2=0x7f9d5c03ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:13.299 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.296+0000 7f9d80a59700 1 --2- 172.21.15.84:0/3528869356 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9d5c03c7d0 0x7f9d5c03ece0 crc :-1 s=READY pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:13.299 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.296+0000 7f9d80a59700 1 -- 172.21.15.84:0/3528869356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c127b70 msgr2=0x7f9d7c0a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:13.299 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.296+0000 7f9d80a59700 1 --2- 172.21.15.84:0/3528869356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c127b70 0x7f9d7c0a71f0 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f9d70001430 tx=0x7f9d7000c4a0).stop 2020-01-16T05:45:13.299 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.296+0000 7f9d80a59700 1 -- 172.21.15.84:0/3528869356 shutdown_connections 2020-01-16T05:45:13.300 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.296+0000 7f9d80a59700 1 --2- 172.21.15.84:0/3528869356 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9d5c03c7d0 0x7f9d5c03ece0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:13.300 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.296+0000 7f9d80a59700 1 --2- 172.21.15.84:0/3528869356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d7c127b70 0x7f9d7c0a71f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:13.300 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.296+0000 7f9d80a59700 1 -- 172.21.15.84:0/3528869356 shutdown_connections 2020-01-16T05:45:13.300 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.296+0000 7f9d80a59700 1 -- 172.21.15.84:0/3528869356 wait complete. 2020-01-16T05:45:13.300 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:13.296+0000 7f9d80a59700 1 -- 172.21.15.84:0/3528869356 >> 172.21.15.84:0/3528869356 conn(0x7f9d7c07f160 msgr2=0x7f9d7c0a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:13.301 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2020-01-16T05:45:13.311 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2020-01-16T05:45:13.959 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:45:13.961 INFO:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:45:15.314 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:15.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.424+0000 7f2b5305a700 1 Processor -- start 2020-01-16T05:45:15.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.424+0000 7f2b5305a700 1 -- start start 2020-01-16T05:45:15.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.424+0000 7f2b5305a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2b4c0a9b30 0x7f2b4c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:15.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.424+0000 7f2b5305a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2b4c0a4250 0x7f2b4c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:15.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.424+0000 7f2b5305a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4c066dd0 con 0x7f2b4c07ff10 2020-01-16T05:45:15.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.424+0000 7f2b5305a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4c0a4830 con 0x7f2b4c0a4250 2020-01-16T05:45:15.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.424+0000 7f2b5305a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4c07f9d0 con 0x7f2b4c0a9b30 2020-01-16T05:45:15.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.424+0000 7f2b542bc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2b4c0a4250 0x7f2b4c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:15.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.424+0000 7f2b52058700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2b4c07ff10 0x7f2b4c0a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52208/0 (socket says 172.21.15.84:52208) 2020-01-16T05:45:15.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.424+0000 7f2b52058700 1 -- 172.21.15.84:0/2850907590 learned_addr learned my addr 172.21.15.84:0/2850907590 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:15.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.424+0000 7f2b52859700 1 --2- 172.21.15.84:0/2850907590 >> v2:172.21.15.142:3300/0 conn(0x7f2b4c0a9b30 0x7f2b4c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:15.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.424+0000 7f2b51857700 1 -- 172.21.15.84:0/2850907590 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790233128 0 0) 0x7f2b4c066dd0 con 0x7f2b4c07ff10 2020-01-16T05:45:15.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.424+0000 7f2b51857700 1 -- 172.21.15.84:0/2850907590 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b38003230 con 0x7f2b4c07ff10 2020-01-16T05:45:15.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.424+0000 7f2b542bc700 1 -- 172.21.15.84:0/2850907590 >> v2:172.21.15.142:3300/0 conn(0x7f2b4c0a9b30 msgr2=0x7f2b4c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:15.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.424+0000 7f2b542bc700 1 --2- 172.21.15.84:0/2850907590 >> v2:172.21.15.142:3300/0 conn(0x7f2b4c0a9b30 0x7f2b4c0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:15.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.424+0000 7f2b542bc700 1 -- 172.21.15.84:0/2850907590 >> v1:172.21.15.84:6789/0 conn(0x7f2b4c07ff10 legacy=0x7f2b4c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:15.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.424+0000 7f2b542bc700 1 -- 172.21.15.84:0/2850907590 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c150ce0 con 0x7f2b4c0a4250 2020-01-16T05:45:15.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b542bc700 1 --2- 172.21.15.84:0/2850907590 >> v2:172.21.15.84:3300/0 conn(0x7f2b4c0a4250 0x7f2b4c066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2b4c0a49f0 tx=0x7f2b44010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:15.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b542bc700 1 --2- 172.21.15.84:0/2850907590 >> v2:172.21.15.84:3300/0 conn(0x7f2b4c0a4250 0x7f2b4c066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2b4c0a49f0 tx=0x7f2b44010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:15.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b542bc700 1 --2- 172.21.15.84:0/2850907590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4c0a4250 0x7f2b4c066880 secure :-1 s=READY pgs=266 cs=0 l=1 rx=0x7f2b4c0a49f0 tx=0x7f2b44010170).ready entity=mon.0 client_cookie=4d9ef0e545382769 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:15.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b542bc700 1 --2- 172.21.15.84:0/2850907590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4c0a4250 0x7f2b4c066880 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f2b4c0a49f0 tx=0x7f2b44010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:15.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b51857700 1 -- 172.21.15.84:0/2850907590 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b4400a160 con 0x7f2b4c0a4250 2020-01-16T05:45:15.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b542bc700 1 --2- 172.21.15.84:0/2850907590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4c0a4250 0x7f2b4c066880 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f2b4c0a49f0 tx=0x7f2b44010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:15.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b51857700 1 -- 172.21.15.84:0/2850907590 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b44011ab0 con 0x7f2b4c0a4250 2020-01-16T05:45:15.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b542bc700 1 --2- 172.21.15.84:0/2850907590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4c0a4250 0x7f2b4c066880 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f2b4c0a49f0 tx=0x7f2b44010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:15.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b5305a700 1 -- 172.21.15.84:0/2850907590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4c0a4250 msgr2=0x7f2b4c066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:15.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b51857700 1 -- 172.21.15.84:0/2850907590 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b4400a740 con 0x7f2b4c0a4250 2020-01-16T05:45:15.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b5305a700 1 --2- 172.21.15.84:0/2850907590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4c0a4250 0x7f2b4c066880 secure :-1 s=READY pgs=266 cs=0 l=1 rx=0x7f2b4c0a49f0 tx=0x7f2b44010170).stop 2020-01-16T05:45:15.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b5305a700 1 -- 172.21.15.84:0/2850907590 shutdown_connections 2020-01-16T05:45:15.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b5305a700 1 --2- 172.21.15.84:0/2850907590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4c0a4250 0x7f2b4c066880 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:15.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b5305a700 1 --2- 172.21.15.84:0/2850907590 >> v2:172.21.15.142:3300/0 conn(0x7f2b4c0a9b30 0x7f2b4c0abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:15.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b5305a700 1 -- 172.21.15.84:0/2850907590 shutdown_connections 2020-01-16T05:45:15.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b5305a700 1 -- 172.21.15.84:0/2850907590 wait complete. 2020-01-16T05:45:15.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b5305a700 1 -- 172.21.15.84:0/2850907590 >> 172.21.15.84:0/2850907590 conn(0x7f2b4c0acfc0 msgr2=0x7f2b4c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:15.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b5305a700 1 Processor -- start 2020-01-16T05:45:15.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.428+0000 7f2b5305a700 1 -- start start 2020-01-16T05:45:15.446 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b5305a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2b4c07ce20 0x7f2b4c0912d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:15.446 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b5305a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4c08f210 con 0x7f2b4c1364c0 2020-01-16T05:45:15.447 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b5305a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4c07bd50 con 0x7f2b4c0a5740 2020-01-16T05:45:15.447 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b5305a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4c0918e0 con 0x7f2b4c07ce20 2020-01-16T05:45:15.447 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b542bc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2b4c1364c0 0x7f2b4c07b550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52216/0 (socket says 172.21.15.84:52216) 2020-01-16T05:45:15.448 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b542bc700 1 -- 172.21.15.84:0/1098955810 learned_addr learned my addr 172.21.15.84:0/1098955810 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:15.448 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b52859700 1 --2- 172.21.15.84:0/1098955810 >> v2:172.21.15.142:3300/0 conn(0x7f2b4c07ce20 0x7f2b4c0912d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:15.448 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b4b7fe700 1 -- 172.21.15.84:0/1098955810 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865984346 0 0) 0x7f2b4c08f210 con 0x7f2b4c1364c0 2020-01-16T05:45:15.448 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b4b7fe700 1 -- 172.21.15.84:0/1098955810 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b30003230 con 0x7f2b4c1364c0 2020-01-16T05:45:15.449 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b4b7fe700 1 -- 172.21.15.84:0/1098955810 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2177618404 0 0) 0x7f2b30003230 con 0x7f2b4c1364c0 2020-01-16T05:45:15.449 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b4b7fe700 1 -- 172.21.15.84:0/1098955810 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2b4c08f210 con 0x7f2b4c1364c0 2020-01-16T05:45:15.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b4b7fe700 1 -- 172.21.15.84:0/1098955810 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f2b4400a160 con 0x7f2b4c1364c0 2020-01-16T05:45:15.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b52859700 1 -- 172.21.15.84:0/1098955810 >> v1:172.21.15.142:6789/0 conn(0x7f2b4c0a5740 legacy=0x7f2b4c135cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:15.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b52859700 1 -- 172.21.15.84:0/1098955810 >> v1:172.21.15.84:6789/0 conn(0x7f2b4c1364c0 legacy=0x7f2b4c07b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:15.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b52859700 1 -- 172.21.15.84:0/1098955810 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c07bf80 con 0x7f2b4c07ce20 2020-01-16T05:45:15.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b52859700 1 --2- 172.21.15.84:0/1098955810 >> v2:172.21.15.142:3300/0 conn(0x7f2b4c07ce20 0x7f2b4c0912d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b34001090 tx=0x7f2b440087d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:15.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b52859700 1 --2- 172.21.15.84:0/1098955810 >> v2:172.21.15.142:3300/0 conn(0x7f2b4c07ce20 0x7f2b4c0912d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b34001090 tx=0x7f2b440087d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:15.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b52859700 1 --2- 172.21.15.84:0/1098955810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b4c07ce20 0x7f2b4c0912d0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f2b34001090 tx=0x7f2b440087d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:15.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b52859700 1 --2- 172.21.15.84:0/1098955810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b4c07ce20 0x7f2b4c0912d0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f2b34001090 tx=0x7f2b440087d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:15.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b4b7fe700 1 -- 172.21.15.84:0/1098955810 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b3c0058a0 con 0x7f2b4c07ce20 2020-01-16T05:45:15.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b52859700 1 --2- 172.21.15.84:0/1098955810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b4c07ce20 0x7f2b4c0912d0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f2b34001090 tx=0x7f2b440087d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:15.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b52859700 1 --2- 172.21.15.84:0/1098955810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b4c07ce20 0x7f2b4c0912d0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f2b34001090 tx=0x7f2b440087d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:15.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b5305a700 1 -- 172.21.15.84:0/1098955810 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4c07c250 con 0x7f2b4c07ce20 2020-01-16T05:45:15.455 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b4b7fe700 1 -- 172.21.15.84:0/1098955810 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3c007160 con 0x7f2b4c07ce20 2020-01-16T05:45:15.455 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b4b7fe700 1 -- 172.21.15.84:0/1098955810 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b3c0060c0 con 0x7f2b4c07ce20 2020-01-16T05:45:15.456 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.432+0000 7f2b5305a700 1 -- 172.21.15.84:0/1098955810 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c13e350 con 0x7f2b4c07ce20 2020-01-16T05:45:15.456 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.436+0000 7f2b52859700 1 --2- 172.21.15.84:0/1098955810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b4c07ce20 0x7f2b4c0912d0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f2b34001090 tx=0x7f2b440087d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:15.456 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.436+0000 7f2b5305a700 1 -- 172.21.15.84:0/1098955810 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4c05e1c0 con 0x7f2b4c07ce20 2020-01-16T05:45:15.456 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.436+0000 7f2b4b7fe700 1 -- 172.21.15.84:0/1098955810 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f2b3c0063a0 con 0x7f2b4c07ce20 2020-01-16T05:45:15.457 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.436+0000 7f2b52859700 1 --2- 172.21.15.84:0/1098955810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b4c07ce20 0x7f2b4c0912d0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f2b34001090 tx=0x7f2b440087d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:15.457 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.436+0000 7f2b4b7fe700 1 --2- 172.21.15.84:0/1098955810 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f2b3003cbc0 0x7f2b3003f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:15.458 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.436+0000 7f2b4b7fe700 1 -- 172.21.15.84:0/1098955810 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f2b3c04c4a0 con 0x7f2b4c07ce20 2020-01-16T05:45:15.458 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.436+0000 7f2b52058700 1 --2- 172.21.15.84:0/1098955810 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f2b3003cbc0 0x7f2b3003f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:15.458 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.436+0000 7f2b52058700 1 --2- 172.21.15.84:0/1098955810 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f2b3003cbc0 0x7f2b3003f0d0 crc :-1 s=READY pgs=105 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:15.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.444+0000 7f2b52859700 1 --2- 172.21.15.84:0/1098955810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b4c07ce20 0x7f2b4c0912d0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f2b34001090 tx=0x7f2b440087d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:15.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.444+0000 7f2b4b7fe700 1 -- 172.21.15.84:0/1098955810 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f2b3c00d0a0 con 0x7f2b4c07ce20 2020-01-16T05:45:15.599 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.596+0000 7f2b5305a700 1 -- 172.21.15.84:0/1098955810 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b4c05cbc0 con 0x7f2b4c07ce20 2020-01-16T05:45:15.600 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.596+0000 7f2b52859700 1 --2- 172.21.15.84:0/1098955810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b4c07ce20 0x7f2b4c0912d0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f2b34001090 tx=0x7f2b440087d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:15.600 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.596+0000 7f2b4b7fe700 1 -- 172.21.15.84:0/1098955810 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+1766 (secure 0 0 0) 0x7f2b3c032aa0 con 0x7f2b4c07ce20 2020-01-16T05:45:15.601 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:15.601 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:44:39.544825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:15.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.600+0000 7f2b5305a700 1 -- 172.21.15.84:0/1098955810 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f2b3003cbc0 msgr2=0x7f2b3003f0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:15.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.600+0000 7f2b5305a700 1 --2- 172.21.15.84:0/1098955810 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f2b3003cbc0 0x7f2b3003f0d0 crc :-1 s=READY pgs=105 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:15.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.600+0000 7f2b5305a700 1 -- 172.21.15.84:0/1098955810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b4c07ce20 msgr2=0x7f2b4c0912d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:15.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.600+0000 7f2b5305a700 1 --2- 172.21.15.84:0/1098955810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b4c07ce20 0x7f2b4c0912d0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f2b34001090 tx=0x7f2b440087d0).stop 2020-01-16T05:45:15.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.600+0000 7f2b5305a700 1 -- 172.21.15.84:0/1098955810 shutdown_connections 2020-01-16T05:45:15.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.600+0000 7f2b5305a700 1 --2- 172.21.15.84:0/1098955810 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f2b3003cbc0 0x7f2b3003f0d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:15.604 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.600+0000 7f2b5305a700 1 --2- 172.21.15.84:0/1098955810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b4c07ce20 0x7f2b4c0912d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:15.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.600+0000 7f2b5305a700 1 -- 172.21.15.84:0/1098955810 shutdown_connections 2020-01-16T05:45:15.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.600+0000 7f2b5305a700 1 -- 172.21.15.84:0/1098955810 wait complete. 2020-01-16T05:45:15.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:15.600+0000 7f2b5305a700 1 -- 172.21.15.84:0/1098955810 >> 172.21.15.84:0/1098955810 conn(0x7f2b4c0a40c0 msgr2=0x7f2b4c07dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:15.605 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2020-01-16T05:45:15.617 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2020-01-16T05:45:17.618 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:17.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.736+0000 7f1daf30c700 1 Processor -- start 2020-01-16T05:45:17.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.736+0000 7f1daf30c700 1 -- start start 2020-01-16T05:45:17.745 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1daf30c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1da80a2f60 0x7f1da805b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:17.745 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1daf30c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da807cd60 con 0x7f1da80a8ff0 2020-01-16T05:45:17.745 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1daf30c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da80a9420 con 0x7f1da808fd80 2020-01-16T05:45:17.745 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1daf30c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da80a3390 con 0x7f1da80a2f60 2020-01-16T05:45:17.745 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1dad8a9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1da80a2f60 0x7f1da805b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:17.745 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1dad8a9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1da80a2f60 0x7f1da805b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35034/0 (socket says 172.21.15.84:35034) 2020-01-16T05:45:17.745 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1dad8a9700 1 -- 172.21.15.84:0/3361442434 learned_addr learned my addr 172.21.15.84:0/3361442434 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:45:17.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1dad0a8700 1 --1- 172.21.15.84:0/3361442434 >> v1:172.21.15.84:6789/0 conn(0x7f1da80a8ff0 0x7f1da807c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52232/0 (socket says 172.21.15.84:52232) 2020-01-16T05:45:17.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1dad8a9700 1 -- 172.21.15.84:0/3361442434 >> v1:172.21.15.142:6789/0 conn(0x7f1da808fd80 legacy=0x7f1da81503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:17.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1dad8a9700 1 -- 172.21.15.84:0/3361442434 >> v1:172.21.15.84:6789/0 conn(0x7f1da80a8ff0 legacy=0x7f1da807c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:17.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1dad8a9700 1 -- 172.21.15.84:0/3361442434 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da808f570 con 0x7f1da80a2f60 2020-01-16T05:45:17.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1dac8a7700 1 -- 172.21.15.84:0/3361442434 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205224151 0 0) 0x7f1da807cd60 con 0x7f1da80a8ff0 2020-01-16T05:45:17.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/3361442434 >> v2:172.21.15.84:3300/0 conn(0x7f1da80a2f60 0x7f1da805b0f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1d980032b0 tx=0x7f1d980101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:17.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/3361442434 >> v2:172.21.15.84:3300/0 conn(0x7f1da80a2f60 0x7f1da805b0f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1d980032b0 tx=0x7f1d980101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/3361442434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1da80a2f60 0x7f1da805b0f0 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7f1d980032b0 tx=0x7f1d980101b0).ready entity=mon.0 client_cookie=c2c2c40a76a162cd server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/3361442434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1da80a2f60 0x7f1da805b0f0 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f1d980032b0 tx=0x7f1d980101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1dac8a7700 1 -- 172.21.15.84:0/3361442434 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d9800a160 con 0x7f1da80a2f60 2020-01-16T05:45:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/3361442434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1da80a2f60 0x7f1da805b0f0 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f1d980032b0 tx=0x7f1d980101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/3361442434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1da80a2f60 0x7f1da805b0f0 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f1d980032b0 tx=0x7f1d980101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1dac8a7700 1 -- 172.21.15.84:0/3361442434 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d98011be0 con 0x7f1da80a2f60 2020-01-16T05:45:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1dac8a7700 1 -- 172.21.15.84:0/3361442434 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d9800a740 con 0x7f1da80a2f60 2020-01-16T05:45:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1daf30c700 1 -- 172.21.15.84:0/3361442434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1da80a2f60 msgr2=0x7f1da805b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1daf30c700 1 --2- 172.21.15.84:0/3361442434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1da80a2f60 0x7f1da805b0f0 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7f1d980032b0 tx=0x7f1d980101b0).stop 2020-01-16T05:45:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1daf30c700 1 -- 172.21.15.84:0/3361442434 shutdown_connections 2020-01-16T05:45:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1daf30c700 1 --2- 172.21.15.84:0/3361442434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1da80a2f60 0x7f1da805b0f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1daf30c700 1 -- 172.21.15.84:0/3361442434 shutdown_connections 2020-01-16T05:45:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1daf30c700 1 -- 172.21.15.84:0/3361442434 wait complete. 2020-01-16T05:45:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1daf30c700 1 -- 172.21.15.84:0/3361442434 >> 172.21.15.84:0/3361442434 conn(0x7f1da80abc10 msgr2=0x7f1da805a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1daf30c700 1 Processor -- start 2020-01-16T05:45:17.749 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.740+0000 7f1daf30c700 1 -- start start 2020-01-16T05:45:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1daf30c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1da8065f80 0x7f1da80663b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1daf30c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da8066900 con 0x7f1da8123cd0 2020-01-16T05:45:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1daf30c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da8080160 con 0x7f1da813d580 2020-01-16T05:45:17.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1daf30c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da809ab90 con 0x7f1da8065f80 2020-01-16T05:45:17.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dad8a9700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1da8123cd0 0x7f1da8137860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52238/0 (socket says 172.21.15.84:52238) 2020-01-16T05:45:17.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dad8a9700 1 -- 172.21.15.84:0/2348035993 learned_addr learned my addr 172.21.15.84:0/2348035993 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:17.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dad0a8700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1da8065f80 0x7f1da80663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:17.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623955388 0 0) 0x7f1da8066900 con 0x7f1da8123cd0 2020-01-16T05:45:17.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d88003230 con 0x7f1da8123cd0 2020-01-16T05:45:17.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2606329203 0 0) 0x7f1d88003230 con 0x7f1da8123cd0 2020-01-16T05:45:17.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1da8066900 con 0x7f1da8123cd0 2020-01-16T05:45:17.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380760880 0 0) 0x7f1da8080160 con 0x7f1da813d580 2020-01-16T05:45:17.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d88003230 con 0x7f1da813d580 2020-01-16T05:45:17.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f1d9800a160 con 0x7f1da8123cd0 2020-01-16T05:45:17.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1da8065f80 msgr2=0x7f1da80663b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:17.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1da8065f80 0x7f1da80663b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:17.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 >> v1:172.21.15.142:6789/0 conn(0x7f1da813d580 legacy=0x7f1da813f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:17.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 >> v1:172.21.15.84:6789/0 conn(0x7f1da8123cd0 legacy=0x7f1da8137860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:17.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d88003c50 0x7f1d880045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:17.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d88004110 0x7f1d88004b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:17.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d88005180 0x7f1d8800b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:17.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da809ab90 con 0x7f1d88003c50 2020-01-16T05:45:17.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8800bf30 con 0x7f1d88005180 2020-01-16T05:45:17.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8800c170 con 0x7f1d88004110 2020-01-16T05:45:17.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dad0a8700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1da8065f80 0x7f1da80663b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:45:17.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d88003c50 0x7f1d880045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:17.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dae0aa700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d88005180 0x7f1d8800b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:17.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dad0a8700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d88004110 0x7f1d88004b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:17.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dad8a9700 1 -- 172.21.15.84:0/2348035993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d88004110 msgr2=0x7f1d88004b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:17.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d88004110 0x7f1d88004b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:17.758 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dad8a9700 1 -- 172.21.15.84:0/2348035993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d88005180 msgr2=0x7f1d8800b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:17.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d88005180 0x7f1d8800b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:17.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dad8a9700 1 -- 172.21.15.84:0/2348035993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da80a1310 con 0x7f1d88003c50 2020-01-16T05:45:17.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1daf30c700 1 -- 172.21.15.84:0/2348035993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da8064dc0 con 0x7f1d88003c50 2020-01-16T05:45:17.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dae0aa700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d88005180 0x7f1d8800b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:45:17.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d88003c50 0x7f1d880045a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d980081a0 tx=0x7f1d9800f300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:17.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1daf30c700 1 -- 172.21.15.84:0/2348035993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da8063ed0 con 0x7f1d88003c50 2020-01-16T05:45:17.760 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d88003c50 0x7f1d880045a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d980081a0 tx=0x7f1d9800f300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:17.760 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d88003c50 0x7f1d880045a0 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7f1d980081a0 tx=0x7f1d9800f300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:17.760 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d88003c50 0x7f1d880045a0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f1d980081a0 tx=0x7f1d9800f300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:17.760 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d9800f540 con 0x7f1d88003c50 2020-01-16T05:45:17.760 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d88003c50 0x7f1d880045a0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f1d980081a0 tx=0x7f1d9800f300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:17.760 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d88003c50 0x7f1d880045a0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f1d980081a0 tx=0x7f1d9800f300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:17.761 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d98005a40 con 0x7f1d88003c50 2020-01-16T05:45:17.761 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d9800fb20 con 0x7f1d88003c50 2020-01-16T05:45:17.761 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1daf30c700 1 -- 172.21.15.84:0/2348035993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d84003360 con 0x7f1d88003c50 2020-01-16T05:45:17.761 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.744+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d88003c50 0x7f1d880045a0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f1d980081a0 tx=0x7f1d9800f300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:17.761 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.748+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f1d98007150 con 0x7f1d88003c50 2020-01-16T05:45:17.762 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.748+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d88003c50 0x7f1d880045a0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f1d980081a0 tx=0x7f1d9800f300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:17.762 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.748+0000 7f1da67fc700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1d88045480 0x7f1d88047990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:17.762 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.748+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f1d9804db20 con 0x7f1d88003c50 2020-01-16T05:45:17.762 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.748+0000 7f1dad0a8700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1d88045480 0x7f1d88047990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:17.762 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.748+0000 7f1dad0a8700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1d88045480 0x7f1d88047990 crc :-1 s=READY pgs=106 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:17.763 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.752+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d88003c50 0x7f1d880045a0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f1d980081a0 tx=0x7f1d9800f300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:17.763 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.752+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f1d98034140 con 0x7f1d88003c50 2020-01-16T05:45:17.908 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.904+0000 7f1daf30c700 1 -- 172.21.15.84:0/2348035993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d84003790 con 0x7f1d88003c50 2020-01-16T05:45:17.909 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.908+0000 7f1dad8a9700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d88003c50 0x7f1d880045a0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f1d980081a0 tx=0x7f1d9800f300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:17.909 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.908+0000 7f1da67fc700 1 -- 172.21.15.84:0/2348035993 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+1766 (secure 0 0 0) 0x7f1d980343a0 con 0x7f1d88003c50 2020-01-16T05:45:17.909 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:17.909 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:44:39.544825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.908+0000 7f1daf30c700 1 -- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1d88045480 msgr2=0x7f1d88047990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.908+0000 7f1daf30c700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1d88045480 0x7f1d88047990 crc :-1 s=READY pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.908+0000 7f1daf30c700 1 -- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d88003c50 msgr2=0x7f1d880045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:17.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.908+0000 7f1daf30c700 1 --2- 172.21.15.84:0/2348035993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d88003c50 0x7f1d880045a0 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7f1d980081a0 tx=0x7f1d9800f300).stop 2020-01-16T05:45:17.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.908+0000 7f1dae0aa700 1 -- 172.21.15.84:0/2348035993 reap_dead start 2020-01-16T05:45:17.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.908+0000 7f1dae0aa700 1 -- 172.21.15.84:0/2348035993 reap_dead start 2020-01-16T05:45:17.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.908+0000 7f1daf30c700 1 -- 172.21.15.84:0/2348035993 shutdown_connections 2020-01-16T05:45:17.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.908+0000 7f1daf30c700 1 -- 172.21.15.84:0/2348035993 shutdown_connections 2020-01-16T05:45:17.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.908+0000 7f1daf30c700 1 -- 172.21.15.84:0/2348035993 wait complete. 2020-01-16T05:45:17.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:17.908+0000 7f1daf30c700 1 -- 172.21.15.84:0/2348035993 >> 172.21.15.84:0/2348035993 conn(0x7f1da808fa50 msgr2=0x7f1da8126b90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:17.913 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2020-01-16T05:45:17.923 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2020-01-16T05:45:18.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~51s 2020-01-16T05:45:19.924 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:20.045 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061f59e700 1 Processor -- start 2020-01-16T05:45:20.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061f59e700 1 -- start start 2020-01-16T05:45:20.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061f59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f06200a9b30 0x7f06200abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:20.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061f59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0620066880 con 0x7f06200a4250 2020-01-16T05:45:20.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061f59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0620066ab0 con 0x7f062007ff10 2020-01-16T05:45:20.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061f59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06200a4830 con 0x7f06200a9b30 2020-01-16T05:45:20.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f0624ee8700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f06200a4250 0x7f062014fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52256/0 (socket says 172.21.15.84:52256) 2020-01-16T05:45:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f0624ee8700 1 -- 172.21.15.84:0/1301000976 learned_addr learned my addr 172.21.15.84:0/1301000976 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061ed9d700 1 --2- 172.21.15.84:0/1301000976 >> v2:172.21.15.142:3300/0 conn(0x7f06200a9b30 0x7f06200abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061dd9b700 1 -- 172.21.15.84:0/1301000976 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221337248 0 0) 0x7f0620066880 con 0x7f06200a4250 2020-01-16T05:45:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061dd9b700 1 -- 172.21.15.84:0/1301000976 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f060c003230 con 0x7f06200a4250 2020-01-16T05:45:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061ed9d700 1 -- 172.21.15.84:0/1301000976 >> v1:172.21.15.142:6789/0 conn(0x7f062007ff10 legacy=0x7f06200a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061ed9d700 1 -- 172.21.15.84:0/1301000976 >> v1:172.21.15.84:6789/0 conn(0x7f06200a4250 legacy=0x7f062014fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061dd9b700 1 -- 172.21.15.84:0/1301000976 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719179297 0 0) 0x7f0620066ab0 con 0x7f062007ff10 2020-01-16T05:45:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061ed9d700 1 -- 172.21.15.84:0/1301000976 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0620066ce0 con 0x7f06200a9b30 2020-01-16T05:45:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061ed9d700 1 --2- 172.21.15.84:0/1301000976 >> v2:172.21.15.142:3300/0 conn(0x7f06200a9b30 0x7f06200abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0610008c90 tx=0x7f06100100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061ed9d700 1 --2- 172.21.15.84:0/1301000976 >> v2:172.21.15.142:3300/0 conn(0x7f06200a9b30 0x7f06200abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0610008c90 tx=0x7f06100100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061ed9d700 1 --2- 172.21.15.84:0/1301000976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06200a9b30 0x7f06200abdd0 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f0610008c90 tx=0x7f06100100f0).ready entity=mon.1 client_cookie=4ea55097d4086b35 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061ed9d700 1 --2- 172.21.15.84:0/1301000976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06200a9b30 0x7f06200abdd0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f0610008c90 tx=0x7f06100100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061dd9b700 1 -- 172.21.15.84:0/1301000976 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f061000a160 con 0x7f06200a9b30 2020-01-16T05:45:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061ed9d700 1 --2- 172.21.15.84:0/1301000976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06200a9b30 0x7f06200abdd0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f0610008c90 tx=0x7f06100100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:20.049 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061ed9d700 1 --2- 172.21.15.84:0/1301000976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06200a9b30 0x7f06200abdd0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f0610008c90 tx=0x7f06100100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:20.049 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061dd9b700 1 -- 172.21.15.84:0/1301000976 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0610011b60 con 0x7f06200a9b30 2020-01-16T05:45:20.049 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061dd9b700 1 -- 172.21.15.84:0/1301000976 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f061000a740 con 0x7f06200a9b30 2020-01-16T05:45:20.049 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061f59e700 1 -- 172.21.15.84:0/1301000976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06200a9b30 msgr2=0x7f06200abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:20.049 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.040+0000 7f061f59e700 1 --2- 172.21.15.84:0/1301000976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06200a9b30 0x7f06200abdd0 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f0610008c90 tx=0x7f06100100f0).stop 2020-01-16T05:45:20.049 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061f59e700 1 -- 172.21.15.84:0/1301000976 shutdown_connections 2020-01-16T05:45:20.050 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061f59e700 1 --2- 172.21.15.84:0/1301000976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06200a9b30 0x7f06200abdd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:20.050 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061f59e700 1 -- 172.21.15.84:0/1301000976 shutdown_connections 2020-01-16T05:45:20.050 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061f59e700 1 -- 172.21.15.84:0/1301000976 wait complete. 2020-01-16T05:45:20.050 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061f59e700 1 -- 172.21.15.84:0/1301000976 >> 172.21.15.84:0/1301000976 conn(0x7f06200acfc0 msgr2=0x7f06200a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:20.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061f59e700 1 Processor -- start 2020-01-16T05:45:20.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061f59e700 1 -- start start 2020-01-16T05:45:20.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061f59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0620126330 0x7f06200a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:20.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061f59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f06200a0e10 0x7f06200a2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:20.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061f59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06200a23d0 con 0x7f06200a2ec0 2020-01-16T05:45:20.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061f59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06200a1640 con 0x7f0620126330 2020-01-16T05:45:20.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061f59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06200a26d0 con 0x7f06200a0e10 2020-01-16T05:45:20.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061ed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0620126330 0x7f06200a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:20.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061ed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0620126330 0x7f06200a5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35062/0 (socket says 172.21.15.84:35062) 2020-01-16T05:45:20.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061ed9d700 1 -- 172.21.15.84:0/719136763 learned_addr learned my addr 172.21.15.84:0/719136763 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:45:20.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061e59c700 1 --2- 172.21.15.84:0/719136763 >> v2:172.21.15.142:3300/0 conn(0x7f06200a0e10 0x7f06200a2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:20.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061ed9d700 1 -- 172.21.15.84:0/719136763 >> v2:172.21.15.142:3300/0 conn(0x7f06200a0e10 msgr2=0x7f06200a2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:20.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061ed9d700 1 --2- 172.21.15.84:0/719136763 >> v2:172.21.15.142:3300/0 conn(0x7f06200a0e10 0x7f06200a2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:20.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061ed9d700 1 -- 172.21.15.84:0/719136763 >> v1:172.21.15.142:6789/0 conn(0x7f06200a2ec0 legacy=0x7f062007bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:20.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061ed9d700 1 -- 172.21.15.84:0/719136763 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062007c3b0 con 0x7f0620126330 2020-01-16T05:45:20.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061ed9d700 1 --2- 172.21.15.84:0/719136763 >> v2:172.21.15.84:3300/0 conn(0x7f0620126330 0x7f06200a5720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0610008c90 tx=0x7f0610011e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:20.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061ed9d700 1 --2- 172.21.15.84:0/719136763 >> v2:172.21.15.84:3300/0 conn(0x7f0620126330 0x7f06200a5720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0610008c90 tx=0x7f0610011e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:20.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061ed9d700 1 --2- 172.21.15.84:0/719136763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0620126330 0x7f06200a5720 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f0610008c90 tx=0x7f0610011e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061ed9d700 1 --2- 172.21.15.84:0/719136763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0620126330 0x7f06200a5720 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f0610008c90 tx=0x7f0610011e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061ed9d700 1 --2- 172.21.15.84:0/719136763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0620126330 0x7f06200a5720 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f0610008c90 tx=0x7f0610011e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f06177fe700 1 -- 172.21.15.84:0/719136763 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0610005a40 con 0x7f0620126330 2020-01-16T05:45:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061ed9d700 1 --2- 172.21.15.84:0/719136763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0620126330 0x7f06200a5720 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f0610008c90 tx=0x7f0610011e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f06177fe700 1 -- 172.21.15.84:0/719136763 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061000a360 con 0x7f0620126330 2020-01-16T05:45:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f061f59e700 1 -- 172.21.15.84:0/719136763 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06200a1240 con 0x7f0620126330 2020-01-16T05:45:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.044+0000 7f06177fe700 1 -- 172.21.15.84:0/719136763 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0610007340 con 0x7f0620126330 2020-01-16T05:45:20.058 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.048+0000 7f061f59e700 1 -- 172.21.15.84:0/719136763 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062013d130 con 0x7f0620126330 2020-01-16T05:45:20.058 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.048+0000 7f061ed9d700 1 --2- 172.21.15.84:0/719136763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0620126330 0x7f06200a5720 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f0610008c90 tx=0x7f0610011e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:20.058 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.048+0000 7f06177fe700 1 -- 172.21.15.84:0/719136763 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f0610007650 con 0x7f0620126330 2020-01-16T05:45:20.058 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.048+0000 7f061ed9d700 1 --2- 172.21.15.84:0/719136763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0620126330 0x7f06200a5720 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f0610008c90 tx=0x7f0610011e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:20.058 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.048+0000 7f061f59e700 1 -- 172.21.15.84:0/719136763 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062005e1c0 con 0x7f0620126330 2020-01-16T05:45:20.058 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.048+0000 7f06177fe700 1 --2- 172.21.15.84:0/719136763 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f060403c270 0x7f060403e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:20.058 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.048+0000 7f06177fe700 1 -- 172.21.15.84:0/719136763 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f061004d700 con 0x7f0620126330 2020-01-16T05:45:20.059 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.048+0000 7f061e59c700 1 --2- 172.21.15.84:0/719136763 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f060403c270 0x7f060403e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:20.059 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.048+0000 7f061e59c700 1 --2- 172.21.15.84:0/719136763 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f060403c270 0x7f060403e780 crc :-1 s=READY pgs=107 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:20.059 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.052+0000 7f061ed9d700 1 --2- 172.21.15.84:0/719136763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0620126330 0x7f06200a5720 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f0610008c90 tx=0x7f0610011e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:20.059 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.052+0000 7f06177fe700 1 -- 172.21.15.84:0/719136763 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f0610033d20 con 0x7f0620126330 2020-01-16T05:45:20.206 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.204+0000 7f061f59e700 1 -- 172.21.15.84:0/719136763 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f062005cbc0 con 0x7f0620126330 2020-01-16T05:45:20.207 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.204+0000 7f061ed9d700 1 --2- 172.21.15.84:0/719136763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0620126330 0x7f06200a5720 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f0610008c90 tx=0x7f0610011e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:20.207 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.204+0000 7f06177fe700 1 -- 172.21.15.84:0/719136763 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+1766 (secure 0 0 0) 0x7f0610033f80 con 0x7f0620126330 2020-01-16T05:45:20.207 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:20.208 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:44:39.544825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:20.211 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.208+0000 7f061f59e700 1 -- 172.21.15.84:0/719136763 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f060403c270 msgr2=0x7f060403e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:20.211 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.208+0000 7f061f59e700 1 --2- 172.21.15.84:0/719136763 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f060403c270 0x7f060403e780 crc :-1 s=READY pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:20.211 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.208+0000 7f061f59e700 1 -- 172.21.15.84:0/719136763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0620126330 msgr2=0x7f06200a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:20.212 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.208+0000 7f061f59e700 1 --2- 172.21.15.84:0/719136763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0620126330 0x7f06200a5720 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f0610008c90 tx=0x7f0610011e10).stop 2020-01-16T05:45:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.208+0000 7f061f59e700 1 -- 172.21.15.84:0/719136763 shutdown_connections 2020-01-16T05:45:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.208+0000 7f061f59e700 1 --2- 172.21.15.84:0/719136763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0620126330 0x7f06200a5720 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.208+0000 7f061f59e700 1 --2- 172.21.15.84:0/719136763 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f060403c270 0x7f060403e780 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.208+0000 7f061f59e700 1 --2- 172.21.15.84:0/719136763 >> v2:172.21.15.142:3300/0 conn(0x7f06200a0e10 0x7f06200a2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:20.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.208+0000 7f061f59e700 1 -- 172.21.15.84:0/719136763 shutdown_connections 2020-01-16T05:45:20.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.208+0000 7f061f59e700 1 -- 172.21.15.84:0/719136763 wait complete. 2020-01-16T05:45:20.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:20.208+0000 7f061f59e700 1 -- 172.21.15.84:0/719136763 >> 172.21.15.84:0/719136763 conn(0x7f06200acfc0 msgr2=0x7f06200246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:20.214 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2020-01-16T05:45:20.225 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2020-01-16T05:45:22.225 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:22.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.344+0000 7fdbee843700 1 Processor -- start 2020-01-16T05:45:22.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.344+0000 7fdbee843700 1 -- start start 2020-01-16T05:45:22.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.344+0000 7fdbee843700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdbe80a4250 0x7fdbe80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:22.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.344+0000 7fdbee843700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe8066880 con 0x7fdbe80a9b30 2020-01-16T05:45:22.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.344+0000 7fdbee843700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe8066ab0 con 0x7fdbe807ff10 2020-01-16T05:45:22.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.344+0000 7fdbee843700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe80a4830 con 0x7fdbe80a4250 2020-01-16T05:45:22.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.344+0000 7fdbee042700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdbe80a9b30 0x7fdbe80a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52272/0 (socket says 172.21.15.84:52272) 2020-01-16T05:45:22.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.344+0000 7fdbee042700 1 -- 172.21.15.84:0/3837264852 learned_addr learned my addr 172.21.15.84:0/3837264852 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:22.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.344+0000 7fdbefaa5700 1 --2- 172.21.15.84:0/3837264852 >> v2:172.21.15.142:3300/0 conn(0x7fdbe80a4250 0x7fdbe80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:22.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbed040700 1 -- 172.21.15.84:0/3837264852 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838607351 0 0) 0x7fdbe8066880 con 0x7fdbe80a9b30 2020-01-16T05:45:22.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbed040700 1 -- 172.21.15.84:0/3837264852 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbd4003230 con 0x7fdbe80a9b30 2020-01-16T05:45:22.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbed040700 1 -- 172.21.15.84:0/3837264852 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408982300 0 0) 0x7fdbe8066ab0 con 0x7fdbe807ff10 2020-01-16T05:45:22.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbed040700 1 -- 172.21.15.84:0/3837264852 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbe8066880 con 0x7fdbe807ff10 2020-01-16T05:45:22.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbefaa5700 1 -- 172.21.15.84:0/3837264852 >> v1:172.21.15.142:6789/0 conn(0x7fdbe807ff10 legacy=0x7fdbe814dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:22.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbefaa5700 1 -- 172.21.15.84:0/3837264852 >> v1:172.21.15.84:6789/0 conn(0x7fdbe80a9b30 legacy=0x7fdbe80a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:22.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbefaa5700 1 -- 172.21.15.84:0/3837264852 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe8066ce0 con 0x7fdbe80a4250 2020-01-16T05:45:22.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbefaa5700 1 --2- 172.21.15.84:0/3837264852 >> v2:172.21.15.142:3300/0 conn(0x7fdbe80a4250 0x7fdbe80abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdbe0008c90 tx=0x7fdbe00100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:22.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbefaa5700 1 --2- 172.21.15.84:0/3837264852 >> v2:172.21.15.142:3300/0 conn(0x7fdbe80a4250 0x7fdbe80abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdbe0008c90 tx=0x7fdbe00100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:22.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbefaa5700 1 --2- 172.21.15.84:0/3837264852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe80a4250 0x7fdbe80abdd0 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7fdbe0008c90 tx=0x7fdbe00100f0).ready entity=mon.1 client_cookie=abbf3e54822fff49 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:22.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbefaa5700 1 --2- 172.21.15.84:0/3837264852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe80a4250 0x7fdbe80abdd0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7fdbe0008c90 tx=0x7fdbe00100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:22.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbed040700 1 -- 172.21.15.84:0/3837264852 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbe000a160 con 0x7fdbe80a4250 2020-01-16T05:45:22.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbefaa5700 1 --2- 172.21.15.84:0/3837264852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe80a4250 0x7fdbe80abdd0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7fdbe0008c90 tx=0x7fdbe00100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:22.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbefaa5700 1 --2- 172.21.15.84:0/3837264852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe80a4250 0x7fdbe80abdd0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7fdbe0008c90 tx=0x7fdbe00100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:22.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbed040700 1 -- 172.21.15.84:0/3837264852 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe0011b60 con 0x7fdbe80a4250 2020-01-16T05:45:22.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbed040700 1 -- 172.21.15.84:0/3837264852 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbe000a740 con 0x7fdbe80a4250 2020-01-16T05:45:22.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbee843700 1 -- 172.21.15.84:0/3837264852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe80a4250 msgr2=0x7fdbe80abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:22.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbee843700 1 --2- 172.21.15.84:0/3837264852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe80a4250 0x7fdbe80abdd0 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7fdbe0008c90 tx=0x7fdbe00100f0).stop 2020-01-16T05:45:22.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbee843700 1 -- 172.21.15.84:0/3837264852 shutdown_connections 2020-01-16T05:45:22.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbee843700 1 --2- 172.21.15.84:0/3837264852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe80a4250 0x7fdbe80abdd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:22.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbee843700 1 -- 172.21.15.84:0/3837264852 shutdown_connections 2020-01-16T05:45:22.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbee843700 1 -- 172.21.15.84:0/3837264852 wait complete. 2020-01-16T05:45:22.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.348+0000 7fdbee843700 1 -- 172.21.15.84:0/3837264852 >> 172.21.15.84:0/3837264852 conn(0x7fdbe80acfc0 msgr2=0x7fdbe80a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:22.359 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.352+0000 7fdbee843700 1 Processor -- start 2020-01-16T05:45:22.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.352+0000 7fdbee843700 1 -- start start 2020-01-16T05:45:22.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.352+0000 7fdbee843700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbe8134d10 0x7fdbe808f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:22.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.352+0000 7fdbee843700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdbe808f930 0x7fdbe8127220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:22.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.352+0000 7fdbee843700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe8127f70 con 0x7fdbe8126560 2020-01-16T05:45:22.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.352+0000 7fdbee843700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe8124c20 con 0x7fdbe808f930 2020-01-16T05:45:22.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.352+0000 7fdbee843700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe8123fe0 con 0x7fdbe8134d10 2020-01-16T05:45:22.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.352+0000 7fdbed841700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdbe808f930 0x7fdbe8127220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:22.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.352+0000 7fdbed841700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdbe808f930 0x7fdbe8127220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35080/0 (socket says 172.21.15.84:35080) 2020-01-16T05:45:22.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.352+0000 7fdbed841700 1 -- 172.21.15.84:0/1618024425 learned_addr learned my addr 172.21.15.84:0/1618024425 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:45:22.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.352+0000 7fdbee042700 1 --2- 172.21.15.84:0/1618024425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbe8134d10 0x7fdbe808f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:22.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.352+0000 7fdbdeffd700 1 -- 172.21.15.84:0/1618024425 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104125763 0 0) 0x7fdbe8127f70 con 0x7fdbe8126560 2020-01-16T05:45:22.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbed841700 1 -- 172.21.15.84:0/1618024425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbe8134d10 msgr2=0x7fdbe808f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:22.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbed841700 1 --2- 172.21.15.84:0/1618024425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbe8134d10 0x7fdbe808f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:22.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbed841700 1 -- 172.21.15.84:0/1618024425 >> v1:172.21.15.142:6789/0 conn(0x7fdbe8126560 legacy=0x7fdbe8127770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:22.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbed841700 1 -- 172.21.15.84:0/1618024425 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe807f670 con 0x7fdbe808f930 2020-01-16T05:45:22.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbed841700 1 --2- 172.21.15.84:0/1618024425 >> v2:172.21.15.84:3300/0 conn(0x7fdbe808f930 0x7fdbe8127220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdbd8000e90 tx=0x7fdbd8010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:22.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbed841700 1 --2- 172.21.15.84:0/1618024425 >> v2:172.21.15.84:3300/0 conn(0x7fdbe808f930 0x7fdbe8127220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdbd8000e90 tx=0x7fdbd8010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:22.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbed841700 1 --2- 172.21.15.84:0/1618024425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbe808f930 0x7fdbe8127220 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7fdbd8000e90 tx=0x7fdbd8010b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbed841700 1 --2- 172.21.15.84:0/1618024425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbe808f930 0x7fdbe8127220 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fdbd8000e90 tx=0x7fdbd8010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbdeffd700 1 -- 172.21.15.84:0/1618024425 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbd800cc20 con 0x7fdbe808f930 2020-01-16T05:45:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbed841700 1 --2- 172.21.15.84:0/1618024425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbe808f930 0x7fdbe8127220 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fdbd8000e90 tx=0x7fdbd8010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbee843700 1 -- 172.21.15.84:0/1618024425 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe8066220 con 0x7fdbe808f930 2020-01-16T05:45:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbdeffd700 1 -- 172.21.15.84:0/1618024425 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd800c840 con 0x7fdbe808f930 2020-01-16T05:45:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbed841700 1 --2- 172.21.15.84:0/1618024425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbe808f930 0x7fdbe8127220 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fdbd8000e90 tx=0x7fdbd8010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbdeffd700 1 -- 172.21.15.84:0/1618024425 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbd8012580 con 0x7fdbe808f930 2020-01-16T05:45:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbee843700 1 -- 172.21.15.84:0/1618024425 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe8124710 con 0x7fdbe808f930 2020-01-16T05:45:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbed841700 1 --2- 172.21.15.84:0/1618024425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbe808f930 0x7fdbe8127220 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fdbd8000e90 tx=0x7fdbd8010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbdeffd700 1 -- 172.21.15.84:0/1618024425 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fdbd8012860 con 0x7fdbe808f930 2020-01-16T05:45:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbed841700 1 --2- 172.21.15.84:0/1618024425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbe808f930 0x7fdbe8127220 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fdbd8000e90 tx=0x7fdbd8010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbee843700 1 -- 172.21.15.84:0/1618024425 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe805e1c0 con 0x7fdbe808f930 2020-01-16T05:45:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbdeffd700 1 --2- 172.21.15.84:0/1618024425 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdbd003c140 0x7fdbd003e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbdeffd700 1 -- 172.21.15.84:0/1618024425 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fdbd804cb20 con 0x7fdbe808f930 2020-01-16T05:45:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbee042700 1 --2- 172.21.15.84:0/1618024425 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdbd003c140 0x7fdbd003e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:22.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.356+0000 7fdbee042700 1 --2- 172.21.15.84:0/1618024425 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdbd003c140 0x7fdbd003e650 crc :-1 s=READY pgs=108 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:22.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.364+0000 7fdbed841700 1 --2- 172.21.15.84:0/1618024425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbe808f930 0x7fdbe8127220 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fdbd8000e90 tx=0x7fdbd8010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:22.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.364+0000 7fdbdeffd700 1 -- 172.21.15.84:0/1618024425 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fdbd8010310 con 0x7fdbe808f930 2020-01-16T05:45:22.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.516+0000 7fdbee843700 1 -- 172.21.15.84:0/1618024425 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbe808ef10 con 0x7fdbe808f930 2020-01-16T05:45:22.520 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.516+0000 7fdbed841700 1 --2- 172.21.15.84:0/1618024425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbe808f930 0x7fdbe8127220 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fdbd8000e90 tx=0x7fdbd8010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:22.520 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.516+0000 7fdbdeffd700 1 -- 172.21.15.84:0/1618024425 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+1766 (secure 0 0 0) 0x7fdbd8033120 con 0x7fdbe808f930 2020-01-16T05:45:22.520 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:22.520 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:44:39.544825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:22.522 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.520+0000 7fdbee843700 1 -- 172.21.15.84:0/1618024425 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdbd003c140 msgr2=0x7fdbd003e650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:22.522 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.520+0000 7fdbee843700 1 --2- 172.21.15.84:0/1618024425 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdbd003c140 0x7fdbd003e650 crc :-1 s=READY pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:22.522 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.520+0000 7fdbee843700 1 -- 172.21.15.84:0/1618024425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbe808f930 msgr2=0x7fdbe8127220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:22.522 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.520+0000 7fdbee843700 1 --2- 172.21.15.84:0/1618024425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbe808f930 0x7fdbe8127220 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7fdbd8000e90 tx=0x7fdbd8010b20).stop 2020-01-16T05:45:22.522 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.520+0000 7fdbee843700 1 -- 172.21.15.84:0/1618024425 shutdown_connections 2020-01-16T05:45:22.522 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.520+0000 7fdbee843700 1 --2- 172.21.15.84:0/1618024425 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdbd003c140 0x7fdbd003e650 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:22.523 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.520+0000 7fdbee843700 1 --2- 172.21.15.84:0/1618024425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbe8134d10 0x7fdbe808f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:22.523 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.520+0000 7fdbee843700 1 --2- 172.21.15.84:0/1618024425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbe808f930 0x7fdbe8127220 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:22.523 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.520+0000 7fdbee843700 1 -- 172.21.15.84:0/1618024425 shutdown_connections 2020-01-16T05:45:22.523 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.520+0000 7fdbee843700 1 -- 172.21.15.84:0/1618024425 wait complete. 2020-01-16T05:45:22.523 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:22.520+0000 7fdbee843700 1 -- 172.21.15.84:0/1618024425 >> 172.21.15.84:0/1618024425 conn(0x7fdbe80a9b30 msgr2=0x7fdbe807ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:22.524 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2020-01-16T05:45:22.539 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2020-01-16T05:45:24.540 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.652+0000 7f70e98e7700 1 Processor -- start 2020-01-16T05:45:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e98e7700 1 -- start start 2020-01-16T05:45:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e98e7700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f70e407ff10 0x7f70e40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e98e7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70e40a4250 0x7f70e4066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e98e7700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e4066dd0 con 0x7f70e40a9b30 2020-01-16T05:45:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e98e7700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e40a4830 con 0x7f70e407ff10 2020-01-16T05:45:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e98e7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e407f9d0 con 0x7f70e40a4250 2020-01-16T05:45:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70eab49700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70e40a4250 0x7f70e4066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e88e5700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f70e407ff10 0x7f70e40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e90e6700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f70e40a9b30 0x7f70e40a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:50516/0 (socket says 172.21.15.84:50516) 2020-01-16T05:45:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70eab49700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70e40a4250 0x7f70e4066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:47338/0 (socket says 172.21.15.84:47338) 2020-01-16T05:45:24.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e90e6700 1 -- 172.21.15.84:0/2558415446 learned_addr learned my addr 172.21.15.84:0/2558415446 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:24.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e88e5700 1 -- 172.21.15.84:0/2558415446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70e40a4250 msgr2=0x7f70e4066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:24.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e88e5700 1 --2- 172.21.15.84:0/2558415446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70e40a4250 0x7f70e4066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:24.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e88e5700 1 -- 172.21.15.84:0/2558415446 >> v1:172.21.15.142:6789/0 conn(0x7f70e40a9b30 legacy=0x7f70e40a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:24.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70dbfff700 1 -- 172.21.15.84:0/2558415446 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185218172 0 0) 0x7f70e4066dd0 con 0x7f70e40a9b30 2020-01-16T05:45:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e88e5700 1 -- 172.21.15.84:0/2558415446 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e4150ce0 con 0x7f70e407ff10 2020-01-16T05:45:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70eab49700 1 --2- 172.21.15.84:0/2558415446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70e40a4250 0x7f70e4066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:45:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e88e5700 1 --2- 172.21.15.84:0/2558415446 >> v2:172.21.15.142:3300/0 conn(0x7f70e407ff10 0x7f70e40abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f70e40a49f0 tx=0x7f70d400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e88e5700 1 --2- 172.21.15.84:0/2558415446 >> v2:172.21.15.142:3300/0 conn(0x7f70e407ff10 0x7f70e40abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f70e40a49f0 tx=0x7f70d400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e88e5700 1 --2- 172.21.15.84:0/2558415446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e407ff10 0x7f70e40abdd0 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f70e40a49f0 tx=0x7f70d400fdf0).ready entity=mon.1 client_cookie=1464adaa69f8c95b server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e88e5700 1 --2- 172.21.15.84:0/2558415446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e407ff10 0x7f70e40abdd0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f70e40a49f0 tx=0x7f70d400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70dbfff700 1 -- 172.21.15.84:0/2558415446 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70d4011660 con 0x7f70e407ff10 2020-01-16T05:45:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e88e5700 1 --2- 172.21.15.84:0/2558415446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e407ff10 0x7f70e40abdd0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f70e40a49f0 tx=0x7f70d400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70e88e5700 1 --2- 172.21.15.84:0/2558415446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e407ff10 0x7f70e40abdd0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f70e40a49f0 tx=0x7f70d400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.656+0000 7f70dbfff700 1 -- 172.21.15.84:0/2558415446 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d4008c50 con 0x7f70e407ff10 2020-01-16T05:45:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.660+0000 7f70dbfff700 1 -- 172.21.15.84:0/2558415446 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70d4011c40 con 0x7f70e407ff10 2020-01-16T05:45:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.660+0000 7f70e98e7700 1 -- 172.21.15.84:0/2558415446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e407ff10 msgr2=0x7f70e40abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.660+0000 7f70e98e7700 1 --2- 172.21.15.84:0/2558415446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e407ff10 0x7f70e40abdd0 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f70e40a49f0 tx=0x7f70d400fdf0).stop 2020-01-16T05:45:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.660+0000 7f70e98e7700 1 -- 172.21.15.84:0/2558415446 shutdown_connections 2020-01-16T05:45:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.660+0000 7f70e98e7700 1 --2- 172.21.15.84:0/2558415446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70e40a4250 0x7f70e4066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.660+0000 7f70e98e7700 1 --2- 172.21.15.84:0/2558415446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e407ff10 0x7f70e40abdd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.660+0000 7f70e98e7700 1 -- 172.21.15.84:0/2558415446 shutdown_connections 2020-01-16T05:45:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.660+0000 7f70e98e7700 1 -- 172.21.15.84:0/2558415446 wait complete. 2020-01-16T05:45:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.660+0000 7f70e98e7700 1 -- 172.21.15.84:0/2558415446 >> 172.21.15.84:0/2558415446 conn(0x7f70e40acfc0 msgr2=0x7f70e40a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.660+0000 7f70e98e7700 1 Processor -- start 2020-01-16T05:45:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.660+0000 7f70e98e7700 1 -- start start 2020-01-16T05:45:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e98e7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f70e407bdc0 0x7f70e4124fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e98e7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70e40a7420 0x7f70e4125530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e98e7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e408f5b0 con 0x7f70e409ecd0 2020-01-16T05:45:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e98e7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e408f990 con 0x7f70e407bdc0 2020-01-16T05:45:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e98e7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e408fc30 con 0x7f70e40a7420 2020-01-16T05:45:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e90e6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f70e407bdc0 0x7f70e4124fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70eab49700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f70e409ecd0 0x7f70e409f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52300/0 (socket says 172.21.15.84:52300) 2020-01-16T05:45:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70eab49700 1 -- 172.21.15.84:0/775581643 learned_addr learned my addr 172.21.15.84:0/775581643 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e88e5700 1 --2- 172.21.15.84:0/775581643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70e40a7420 0x7f70e4125530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70d9ffb700 1 -- 172.21.15.84:0/775581643 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052666444 0 0) 0x7f70e408f5b0 con 0x7f70e409ecd0 2020-01-16T05:45:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70d9ffb700 1 -- 172.21.15.84:0/775581643 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70c4003230 con 0x7f70e409ecd0 2020-01-16T05:45:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e90e6700 1 -- 172.21.15.84:0/775581643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70e40a7420 msgr2=0x7f70e4125530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e90e6700 1 --2- 172.21.15.84:0/775581643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70e40a7420 0x7f70e4125530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e90e6700 1 -- 172.21.15.84:0/775581643 >> v1:172.21.15.84:6789/0 conn(0x7f70e409ecd0 legacy=0x7f70e409f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e90e6700 1 -- 172.21.15.84:0/775581643 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e409f900 con 0x7f70e407bdc0 2020-01-16T05:45:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e90e6700 1 --2- 172.21.15.84:0/775581643 >> v2:172.21.15.84:3300/0 conn(0x7f70e407bdc0 0x7f70e4124fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f70e409fec0 tx=0x7f70e0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:24.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e90e6700 1 --2- 172.21.15.84:0/775581643 >> v2:172.21.15.84:3300/0 conn(0x7f70e407bdc0 0x7f70e4124fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f70e409fec0 tx=0x7f70e0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:24.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e90e6700 1 --2- 172.21.15.84:0/775581643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70e407bdc0 0x7f70e4124fe0 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7f70e409fec0 tx=0x7f70e0010a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:24.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e90e6700 1 --2- 172.21.15.84:0/775581643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70e407bdc0 0x7f70e4124fe0 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f70e409fec0 tx=0x7f70e0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:24.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70d9ffb700 1 -- 172.21.15.84:0/775581643 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70e000d0c0 con 0x7f70e407bdc0 2020-01-16T05:45:24.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e90e6700 1 --2- 172.21.15.84:0/775581643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70e407bdc0 0x7f70e4124fe0 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f70e409fec0 tx=0x7f70e0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70d9ffb700 1 -- 172.21.15.84:0/775581643 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e0011420 con 0x7f70e407bdc0 2020-01-16T05:45:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e90e6700 1 --2- 172.21.15.84:0/775581643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70e407bdc0 0x7f70e4124fe0 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f70e409fec0 tx=0x7f70e0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e98e7700 1 -- 172.21.15.84:0/775581643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e4126ca0 con 0x7f70e407bdc0 2020-01-16T05:45:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70d9ffb700 1 -- 172.21.15.84:0/775581643 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70e000d6a0 con 0x7f70e407bdc0 2020-01-16T05:45:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.664+0000 7f70e98e7700 1 -- 172.21.15.84:0/775581643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e413c510 con 0x7f70e407bdc0 2020-01-16T05:45:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.668+0000 7f70e90e6700 1 --2- 172.21.15.84:0/775581643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70e407bdc0 0x7f70e4124fe0 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f70e409fec0 tx=0x7f70e0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.668+0000 7f70d9ffb700 1 -- 172.21.15.84:0/775581643 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f70e000d980 con 0x7f70e407bdc0 2020-01-16T05:45:24.680 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.668+0000 7f70e90e6700 1 --2- 172.21.15.84:0/775581643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70e407bdc0 0x7f70e4124fe0 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f70e409fec0 tx=0x7f70e0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:24.680 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.668+0000 7f70e98e7700 1 -- 172.21.15.84:0/775581643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e405e1c0 con 0x7f70e407bdc0 2020-01-16T05:45:24.680 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.668+0000 7f70d9ffb700 1 --2- 172.21.15.84:0/775581643 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f70c403c7d0 0x7f70c403ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:24.680 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.668+0000 7f70d9ffb700 1 -- 172.21.15.84:0/775581643 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f70e004c7c0 con 0x7f70e407bdc0 2020-01-16T05:45:24.680 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.668+0000 7f70e88e5700 1 --2- 172.21.15.84:0/775581643 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f70c403c7d0 0x7f70c403ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:24.680 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.668+0000 7f70e88e5700 1 --2- 172.21.15.84:0/775581643 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f70c403c7d0 0x7f70c403ece0 crc :-1 s=READY pgs=109 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:24.680 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.672+0000 7f70e90e6700 1 --2- 172.21.15.84:0/775581643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70e407bdc0 0x7f70e4124fe0 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f70e409fec0 tx=0x7f70e0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:24.681 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.672+0000 7f70d9ffb700 1 -- 172.21.15.84:0/775581643 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f70e0032dc0 con 0x7f70e407bdc0 2020-01-16T05:45:24.790 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~58s 2020-01-16T05:45:24.834 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.828+0000 7f70e98e7700 1 -- 172.21.15.84:0/775581643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70e405cbc0 con 0x7f70e407bdc0 2020-01-16T05:45:24.835 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.828+0000 7f70e90e6700 1 --2- 172.21.15.84:0/775581643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70e407bdc0 0x7f70e4124fe0 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f70e409fec0 tx=0x7f70e0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:24.835 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.828+0000 7f70d9ffb700 1 -- 172.21.15.84:0/775581643 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+1766 (secure 0 0 0) 0x7f70e0033020 con 0x7f70e407bdc0 2020-01-16T05:45:24.835 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.828+0000 7f70e98e7700 1 -- 172.21.15.84:0/775581643 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f70c403c7d0 msgr2=0x7f70c403ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:24.835 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.828+0000 7f70e98e7700 1 --2- 172.21.15.84:0/775581643 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f70c403c7d0 0x7f70c403ece0 crc :-1 s=READY pgs=109 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:24.836 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.828+0000 7f70e98e7700 1 -- 172.21.15.84:0/775581643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70e407bdc0 msgr2=0x7f70e4124fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:24.836 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.828+0000 7f70e98e7700 1 --2- 172.21.15.84:0/775581643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70e407bdc0 0x7f70e4124fe0 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7f70e409fec0 tx=0x7f70e0010a70).stop 2020-01-16T05:45:24.836 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.828+0000 7f70e98e7700 1 -- 172.21.15.84:0/775581643 shutdown_connections 2020-01-16T05:45:24.836 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.828+0000 7f70e98e7700 1 --2- 172.21.15.84:0/775581643 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f70c403c7d0 0x7f70c403ece0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:24.837 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.828+0000 7f70e98e7700 1 --2- 172.21.15.84:0/775581643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70e407bdc0 0x7f70e4124fe0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:24.837 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.828+0000 7f70e98e7700 1 --2- 172.21.15.84:0/775581643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70e40a7420 0x7f70e4125530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:24.837 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.828+0000 7f70e98e7700 1 -- 172.21.15.84:0/775581643 shutdown_connections 2020-01-16T05:45:24.837 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.828+0000 7f70e98e7700 1 -- 172.21.15.84:0/775581643 wait complete. 2020-01-16T05:45:24.838 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:24.828+0000 7f70e98e7700 1 -- 172.21.15.84:0/775581643 >> 172.21.15.84:0/775581643 conn(0x7f70e405ee80 msgr2=0x7f70e41271f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:24.838 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2020-01-16T05:45:24.838 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:24.838 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:44:39.544825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:24.843 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2020-01-16T05:45:26.844 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab359e700 1 Processor -- start 2020-01-16T05:45:26.967 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab359e700 1 -- start start 2020-01-16T05:45:26.967 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab359e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7ab40a9b30 0x7f7ab40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:26.967 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7ab407ff10 0x7f7ab4066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:26.967 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ab40a4250 0x7f7ab40a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:26.967 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab359e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab40a4830 con 0x7f7ab40a9b30 2020-01-16T05:45:26.967 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab359e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab407f9d0 con 0x7f7ab407ff10 2020-01-16T05:45:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab407fc70 con 0x7f7ab40a4250 2020-01-16T05:45:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab2d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7ab40a9b30 0x7f7ab40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab2d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7ab40a9b30 0x7f7ab40abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35110/0 (socket says 172.21.15.84:35110) 2020-01-16T05:45:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab2d9d700 1 -- 172.21.15.84:0/2205444935 learned_addr learned my addr 172.21.15.84:0/2205444935 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:45:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7aaa59c700 1 --2- 172.21.15.84:0/2205444935 >> v2:172.21.15.142:3300/0 conn(0x7f7ab407ff10 0x7f7ab4066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab8ad9700 1 --2- 172.21.15.84:0/2205444935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ab40a4250 0x7f7ab40a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab2d9d700 1 -- 172.21.15.84:0/2205444935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ab40a4250 msgr2=0x7f7ab40a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab2d9d700 1 --2- 172.21.15.84:0/2205444935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ab40a4250 0x7f7ab40a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab2d9d700 1 -- 172.21.15.84:0/2205444935 >> v2:172.21.15.142:3300/0 conn(0x7f7ab407ff10 msgr2=0x7f7ab4066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab2d9d700 1 --2- 172.21.15.84:0/2205444935 >> v2:172.21.15.142:3300/0 conn(0x7f7ab407ff10 0x7f7ab4066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab2d9d700 1 -- 172.21.15.84:0/2205444935 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab4066dd0 con 0x7f7ab40a9b30 2020-01-16T05:45:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab8ad9700 1 --2- 172.21.15.84:0/2205444935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ab40a4250 0x7f7ab40a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:45:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab2d9d700 1 --2- 172.21.15.84:0/2205444935 >> v2:172.21.15.84:3300/0 conn(0x7f7ab40a9b30 0x7f7ab40abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7ab40a49f0 tx=0x7f7aa400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab2d9d700 1 --2- 172.21.15.84:0/2205444935 >> v2:172.21.15.84:3300/0 conn(0x7f7ab40a9b30 0x7f7ab40abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7ab40a49f0 tx=0x7f7aa400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab2d9d700 1 --2- 172.21.15.84:0/2205444935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ab40a9b30 0x7f7ab40abdd0 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f7ab40a49f0 tx=0x7f7aa400ff30).ready entity=mon.0 client_cookie=95bd70f1b990e118 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab2d9d700 1 --2- 172.21.15.84:0/2205444935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ab40a9b30 0x7f7ab40abdd0 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f7ab40a49f0 tx=0x7f7aa400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab259c700 1 -- 172.21.15.84:0/2205444935 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aa4011760 con 0x7f7ab40a9b30 2020-01-16T05:45:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab2d9d700 1 --2- 172.21.15.84:0/2205444935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ab40a9b30 0x7f7ab40abdd0 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f7ab40a49f0 tx=0x7f7aa400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab2d9d700 1 --2- 172.21.15.84:0/2205444935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ab40a9b30 0x7f7ab40abdd0 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f7ab40a49f0 tx=0x7f7aa400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab259c700 1 -- 172.21.15.84:0/2205444935 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa4008d30 con 0x7f7ab40a9b30 2020-01-16T05:45:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab259c700 1 -- 172.21.15.84:0/2205444935 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aa4011d40 con 0x7f7ab40a9b30 2020-01-16T05:45:26.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab359e700 1 -- 172.21.15.84:0/2205444935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ab40a9b30 msgr2=0x7f7ab40abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:26.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab359e700 1 --2- 172.21.15.84:0/2205444935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ab40a9b30 0x7f7ab40abdd0 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f7ab40a49f0 tx=0x7f7aa400ff30).stop 2020-01-16T05:45:26.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab359e700 1 -- 172.21.15.84:0/2205444935 shutdown_connections 2020-01-16T05:45:26.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab359e700 1 --2- 172.21.15.84:0/2205444935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ab40a4250 0x7f7ab40a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:26.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab359e700 1 --2- 172.21.15.84:0/2205444935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ab40a9b30 0x7f7ab40abdd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:26.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.960+0000 7f7ab359e700 1 --2- 172.21.15.84:0/2205444935 >> v2:172.21.15.142:3300/0 conn(0x7f7ab407ff10 0x7f7ab4066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:26.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.964+0000 7f7ab359e700 1 -- 172.21.15.84:0/2205444935 shutdown_connections 2020-01-16T05:45:26.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.964+0000 7f7ab359e700 1 -- 172.21.15.84:0/2205444935 wait complete. 2020-01-16T05:45:26.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.964+0000 7f7ab359e700 1 -- 172.21.15.84:0/2205444935 >> 172.21.15.84:0/2205444935 conn(0x7f7ab40acfc0 msgr2=0x7f7ab40a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:26.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.964+0000 7f7ab359e700 1 Processor -- start 2020-01-16T05:45:26.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.964+0000 7f7ab359e700 1 -- start start 2020-01-16T05:45:26.975 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.964+0000 7f7ab359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ab41262e0 0x7f7ab4124e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:26.975 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.964+0000 7f7ab359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7ab407b990 0x7f7ab413f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:26.975 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.964+0000 7f7ab359e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab4126710 con 0x7f7ab4065810 2020-01-16T05:45:26.975 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.964+0000 7f7ab359e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab407b730 con 0x7f7ab407b990 2020-01-16T05:45:26.975 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.964+0000 7f7ab359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4124a90 con 0x7f7ab41262e0 2020-01-16T05:45:26.976 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.964+0000 7f7ab2d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7ab4065810 0x7f7ab409f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52318/0 (socket says 172.21.15.84:52318) 2020-01-16T05:45:26.976 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.964+0000 7f7ab2d9d700 1 -- 172.21.15.84:0/821241928 learned_addr learned my addr 172.21.15.84:0/821241928 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:26.976 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.964+0000 7f7ab8ad9700 1 --2- 172.21.15.84:0/821241928 >> v2:172.21.15.142:3300/0 conn(0x7f7ab407b990 0x7f7ab413f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:26.976 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.964+0000 7f7aaa59c700 1 --2- 172.21.15.84:0/821241928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ab41262e0 0x7f7ab4124e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:26.976 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7aabfff700 1 -- 172.21.15.84:0/821241928 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992241457 0 0) 0x7f7ab4126710 con 0x7f7ab4065810 2020-01-16T05:45:26.976 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7aabfff700 1 -- 172.21.15.84:0/821241928 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a98003230 con 0x7f7ab4065810 2020-01-16T05:45:26.976 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7ab8ad9700 1 -- 172.21.15.84:0/821241928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ab41262e0 msgr2=0x7f7ab4124e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:26.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7ab8ad9700 1 --2- 172.21.15.84:0/821241928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ab41262e0 0x7f7ab4124e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:26.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7ab8ad9700 1 -- 172.21.15.84:0/821241928 >> v1:172.21.15.84:6789/0 conn(0x7f7ab4065810 legacy=0x7f7ab409f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:26.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7aabfff700 1 -- 172.21.15.84:0/821241928 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 90757105 0 0) 0x7f7a98003230 con 0x7f7ab4065810 2020-01-16T05:45:26.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7ab8ad9700 1 -- 172.21.15.84:0/821241928 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab4124470 con 0x7f7ab407b990 2020-01-16T05:45:26.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7ab8ad9700 1 --2- 172.21.15.84:0/821241928 >> v2:172.21.15.142:3300/0 conn(0x7f7ab407b990 0x7f7ab413f340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7aa40077f0 tx=0x7f7aa4010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:26.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7ab8ad9700 1 --2- 172.21.15.84:0/821241928 >> v2:172.21.15.142:3300/0 conn(0x7f7ab407b990 0x7f7ab413f340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7aa40077f0 tx=0x7f7aa4010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:26.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7ab8ad9700 1 --2- 172.21.15.84:0/821241928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab407b990 0x7f7ab413f340 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7f7aa40077f0 tx=0x7f7aa4010400).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:26.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7ab8ad9700 1 --2- 172.21.15.84:0/821241928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab407b990 0x7f7ab413f340 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f7aa40077f0 tx=0x7f7aa4010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:26.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7aabfff700 1 -- 172.21.15.84:0/821241928 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aac007160 con 0x7f7ab407b990 2020-01-16T05:45:26.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7ab8ad9700 1 --2- 172.21.15.84:0/821241928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab407b990 0x7f7ab413f340 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f7aa40077f0 tx=0x7f7aa4010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:26.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7ab359e700 1 -- 172.21.15.84:0/821241928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab407bdc0 con 0x7f7ab407b990 2020-01-16T05:45:26.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7aabfff700 1 -- 172.21.15.84:0/821241928 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa4011960 con 0x7f7ab407b990 2020-01-16T05:45:26.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7ab8ad9700 1 --2- 172.21.15.84:0/821241928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab407b990 0x7f7ab413f340 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f7aa40077f0 tx=0x7f7aa4010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:26.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7aabfff700 1 -- 172.21.15.84:0/821241928 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aac007550 con 0x7f7ab407b990 2020-01-16T05:45:26.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7ab359e700 1 -- 172.21.15.84:0/821241928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab413f890 con 0x7f7ab407b990 2020-01-16T05:45:26.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7ab8ad9700 1 --2- 172.21.15.84:0/821241928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab407b990 0x7f7ab413f340 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f7aa40077f0 tx=0x7f7aa4010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:26.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7ab359e700 1 -- 172.21.15.84:0/821241928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab405e1c0 con 0x7f7ab407b990 2020-01-16T05:45:26.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7aabfff700 1 -- 172.21.15.84:0/821241928 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f7aac00e2d0 con 0x7f7ab407b990 2020-01-16T05:45:26.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7ab8ad9700 1 --2- 172.21.15.84:0/821241928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab407b990 0x7f7ab413f340 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f7aa40077f0 tx=0x7f7aa4010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:26.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7aabfff700 1 --2- 172.21.15.84:0/821241928 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7a9803c740 0x7f7a9803ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:26.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7aabfff700 1 -- 172.21.15.84:0/821241928 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f7aac04c790 con 0x7f7ab407b990 2020-01-16T05:45:26.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.968+0000 7f7ab2d9d700 1 --2- 172.21.15.84:0/821241928 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7a9803c740 0x7f7a9803ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:26.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.972+0000 7f7ab2d9d700 1 --2- 172.21.15.84:0/821241928 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7a9803c740 0x7f7a9803ec50 crc :-1 s=READY pgs=110 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:26.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.980+0000 7f7ab8ad9700 1 --2- 172.21.15.84:0/821241928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab407b990 0x7f7ab413f340 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f7aa40077f0 tx=0x7f7aa4010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:26.982 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:26.980+0000 7f7aabfff700 1 -- 172.21.15.84:0/821241928 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f7aac032d90 con 0x7f7ab407b990 2020-01-16T05:45:27.137 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.136+0000 7f7ab359e700 1 -- 172.21.15.84:0/821241928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ab405cbc0 con 0x7f7ab407b990 2020-01-16T05:45:27.138 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.136+0000 7f7ab8ad9700 1 --2- 172.21.15.84:0/821241928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab407b990 0x7f7ab413f340 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f7aa40077f0 tx=0x7f7aa4010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:27.138 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.136+0000 7f7aabfff700 1 -- 172.21.15.84:0/821241928 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f7aac032ff0 con 0x7f7ab407b990 2020-01-16T05:45:27.139 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:27.139 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:27.140 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.136+0000 7f7ab359e700 1 -- 172.21.15.84:0/821241928 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7a9803c740 msgr2=0x7f7a9803ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:27.140 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.136+0000 7f7ab359e700 1 --2- 172.21.15.84:0/821241928 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7a9803c740 0x7f7a9803ec50 crc :-1 s=READY pgs=110 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.136+0000 7f7ab359e700 1 -- 172.21.15.84:0/821241928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab407b990 msgr2=0x7f7ab413f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.136+0000 7f7ab359e700 1 --2- 172.21.15.84:0/821241928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab407b990 0x7f7ab413f340 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7f7aa40077f0 tx=0x7f7aa4010400).stop 2020-01-16T05:45:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.136+0000 7f7ab359e700 1 -- 172.21.15.84:0/821241928 shutdown_connections 2020-01-16T05:45:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.136+0000 7f7ab359e700 1 --2- 172.21.15.84:0/821241928 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7a9803c740 0x7f7a9803ec50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.136+0000 7f7ab359e700 1 --2- 172.21.15.84:0/821241928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab407b990 0x7f7ab413f340 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.136+0000 7f7ab359e700 1 --2- 172.21.15.84:0/821241928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ab41262e0 0x7f7ab4124e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.136+0000 7f7ab359e700 1 -- 172.21.15.84:0/821241928 shutdown_connections 2020-01-16T05:45:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.136+0000 7f7ab359e700 1 -- 172.21.15.84:0/821241928 wait complete. 2020-01-16T05:45:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.136+0000 7f7ab359e700 1 -- 172.21.15.84:0/821241928 >> 172.21.15.84:0/821241928 conn(0x7f7ab407e070 msgr2=0x7f7ab407cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:45:27.152 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a reported laggy/crashed since: 2020-01-16T05:45:26.539100+0000 2020-01-16T05:45:27.152 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2020-01-16T05:45:27.153 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:27.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.260+0000 7f64b485c700 1 Processor -- start 2020-01-16T05:45:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.260+0000 7f64b485c700 1 -- start start 2020-01-16T05:45:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.260+0000 7f64b485c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64b00a9b30 0x7f64b00abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.260+0000 7f64b485c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b007ff10 0x7f64b0066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.260+0000 7f64b485c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f64b00a4250 0x7f64b00a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.260+0000 7f64b485c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b00a4830 con 0x7f64b00a4250 2020-01-16T05:45:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.260+0000 7f64b485c700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b007f9d0 con 0x7f64b00a9b30 2020-01-16T05:45:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.260+0000 7f64b485c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b007fc70 con 0x7f64b007ff10 2020-01-16T05:45:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.260+0000 7f64b5abe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f64b00a4250 0x7f64b00a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.260+0000 7f64b5abe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f64b00a4250 0x7f64b00a4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35128/0 (socket says 172.21.15.84:35128) 2020-01-16T05:45:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b5abe700 1 -- 172.21.15.84:0/695869815 learned_addr learned my addr 172.21.15.84:0/695869815 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:45:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64affff700 1 --2- 172.21.15.84:0/695869815 >> v2:172.21.15.142:3300/0 conn(0x7f64b00a9b30 0x7f64b00abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64af7fe700 1 --2- 172.21.15.84:0/695869815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b007ff10 0x7f64b0066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b5abe700 1 -- 172.21.15.84:0/695869815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b007ff10 msgr2=0x7f64b0066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:27.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b5abe700 1 --2- 172.21.15.84:0/695869815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b007ff10 0x7f64b0066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:27.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b5abe700 1 -- 172.21.15.84:0/695869815 >> v2:172.21.15.142:3300/0 conn(0x7f64b00a9b30 msgr2=0x7f64b00abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:27.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b5abe700 1 --2- 172.21.15.84:0/695869815 >> v2:172.21.15.142:3300/0 conn(0x7f64b00a9b30 0x7f64b00abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:27.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b5abe700 1 -- 172.21.15.84:0/695869815 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b0066dd0 con 0x7f64b00a4250 2020-01-16T05:45:27.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64affff700 1 --2- 172.21.15.84:0/695869815 >> v2:172.21.15.142:3300/0 conn(0x7f64b00a9b30 0x7f64b00abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:45:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b5abe700 1 --2- 172.21.15.84:0/695869815 >> v2:172.21.15.84:3300/0 conn(0x7f64b00a4250 0x7f64b00a4ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f64b00a49f0 tx=0x7f64a80102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b5abe700 1 --2- 172.21.15.84:0/695869815 >> v2:172.21.15.84:3300/0 conn(0x7f64b00a4250 0x7f64b00a4ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f64b00a49f0 tx=0x7f64a80102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b5abe700 1 --2- 172.21.15.84:0/695869815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64b00a4250 0x7f64b00a4ad0 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7f64b00a49f0 tx=0x7f64a80102b0).ready entity=mon.0 client_cookie=cf29c6334282c8ba server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b5abe700 1 --2- 172.21.15.84:0/695869815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64b00a4250 0x7f64b00a4ad0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f64b00a49f0 tx=0x7f64a80102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b5abe700 1 --2- 172.21.15.84:0/695869815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64b00a4250 0x7f64b00a4ad0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f64b00a49f0 tx=0x7f64a80102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64aeffd700 1 -- 172.21.15.84:0/695869815 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a800a160 con 0x7f64b00a4250 2020-01-16T05:45:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b5abe700 1 --2- 172.21.15.84:0/695869815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64b00a4250 0x7f64b00a4ad0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f64b00a49f0 tx=0x7f64a80102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64aeffd700 1 -- 172.21.15.84:0/695869815 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a8011bf0 con 0x7f64b00a4250 2020-01-16T05:45:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64aeffd700 1 -- 172.21.15.84:0/695869815 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a800a740 con 0x7f64b00a4250 2020-01-16T05:45:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b485c700 1 -- 172.21.15.84:0/695869815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64b00a4250 msgr2=0x7f64b00a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b485c700 1 --2- 172.21.15.84:0/695869815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64b00a4250 0x7f64b00a4ad0 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7f64b00a49f0 tx=0x7f64a80102b0).stop 2020-01-16T05:45:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b485c700 1 -- 172.21.15.84:0/695869815 shutdown_connections 2020-01-16T05:45:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b485c700 1 --2- 172.21.15.84:0/695869815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64b00a4250 0x7f64b00a4ad0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:27.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b485c700 1 --2- 172.21.15.84:0/695869815 >> v2:172.21.15.142:3300/0 conn(0x7f64b00a9b30 0x7f64b00abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:27.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b485c700 1 --2- 172.21.15.84:0/695869815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b007ff10 0x7f64b0066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:27.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b485c700 1 -- 172.21.15.84:0/695869815 shutdown_connections 2020-01-16T05:45:27.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b485c700 1 -- 172.21.15.84:0/695869815 wait complete. 2020-01-16T05:45:27.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.264+0000 7f64b485c700 1 -- 172.21.15.84:0/695869815 >> 172.21.15.84:0/695869815 conn(0x7f64b00acfc0 msgr2=0x7f64b00a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:27.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b485c700 1 Processor -- start 2020-01-16T05:45:27.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b485c700 1 -- start start 2020-01-16T05:45:27.277 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b485c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64b00a8870 0x7f64b008ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:27.277 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b485c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f64b009f510 0x7f64b009f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:27.277 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b485c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b00a7de0 con 0x7f64b01277e0 2020-01-16T05:45:27.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b485c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b00a8330 con 0x7f64b009f510 2020-01-16T05:45:27.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b485c700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b00a85d0 con 0x7f64b00a8870 2020-01-16T05:45:27.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b5abe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f64b009f510 0x7f64b009f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:27.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64affff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64b00a8870 0x7f64b008ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:27.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64af7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f64b01277e0 0x7f64b007ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52332/0 (socket says 172.21.15.84:52332) 2020-01-16T05:45:27.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64af7fe700 1 -- 172.21.15.84:0/2450627044 learned_addr learned my addr 172.21.15.84:0/2450627044 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:27.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b5abe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f64b009f510 0x7f64b009f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35134/0 (socket says 172.21.15.84:35134) 2020-01-16T05:45:27.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b5abe700 1 -- 172.21.15.84:0/2450627044 >> v2:172.21.15.142:3300/0 conn(0x7f64b00a8870 msgr2=0x7f64b008ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:27.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b5abe700 1 --2- 172.21.15.84:0/2450627044 >> v2:172.21.15.142:3300/0 conn(0x7f64b00a8870 0x7f64b008ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:27.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b5abe700 1 -- 172.21.15.84:0/2450627044 >> v1:172.21.15.84:6789/0 conn(0x7f64b01277e0 legacy=0x7f64b007ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:27.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64acff9700 1 -- 172.21.15.84:0/2450627044 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183137997 0 0) 0x7f64b00a7de0 con 0x7f64b01277e0 2020-01-16T05:45:27.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b5abe700 1 -- 172.21.15.84:0/2450627044 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b008f690 con 0x7f64b009f510 2020-01-16T05:45:27.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b5abe700 1 --2- 172.21.15.84:0/2450627044 >> v2:172.21.15.84:3300/0 conn(0x7f64b009f510 0x7f64b009f940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f64b00a8250 tx=0x7f64a8011ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:27.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b5abe700 1 --2- 172.21.15.84:0/2450627044 >> v2:172.21.15.84:3300/0 conn(0x7f64b009f510 0x7f64b009f940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f64b00a8250 tx=0x7f64a8011ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:27.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b5abe700 1 --2- 172.21.15.84:0/2450627044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64b009f510 0x7f64b009f940 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7f64b00a8250 tx=0x7f64a8011ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:27.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b5abe700 1 --2- 172.21.15.84:0/2450627044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64b009f510 0x7f64b009f940 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f64b00a8250 tx=0x7f64a8011ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:27.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64acff9700 1 -- 172.21.15.84:0/2450627044 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a8005a40 con 0x7f64b009f510 2020-01-16T05:45:27.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b5abe700 1 --2- 172.21.15.84:0/2450627044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64b009f510 0x7f64b009f940 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f64b00a8250 tx=0x7f64a8011ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:27.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b5abe700 1 --2- 172.21.15.84:0/2450627044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64b009f510 0x7f64b009f940 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f64b00a8250 tx=0x7f64a8011ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:27.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64acff9700 1 -- 172.21.15.84:0/2450627044 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a800a360 con 0x7f64b009f510 2020-01-16T05:45:27.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b485c700 1 -- 172.21.15.84:0/2450627044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b007f6e0 con 0x7f64b009f510 2020-01-16T05:45:27.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64acff9700 1 -- 172.21.15.84:0/2450627044 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a8007340 con 0x7f64b009f510 2020-01-16T05:45:27.281 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.268+0000 7f64b485c700 1 -- 172.21.15.84:0/2450627044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b013c0b0 con 0x7f64b009f510 2020-01-16T05:45:27.281 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.272+0000 7f64b5abe700 1 --2- 172.21.15.84:0/2450627044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64b009f510 0x7f64b009f940 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f64b00a8250 tx=0x7f64a8011ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:27.281 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.272+0000 7f64b485c700 1 -- 172.21.15.84:0/2450627044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b005e1c0 con 0x7f64b009f510 2020-01-16T05:45:27.281 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.272+0000 7f64acff9700 1 -- 172.21.15.84:0/2450627044 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f64a80075e0 con 0x7f64b009f510 2020-01-16T05:45:27.281 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.272+0000 7f64b5abe700 1 --2- 172.21.15.84:0/2450627044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64b009f510 0x7f64b009f940 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f64b00a8250 tx=0x7f64a8011ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:27.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.272+0000 7f64acff9700 1 --2- 172.21.15.84:0/2450627044 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f649003c1b0 0x7f649003e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:27.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.272+0000 7f64acff9700 1 -- 172.21.15.84:0/2450627044 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f64a8091580 con 0x7f64b009f510 2020-01-16T05:45:27.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.276+0000 7f64affff700 1 --2- 172.21.15.84:0/2450627044 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f649003c1b0 0x7f649003e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:27.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.276+0000 7f64affff700 1 --2- 172.21.15.84:0/2450627044 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f649003c1b0 0x7f649003e6c0 crc :-1 s=READY pgs=111 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:27.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.276+0000 7f64b5abe700 1 --2- 172.21.15.84:0/2450627044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64b009f510 0x7f64b009f940 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f64b00a8250 tx=0x7f64a8011ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:27.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.276+0000 7f64acff9700 1 -- 172.21.15.84:0/2450627044 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f64a8077b00 con 0x7f64b009f510 2020-01-16T05:45:27.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.428+0000 7f64b485c700 1 -- 172.21.15.84:0/2450627044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64b008f460 con 0x7f64b009f510 2020-01-16T05:45:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.428+0000 7f64b5abe700 1 --2- 172.21.15.84:0/2450627044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64b009f510 0x7f64b009f940 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f64b00a8250 tx=0x7f64a8011ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.428+0000 7f64acff9700 1 -- 172.21.15.84:0/2450627044 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f64a8077d60 con 0x7f64b009f510 2020-01-16T05:45:27.431 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:27.431 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:27.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.428+0000 7f64b485c700 1 -- 172.21.15.84:0/2450627044 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f649003c1b0 msgr2=0x7f649003e6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:27.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.428+0000 7f64b485c700 1 --2- 172.21.15.84:0/2450627044 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f649003c1b0 0x7f649003e6c0 crc :-1 s=READY pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:27.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.428+0000 7f64b485c700 1 -- 172.21.15.84:0/2450627044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64b009f510 msgr2=0x7f64b009f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:27.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.428+0000 7f64b485c700 1 --2- 172.21.15.84:0/2450627044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64b009f510 0x7f64b009f940 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7f64b00a8250 tx=0x7f64a8011ea0).stop 2020-01-16T05:45:27.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.428+0000 7f64b485c700 1 -- 172.21.15.84:0/2450627044 shutdown_connections 2020-01-16T05:45:27.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.428+0000 7f64b485c700 1 --2- 172.21.15.84:0/2450627044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64b009f510 0x7f64b009f940 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:27.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.428+0000 7f64b485c700 1 --2- 172.21.15.84:0/2450627044 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f649003c1b0 0x7f649003e6c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:27.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.428+0000 7f64b485c700 1 --2- 172.21.15.84:0/2450627044 >> v2:172.21.15.142:3300/0 conn(0x7f64b00a8870 0x7f64b008ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:27.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.428+0000 7f64b485c700 1 -- 172.21.15.84:0/2450627044 shutdown_connections 2020-01-16T05:45:27.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.428+0000 7f64b485c700 1 -- 172.21.15.84:0/2450627044 wait complete. 2020-01-16T05:45:27.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:27.428+0000 7f64b485c700 1 -- 172.21.15.84:0/2450627044 >> 172.21.15.84:0/2450627044 conn(0x7f64b007e070 msgr2=0x7f64b0123430 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:27.435 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:45:27.444 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:45:29.445 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:29.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.552+0000 7f1aa759e700 1 Processor -- start 2020-01-16T05:45:29.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.552+0000 7f1aa759e700 1 -- start start 2020-01-16T05:45:29.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.552+0000 7f1aa759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1aa80a4250 0x7f1aa80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:29.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.552+0000 7f1aa759e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa8066880 con 0x7f1aa807ff10 2020-01-16T05:45:29.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.552+0000 7f1aa759e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa8066ab0 con 0x7f1aa80a9b30 2020-01-16T05:45:29.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.552+0000 7f1aa759e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa80a4830 con 0x7f1aa80a4250 2020-01-16T05:45:29.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.552+0000 7f1aa659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1aa807ff10 0x7f1aa814dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52340/0 (socket says 172.21.15.84:52340) 2020-01-16T05:45:29.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.552+0000 7f1aa659c700 1 -- 172.21.15.84:0/3037414470 learned_addr learned my addr 172.21.15.84:0/3037414470 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:29.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.552+0000 7f1aaca0e700 1 --2- 172.21.15.84:0/3037414470 >> v2:172.21.15.84:3300/0 conn(0x7f1aa80a4250 0x7f1aa80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:29.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aa5d9b700 1 -- 172.21.15.84:0/3037414470 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749261815 0 0) 0x7f1aa8066880 con 0x7f1aa807ff10 2020-01-16T05:45:29.567 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aa5d9b700 1 -- 172.21.15.84:0/3037414470 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a90003230 con 0x7f1aa807ff10 2020-01-16T05:45:29.567 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aa5d9b700 1 -- 172.21.15.84:0/3037414470 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239522930 0 0) 0x7f1aa8066ab0 con 0x7f1aa80a9b30 2020-01-16T05:45:29.567 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aaca0e700 1 -- 172.21.15.84:0/3037414470 >> v1:172.21.15.142:6789/0 conn(0x7f1aa80a9b30 legacy=0x7f1aa80a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:29.567 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aaca0e700 1 -- 172.21.15.84:0/3037414470 >> v1:172.21.15.84:6789/0 conn(0x7f1aa807ff10 legacy=0x7f1aa814dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:29.567 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aaca0e700 1 -- 172.21.15.84:0/3037414470 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa8066ce0 con 0x7f1aa80a4250 2020-01-16T05:45:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aaca0e700 1 --2- 172.21.15.84:0/3037414470 >> v2:172.21.15.84:3300/0 conn(0x7f1aa80a4250 0x7f1aa80abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1a98008c90 tx=0x7f1a980100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aaca0e700 1 --2- 172.21.15.84:0/3037414470 >> v2:172.21.15.84:3300/0 conn(0x7f1aa80a4250 0x7f1aa80abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1a98008c90 tx=0x7f1a980100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aaca0e700 1 --2- 172.21.15.84:0/3037414470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa80a4250 0x7f1aa80abdd0 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7f1a98008c90 tx=0x7f1a980100f0).ready entity=mon.0 client_cookie=d49bee283ff4fbc8 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aaca0e700 1 --2- 172.21.15.84:0/3037414470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa80a4250 0x7f1aa80abdd0 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7f1a98008c90 tx=0x7f1a980100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aa5d9b700 1 -- 172.21.15.84:0/3037414470 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a9800a160 con 0x7f1aa80a4250 2020-01-16T05:45:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aaca0e700 1 --2- 172.21.15.84:0/3037414470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa80a4250 0x7f1aa80abdd0 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7f1a98008c90 tx=0x7f1a980100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aa5d9b700 1 -- 172.21.15.84:0/3037414470 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a98011b60 con 0x7f1aa80a4250 2020-01-16T05:45:29.569 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aaca0e700 1 --2- 172.21.15.84:0/3037414470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa80a4250 0x7f1aa80abdd0 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7f1a98008c90 tx=0x7f1a980100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:29.569 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aa5d9b700 1 -- 172.21.15.84:0/3037414470 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a9800a740 con 0x7f1aa80a4250 2020-01-16T05:45:29.569 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aa759e700 1 -- 172.21.15.84:0/3037414470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa80a4250 msgr2=0x7f1aa80abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:29.569 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aa759e700 1 --2- 172.21.15.84:0/3037414470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa80a4250 0x7f1aa80abdd0 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7f1a98008c90 tx=0x7f1a980100f0).stop 2020-01-16T05:45:29.569 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aa759e700 1 -- 172.21.15.84:0/3037414470 shutdown_connections 2020-01-16T05:45:29.569 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aa759e700 1 --2- 172.21.15.84:0/3037414470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa80a4250 0x7f1aa80abdd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:29.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aa759e700 1 -- 172.21.15.84:0/3037414470 shutdown_connections 2020-01-16T05:45:29.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aa759e700 1 -- 172.21.15.84:0/3037414470 wait complete. 2020-01-16T05:45:29.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.556+0000 7f1aa759e700 1 -- 172.21.15.84:0/3037414470 >> 172.21.15.84:0/3037414470 conn(0x7f1aa80acfc0 msgr2=0x7f1aa80a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:29.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa759e700 1 Processor -- start 2020-01-16T05:45:29.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa759e700 1 -- start start 2020-01-16T05:45:29.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1aa8091460 0x7f1aa807b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:29.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1aa8124700 0x7f1aa8135d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:29.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa759e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa80a5c70 con 0x7f1aa809f2a0 2020-01-16T05:45:29.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa759e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa80a36e0 con 0x7f1aa8091460 2020-01-16T05:45:29.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa759e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa80a5fb0 con 0x7f1aa8124700 2020-01-16T05:45:29.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa6d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1aa8091460 0x7f1aa807b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:29.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aaca0e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1aa809f2a0 0x7f1aa809f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52346/0 (socket says 172.21.15.84:52346) 2020-01-16T05:45:29.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aaca0e700 1 -- 172.21.15.84:0/476279231 learned_addr learned my addr 172.21.15.84:0/476279231 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:29.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa659c700 1 --2- 172.21.15.84:0/476279231 >> v2:172.21.15.142:3300/0 conn(0x7f1aa8124700 0x7f1aa8135d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:29.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa6d9d700 1 -- 172.21.15.84:0/476279231 >> v2:172.21.15.142:3300/0 conn(0x7f1aa8124700 msgr2=0x7f1aa8135d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:29.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa6d9d700 1 --2- 172.21.15.84:0/476279231 >> v2:172.21.15.142:3300/0 conn(0x7f1aa8124700 0x7f1aa8135d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:29.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa6d9d700 1 -- 172.21.15.84:0/476279231 >> v1:172.21.15.84:6789/0 conn(0x7f1aa809f2a0 legacy=0x7f1aa809f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:29.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1a977fe700 1 -- 172.21.15.84:0/476279231 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971790123 0 0) 0x7f1aa80a5c70 con 0x7f1aa809f2a0 2020-01-16T05:45:29.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa6d9d700 1 -- 172.21.15.84:0/476279231 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa807bb70 con 0x7f1aa8091460 2020-01-16T05:45:29.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa6d9d700 1 --2- 172.21.15.84:0/476279231 >> v2:172.21.15.84:3300/0 conn(0x7f1aa8091460 0x7f1aa807b620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1aa80a6170 tx=0x7f1aa00109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:29.574 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa6d9d700 1 --2- 172.21.15.84:0/476279231 >> v2:172.21.15.84:3300/0 conn(0x7f1aa8091460 0x7f1aa807b620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1aa80a6170 tx=0x7f1aa00109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:29.574 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa6d9d700 1 --2- 172.21.15.84:0/476279231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa8091460 0x7f1aa807b620 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7f1aa80a6170 tx=0x7f1aa00109c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:29.574 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa6d9d700 1 --2- 172.21.15.84:0/476279231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa8091460 0x7f1aa807b620 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f1aa80a6170 tx=0x7f1aa00109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:29.574 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1a977fe700 1 -- 172.21.15.84:0/476279231 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aa0006bc0 con 0x7f1aa8091460 2020-01-16T05:45:29.574 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa6d9d700 1 --2- 172.21.15.84:0/476279231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa8091460 0x7f1aa807b620 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f1aa80a6170 tx=0x7f1aa00109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:29.574 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa6d9d700 1 --2- 172.21.15.84:0/476279231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa8091460 0x7f1aa807b620 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f1aa80a6170 tx=0x7f1aa00109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:29.574 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1a977fe700 1 -- 172.21.15.84:0/476279231 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa00067e0 con 0x7f1aa8091460 2020-01-16T05:45:29.575 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1a977fe700 1 -- 172.21.15.84:0/476279231 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aa0012230 con 0x7f1aa8091460 2020-01-16T05:45:29.575 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa759e700 1 -- 172.21.15.84:0/476279231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa8136250 con 0x7f1aa8091460 2020-01-16T05:45:29.575 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa759e700 1 -- 172.21.15.84:0/476279231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa813d150 con 0x7f1aa8091460 2020-01-16T05:45:29.575 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa6d9d700 1 --2- 172.21.15.84:0/476279231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa8091460 0x7f1aa807b620 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f1aa80a6170 tx=0x7f1aa00109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:29.575 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1a977fe700 1 -- 172.21.15.84:0/476279231 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f1aa0012500 con 0x7f1aa8091460 2020-01-16T05:45:29.575 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1aa6d9d700 1 --2- 172.21.15.84:0/476279231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa8091460 0x7f1aa807b620 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f1aa80a6170 tx=0x7f1aa00109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:29.575 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.560+0000 7f1a977fe700 1 --2- 172.21.15.84:0/476279231 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1a8c03c1c0 0x7f1a8c03e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:29.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.564+0000 7f1a977fe700 1 -- 172.21.15.84:0/476279231 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f1aa004ca10 con 0x7f1aa8091460 2020-01-16T05:45:29.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.564+0000 7f1aa659c700 1 --2- 172.21.15.84:0/476279231 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1a8c03c1c0 0x7f1a8c03e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:29.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.564+0000 7f1aa759e700 1 -- 172.21.15.84:0/476279231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa805e1c0 con 0x7f1aa8091460 2020-01-16T05:45:29.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.564+0000 7f1aa659c700 1 --2- 172.21.15.84:0/476279231 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1a8c03c1c0 0x7f1a8c03e6d0 crc :-1 s=READY pgs=112 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:29.577 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.568+0000 7f1aa6d9d700 1 --2- 172.21.15.84:0/476279231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa8091460 0x7f1aa807b620 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f1aa80a6170 tx=0x7f1aa00109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:29.595 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.568+0000 7f1a977fe700 1 -- 172.21.15.84:0/476279231 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f1aa0033010 con 0x7f1aa8091460 2020-01-16T05:45:29.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.724+0000 7f1aa759e700 1 -- 172.21.15.84:0/476279231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1aa80a61b0 con 0x7f1aa8091460 2020-01-16T05:45:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.728+0000 7f1aa6d9d700 1 --2- 172.21.15.84:0/476279231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa8091460 0x7f1aa807b620 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f1aa80a6170 tx=0x7f1aa00109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:29.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.728+0000 7f1a977fe700 1 -- 172.21.15.84:0/476279231 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f1aa0033270 con 0x7f1aa8091460 2020-01-16T05:45:29.729 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:29.729 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:29.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.728+0000 7f1aa759e700 1 -- 172.21.15.84:0/476279231 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1a8c03c1c0 msgr2=0x7f1a8c03e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:29.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.728+0000 7f1aa759e700 1 --2- 172.21.15.84:0/476279231 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1a8c03c1c0 0x7f1a8c03e6d0 crc :-1 s=READY pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:29.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.728+0000 7f1aa759e700 1 -- 172.21.15.84:0/476279231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa8091460 msgr2=0x7f1aa807b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.728+0000 7f1aa759e700 1 --2- 172.21.15.84:0/476279231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa8091460 0x7f1aa807b620 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7f1aa80a6170 tx=0x7f1aa00109c0).stop 2020-01-16T05:45:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.728+0000 7f1aa759e700 1 -- 172.21.15.84:0/476279231 shutdown_connections 2020-01-16T05:45:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.728+0000 7f1aa759e700 1 --2- 172.21.15.84:0/476279231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa8091460 0x7f1aa807b620 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.728+0000 7f1aa759e700 1 --2- 172.21.15.84:0/476279231 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1a8c03c1c0 0x7f1a8c03e6d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.728+0000 7f1aa759e700 1 --2- 172.21.15.84:0/476279231 >> v2:172.21.15.142:3300/0 conn(0x7f1aa8124700 0x7f1aa8135d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:29.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.728+0000 7f1aa759e700 1 -- 172.21.15.84:0/476279231 shutdown_connections 2020-01-16T05:45:29.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.728+0000 7f1aa759e700 1 -- 172.21.15.84:0/476279231 wait complete. 2020-01-16T05:45:29.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:29.728+0000 7f1aa759e700 1 -- 172.21.15.84:0/476279231 >> 172.21.15.84:0/476279231 conn(0x7f1aa80a8e90 msgr2=0x7f1aa80a4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:29.736 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:45:29.742 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:45:31.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~64s 2020-01-16T05:45:31.745 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:31.877 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.856+0000 7f805759e700 1 Processor -- start 2020-01-16T05:45:31.877 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.856+0000 7f805759e700 1 -- start start 2020-01-16T05:45:31.877 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80580a9b30 0x7f80580abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:31.877 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805759e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8058066880 con 0x7f805807ff10 2020-01-16T05:45:31.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805759e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8058066ab0 con 0x7f80580a4250 2020-01-16T05:45:31.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80580a4830 con 0x7f80580a9b30 2020-01-16T05:45:31.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f804ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f805807ff10 0x7f80580a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52356/0 (socket says 172.21.15.84:52356) 2020-01-16T05:45:31.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f804ffff700 1 -- 172.21.15.84:0/2380225360 learned_addr learned my addr 172.21.15.84:0/2380225360 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:31.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f8056d9d700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80580a9b30 0x7f80580abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:31.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 -- 172.21.15.84:0/2380225360 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937445568 0 0) 0x7f8058066880 con 0x7f805807ff10 2020-01-16T05:45:31.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 -- 172.21.15.84:0/2380225360 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8044003230 con 0x7f805807ff10 2020-01-16T05:45:31.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 -- 172.21.15.84:0/2380225360 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576185342 0 0) 0x7f8058066ab0 con 0x7f80580a4250 2020-01-16T05:45:31.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 -- 172.21.15.84:0/2380225360 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8058066880 con 0x7f80580a4250 2020-01-16T05:45:31.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 -- 172.21.15.84:0/2380225360 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 360865792 0 0) 0x7f8044003230 con 0x7f805807ff10 2020-01-16T05:45:31.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 -- 172.21.15.84:0/2380225360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80580a9b30 msgr2=0x7f80580abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:31.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80580a9b30 0x7f80580abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:31.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 -- 172.21.15.84:0/2380225360 >> v1:172.21.15.142:6789/0 conn(0x7f80580a4250 legacy=0x7f805814fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:31.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 -- 172.21.15.84:0/2380225360 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8058066ce0 con 0x7f805807ff10 2020-01-16T05:45:31.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 -- 172.21.15.84:0/2380225360 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f8040001750 con 0x7f805807ff10 2020-01-16T05:45:31.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 -- 172.21.15.84:0/2380225360 >> v1:172.21.15.84:6789/0 conn(0x7f805807ff10 legacy=0x7f80580a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:31.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8044003ac0 0x7f8044003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:31.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80440045f0 0x7f8044004aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:31.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80440050b0 0x7f804404f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:31.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 -- 172.21.15.84:0/2380225360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80580a4830 con 0x7f80440050b0 2020-01-16T05:45:31.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 -- 172.21.15.84:0/2380225360 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804404ffa0 con 0x7f8044003ac0 2020-01-16T05:45:31.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 -- 172.21.15.84:0/2380225360 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80440501e0 con 0x7f80440045f0 2020-01-16T05:45:31.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f8056d9d700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80580a9b30 0x7f80580abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:45:31.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f804ffff700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80440045f0 0x7f8044004aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:31.884 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805ca9b700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80440050b0 0x7f804404f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:31.884 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f8056d9d700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8044003ac0 0x7f8044003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:31.884 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805ca9b700 1 -- 172.21.15.84:0/2380225360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80440045f0 msgr2=0x7f8044004aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:31.884 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805ca9b700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80440045f0 0x7f8044004aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:31.884 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805ca9b700 1 -- 172.21.15.84:0/2380225360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8044003ac0 msgr2=0x7f8044003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:31.885 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805ca9b700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8044003ac0 0x7f8044003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:31.885 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805ca9b700 1 -- 172.21.15.84:0/2380225360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80440504e0 con 0x7f80440050b0 2020-01-16T05:45:31.885 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f8056d9d700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8044003ac0 0x7f8044003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:45:31.885 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805ca9b700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80440050b0 0x7f804404f800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8050001380 tx=0x7f805000c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:31.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805ca9b700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80440050b0 0x7f804404f800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8050001380 tx=0x7f805000c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:31.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805ca9b700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80440050b0 0x7f804404f800 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7f8050001380 tx=0x7f805000c370).ready entity=mon.0 client_cookie=be91cf3b33342a5e server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:31.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805ca9b700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80440050b0 0x7f804404f800 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7f8050001380 tx=0x7f805000c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:31.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 -- 172.21.15.84:0/2380225360 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f805000cab0 con 0x7f80440050b0 2020-01-16T05:45:31.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805ca9b700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80440050b0 0x7f804404f800 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7f8050001380 tx=0x7f805000c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:31.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805ca9b700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80440050b0 0x7f804404f800 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7f8050001380 tx=0x7f805000c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:31.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 -- 172.21.15.84:0/2380225360 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8050010d00 con 0x7f80440050b0 2020-01-16T05:45:31.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805659c700 1 -- 172.21.15.84:0/2380225360 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80500112b0 con 0x7f80440050b0 2020-01-16T05:45:31.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805759e700 1 -- 172.21.15.84:0/2380225360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80440050b0 msgr2=0x7f804404f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:31.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805759e700 1 --2- 172.21.15.84:0/2380225360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80440050b0 0x7f804404f800 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7f8050001380 tx=0x7f805000c370).stop 2020-01-16T05:45:31.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805ca9b700 1 -- 172.21.15.84:0/2380225360 reap_dead start 2020-01-16T05:45:31.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805759e700 1 -- 172.21.15.84:0/2380225360 shutdown_connections 2020-01-16T05:45:31.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805759e700 1 -- 172.21.15.84:0/2380225360 shutdown_connections 2020-01-16T05:45:31.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805759e700 1 -- 172.21.15.84:0/2380225360 wait complete. 2020-01-16T05:45:31.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.860+0000 7f805759e700 1 -- 172.21.15.84:0/2380225360 >> 172.21.15.84:0/2380225360 conn(0x7f80580acfc0 msgr2=0x7f80580a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:31.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f805759e700 1 Processor -- start 2020-01-16T05:45:31.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f805759e700 1 -- start start 2020-01-16T05:45:31.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f805759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f80580900d0 0x7f8058091210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f805759e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8058125e20 con 0x7f80581255c0 2020-01-16T05:45:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f805759e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8058090500 con 0x7f8058122de0 2020-01-16T05:45:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f805759e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f805808fbd0 con 0x7f80580900d0 2020-01-16T05:45:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f805ca9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f80581255c0 0x7f8058124770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52368/0 (socket says 172.21.15.84:52368) 2020-01-16T05:45:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f805ca9b700 1 -- 172.21.15.84:0/1515069301 learned_addr learned my addr 172.21.15.84:0/1515069301 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804ffff700 1 --2- 172.21.15.84:0/1515069301 >> v2:172.21.15.142:3300/0 conn(0x7f80580900d0 0x7f8058091210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804f7fe700 1 -- 172.21.15.84:0/1515069301 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516441227 0 0) 0x7f8058066880 con 0x7f80581255c0 2020-01-16T05:45:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804f7fe700 1 -- 172.21.15.84:0/1515069301 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f803c003230 con 0x7f80581255c0 2020-01-16T05:45:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804f7fe700 1 -- 172.21.15.84:0/1515069301 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 357019463 0 0) 0x7f803c003230 con 0x7f80581255c0 2020-01-16T05:45:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804f7fe700 1 -- 172.21.15.84:0/1515069301 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8058066880 con 0x7f80581255c0 2020-01-16T05:45:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804f7fe700 1 -- 172.21.15.84:0/1515069301 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f80500016c0 con 0x7f80581255c0 2020-01-16T05:45:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804f7fe700 1 -- 172.21.15.84:0/1515069301 >> v2:172.21.15.142:3300/0 conn(0x7f80580900d0 msgr2=0x7f8058091210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804f7fe700 1 --2- 172.21.15.84:0/1515069301 >> v2:172.21.15.142:3300/0 conn(0x7f80580900d0 0x7f8058091210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804f7fe700 1 -- 172.21.15.84:0/1515069301 >> v1:172.21.15.142:6789/0 conn(0x7f8058122de0 legacy=0x7f8058123f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:31.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804f7fe700 1 -- 172.21.15.84:0/1515069301 >> v1:172.21.15.84:6789/0 conn(0x7f80581255c0 legacy=0x7f8058124770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:31.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804f7fe700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f803c003a20 0x7f803c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:31.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804f7fe700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f803c0045a0 0x7f803c0049f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:31.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804f7fe700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f803c005050 0x7f803c00b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:31.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804f7fe700 1 -- 172.21.15.84:0/1515069301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805808fbd0 con 0x7f803c0045a0 2020-01-16T05:45:31.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804f7fe700 1 -- 172.21.15.84:0/1515069301 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c00bed0 con 0x7f803c005050 2020-01-16T05:45:31.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804f7fe700 1 -- 172.21.15.84:0/1515069301 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803c00c110 con 0x7f803c003a20 2020-01-16T05:45:31.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804ffff700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f803c0045a0 0x7f803c0049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:31.892 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f8056d9d700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f803c003a20 0x7f803c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:31.892 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f805ca9b700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f803c005050 0x7f803c00b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:31.892 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804ffff700 1 -- 172.21.15.84:0/1515069301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f803c003a20 msgr2=0x7f803c003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:31.892 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804ffff700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f803c003a20 0x7f803c003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:31.892 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804ffff700 1 -- 172.21.15.84:0/1515069301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f803c005050 msgr2=0x7f803c00b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:31.893 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804ffff700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f803c005050 0x7f803c00b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:31.893 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804ffff700 1 -- 172.21.15.84:0/1515069301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c0035e0 con 0x7f803c0045a0 2020-01-16T05:45:31.893 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f805ca9b700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f803c005050 0x7f803c00b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:45:31.893 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f805ca9b700 1 -- 172.21.15.84:0/1515069301 reap_dead start 2020-01-16T05:45:31.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f805759e700 1 -- 172.21.15.84:0/1515069301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805808f140 con 0x7f803c0045a0 2020-01-16T05:45:31.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804ffff700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f803c0045a0 0x7f803c0049f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8040001520 tx=0x7f80400110c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:31.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f805759e700 1 -- 172.21.15.84:0/1515069301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80580900d0 con 0x7f803c0045a0 2020-01-16T05:45:31.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804ffff700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f803c0045a0 0x7f803c0049f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8040001520 tx=0x7f80400110c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:31.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804ffff700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f803c0045a0 0x7f803c0049f0 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7f8040001520 tx=0x7f80400110c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:31.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804ffff700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f803c0045a0 0x7f803c0049f0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f8040001520 tx=0x7f80400110c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:31.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804ffff700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f803c0045a0 0x7f803c0049f0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f8040001520 tx=0x7f80400110c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:31.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804ffff700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f803c0045a0 0x7f803c0049f0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f8040001520 tx=0x7f80400110c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:31.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804f7fe700 1 -- 172.21.15.84:0/1515069301 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f804000d870 con 0x7f803c0045a0 2020-01-16T05:45:31.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804f7fe700 1 -- 172.21.15.84:0/1515069301 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80400011d0 con 0x7f803c0045a0 2020-01-16T05:45:31.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.864+0000 7f804f7fe700 1 -- 172.21.15.84:0/1515069301 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f804000e0a0 con 0x7f803c0045a0 2020-01-16T05:45:31.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.868+0000 7f804ffff700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f803c0045a0 0x7f803c0049f0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f8040001520 tx=0x7f80400110c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:31.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.868+0000 7f804f7fe700 1 -- 172.21.15.84:0/1515069301 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f804000e2a0 con 0x7f803c0045a0 2020-01-16T05:45:31.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.868+0000 7f804ffff700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f803c0045a0 0x7f803c0049f0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f8040001520 tx=0x7f80400110c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:31.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.868+0000 7f805759e700 1 -- 172.21.15.84:0/1515069301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8030003360 con 0x7f803c0045a0 2020-01-16T05:45:31.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.868+0000 7f804f7fe700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f803c03ffd0 0x7f803c0424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:31.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.868+0000 7f804f7fe700 1 -- 172.21.15.84:0/1515069301 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f804004c490 con 0x7f803c0045a0 2020-01-16T05:45:31.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.868+0000 7f8056d9d700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f803c03ffd0 0x7f803c0424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:31.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.868+0000 7f8056d9d700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f803c03ffd0 0x7f803c0424e0 crc :-1 s=READY pgs=113 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:31.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.872+0000 7f804ffff700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f803c0045a0 0x7f803c0049f0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f8040001520 tx=0x7f80400110c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:31.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:31.872+0000 7f804f7fe700 1 -- 172.21.15.84:0/1515069301 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f8040032ab0 con 0x7f803c0045a0 2020-01-16T05:45:32.024 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:32.020+0000 7f805759e700 1 -- 172.21.15.84:0/1515069301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8030003790 con 0x7f803c0045a0 2020-01-16T05:45:32.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:32.020+0000 7f804ffff700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f803c0045a0 0x7f803c0049f0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f8040001520 tx=0x7f80400110c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:32.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:32.024+0000 7f804f7fe700 1 -- 172.21.15.84:0/1515069301 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f8040007280 con 0x7f803c0045a0 2020-01-16T05:45:32.026 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:32.027 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:32.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:32.024+0000 7f805759e700 1 -- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f803c03ffd0 msgr2=0x7f803c0424e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:32.024+0000 7f805759e700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f803c03ffd0 0x7f803c0424e0 crc :-1 s=READY pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:32.024+0000 7f805759e700 1 -- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f803c0045a0 msgr2=0x7f803c0049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:32.024+0000 7f805759e700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f803c0045a0 0x7f803c0049f0 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7f8040001520 tx=0x7f80400110c0).stop 2020-01-16T05:45:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:32.024+0000 7f805759e700 1 -- 172.21.15.84:0/1515069301 shutdown_connections 2020-01-16T05:45:32.030 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:32.024+0000 7f805759e700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f803c03ffd0 0x7f803c0424e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:32.030 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:32.024+0000 7f805759e700 1 --2- 172.21.15.84:0/1515069301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f803c0045a0 0x7f803c0049f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:32.030 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:32.024+0000 7f805759e700 1 -- 172.21.15.84:0/1515069301 shutdown_connections 2020-01-16T05:45:32.030 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:32.024+0000 7f805759e700 1 -- 172.21.15.84:0/1515069301 wait complete. 2020-01-16T05:45:32.031 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:32.024+0000 7f805759e700 1 -- 172.21.15.84:0/1515069301 >> 172.21.15.84:0/1515069301 conn(0x7f80580a8f40 msgr2=0x7f8058024790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:32.031 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:45:32.045 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:45:34.046 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:34.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.160+0000 7f0ebc699700 1 Processor -- start 2020-01-16T05:45:34.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.160+0000 7f0ebc699700 1 -- start start 2020-01-16T05:45:34.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.160+0000 7f0ebc699700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb405b0f0 0x7f0eb40a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:34.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.160+0000 7f0ebc699700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb407cd60 con 0x7f0eb408fd80 2020-01-16T05:45:34.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.160+0000 7f0ebc699700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb408f570 con 0x7f0eb40a2f60 2020-01-16T05:45:34.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.160+0000 7f0ebc699700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb40a3390 con 0x7f0eb405b0f0 2020-01-16T05:45:34.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.160+0000 7f0ebb437700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0eb408fd80 0x7f0eb41503f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52394/0 (socket says 172.21.15.84:52394) 2020-01-16T05:45:34.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.160+0000 7f0ebb437700 1 -- 172.21.15.84:0/2530414292 learned_addr learned my addr 172.21.15.84:0/2530414292 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:34.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eba435700 1 --2- 172.21.15.84:0/2530414292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb405b0f0 0x7f0eb40a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:34.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 -- 172.21.15.84:0/2530414292 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449928318 0 0) 0x7f0eb407cd60 con 0x7f0eb408fd80 2020-01-16T05:45:34.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 -- 172.21.15.84:0/2530414292 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e9c003230 con 0x7f0eb408fd80 2020-01-16T05:45:34.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 -- 172.21.15.84:0/2530414292 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027431103 0 0) 0x7f0eb408f570 con 0x7f0eb40a2f60 2020-01-16T05:45:34.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 -- 172.21.15.84:0/2530414292 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eb407cd60 con 0x7f0eb40a2f60 2020-01-16T05:45:34.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 -- 172.21.15.84:0/2530414292 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2211051779 0 0) 0x7f0e9c003230 con 0x7f0eb408fd80 2020-01-16T05:45:34.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 -- 172.21.15.84:0/2530414292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb405b0f0 msgr2=0x7f0eb40a8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:34.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 --2- 172.21.15.84:0/2530414292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb405b0f0 0x7f0eb40a8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:34.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 -- 172.21.15.84:0/2530414292 >> v1:172.21.15.142:6789/0 conn(0x7f0eb40a2f60 legacy=0x7f0eb407c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:34.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 -- 172.21.15.84:0/2530414292 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb405b520 con 0x7f0eb408fd80 2020-01-16T05:45:34.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 -- 172.21.15.84:0/2530414292 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f0eac001ad0 con 0x7f0eb408fd80 2020-01-16T05:45:34.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eba435700 1 --2- 172.21.15.84:0/2530414292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb405b0f0 0x7f0eb40a8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:45:34.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 -- 172.21.15.84:0/2530414292 >> v1:172.21.15.84:6789/0 conn(0x7f0eb408fd80 legacy=0x7f0eb41503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:34.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 --2- 172.21.15.84:0/2530414292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e9c003ac0 0x7f0e9c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:34.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 --2- 172.21.15.84:0/2530414292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e9c0045a0 0x7f0e9c004a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:34.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 --2- 172.21.15.84:0/2530414292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c005140 0x7f0e9c04f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:34.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 -- 172.21.15.84:0/2530414292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb40a3390 con 0x7f0e9c0045a0 2020-01-16T05:45:34.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 -- 172.21.15.84:0/2530414292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c04fe30 con 0x7f0e9c003ac0 2020-01-16T05:45:34.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 -- 172.21.15.84:0/2530414292 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c050070 con 0x7f0e9c005140 2020-01-16T05:45:34.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eba435700 1 --2- 172.21.15.84:0/2530414292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e9c0045a0 0x7f0e9c004a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0ebac36700 1 --2- 172.21.15.84:0/2530414292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e9c003ac0 0x7f0e9c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0ebb437700 1 --2- 172.21.15.84:0/2530414292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c005140 0x7f0e9c04f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eba435700 1 -- 172.21.15.84:0/2530414292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c005140 msgr2=0x7f0e9c04f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eba435700 1 --2- 172.21.15.84:0/2530414292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c005140 0x7f0e9c04f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eba435700 1 -- 172.21.15.84:0/2530414292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e9c003ac0 msgr2=0x7f0e9c003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eba435700 1 --2- 172.21.15.84:0/2530414292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e9c003ac0 0x7f0e9c003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eba435700 1 -- 172.21.15.84:0/2530414292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9c050370 con 0x7f0e9c0045a0 2020-01-16T05:45:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eba435700 1 --2- 172.21.15.84:0/2530414292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e9c0045a0 0x7f0e9c004a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0ea8002f30 tx=0x7f0ea800c050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eba435700 1 --2- 172.21.15.84:0/2530414292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e9c0045a0 0x7f0e9c004a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0ea8002f30 tx=0x7f0ea800c050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eba435700 1 --2- 172.21.15.84:0/2530414292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e9c0045a0 0x7f0e9c004a50 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7f0ea8002f30 tx=0x7f0ea800c050).ready entity=mon.0 client_cookie=c0237e7a33fe52d7 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eba435700 1 --2- 172.21.15.84:0/2530414292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e9c0045a0 0x7f0e9c004a50 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f0ea8002f30 tx=0x7f0ea800c050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 -- 172.21.15.84:0/2530414292 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ea8011d80 con 0x7f0e9c0045a0 2020-01-16T05:45:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eba435700 1 --2- 172.21.15.84:0/2530414292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e9c0045a0 0x7f0e9c004a50 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f0ea8002f30 tx=0x7f0ea800c050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 -- 172.21.15.84:0/2530414292 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea800e200 con 0x7f0e9c0045a0 2020-01-16T05:45:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eba435700 1 --2- 172.21.15.84:0/2530414292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e9c0045a0 0x7f0e9c004a50 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f0ea8002f30 tx=0x7f0ea800c050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0eb9c34700 1 -- 172.21.15.84:0/2530414292 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ea8005aa0 con 0x7f0e9c0045a0 2020-01-16T05:45:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0ebc699700 1 -- 172.21.15.84:0/2530414292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e9c0045a0 msgr2=0x7f0e9c004a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0ebc699700 1 --2- 172.21.15.84:0/2530414292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e9c0045a0 0x7f0e9c004a50 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7f0ea8002f30 tx=0x7f0ea800c050).stop 2020-01-16T05:45:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0ebb437700 1 -- 172.21.15.84:0/2530414292 reap_dead start 2020-01-16T05:45:34.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0ebc699700 1 -- 172.21.15.84:0/2530414292 shutdown_connections 2020-01-16T05:45:34.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0ebc699700 1 -- 172.21.15.84:0/2530414292 shutdown_connections 2020-01-16T05:45:34.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0ebc699700 1 -- 172.21.15.84:0/2530414292 wait complete. 2020-01-16T05:45:34.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.164+0000 7f0ebc699700 1 -- 172.21.15.84:0/2530414292 >> 172.21.15.84:0/2530414292 conn(0x7f0eb40abc10 msgr2=0x7f0eb405a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:34.181 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0ebc699700 1 Processor -- start 2020-01-16T05:45:34.181 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0ebc699700 1 -- start start 2020-01-16T05:45:34.181 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0ebc699700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb4125fd0 0x7f0eb40a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:34.181 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0ebc699700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0eb409f8f0 0x7f0eb409fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:34.182 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0ebc699700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0eb409d550 0x7f0eb409d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:34.182 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0ebc699700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb40a1560 con 0x7f0eb409f8f0 2020-01-16T05:45:34.182 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0ebc699700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb40a1800 con 0x7f0eb409d550 2020-01-16T05:45:34.182 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0ebc699700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb409f650 con 0x7f0eb4125fd0 2020-01-16T05:45:34.182 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eba435700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0eb409f8f0 0x7f0eb409fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:34.182 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eba435700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0eb409f8f0 0x7f0eb409fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35204/0 (socket says 172.21.15.84:35204) 2020-01-16T05:45:34.183 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eba435700 1 -- 172.21.15.84:0/175918309 learned_addr learned my addr 172.21.15.84:0/175918309 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:45:34.183 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0ebb437700 1 --2- 172.21.15.84:0/175918309 >> v2:172.21.15.142:3300/0 conn(0x7f0eb409d550 0x7f0eb409d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:34.183 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0ebac36700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb4125fd0 0x7f0eb40a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:34.183 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eba435700 1 -- 172.21.15.84:0/175918309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb4125fd0 msgr2=0x7f0eb40a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:34.183 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eba435700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb4125fd0 0x7f0eb40a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:34.183 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eba435700 1 -- 172.21.15.84:0/175918309 >> v2:172.21.15.142:3300/0 conn(0x7f0eb409d550 msgr2=0x7f0eb409d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:34.183 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eba435700 1 --2- 172.21.15.84:0/175918309 >> v2:172.21.15.142:3300/0 conn(0x7f0eb409d550 0x7f0eb409d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:34.184 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eba435700 1 -- 172.21.15.84:0/175918309 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb41490e0 con 0x7f0eb409f8f0 2020-01-16T05:45:34.184 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0ebac36700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb4125fd0 0x7f0eb40a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:45:34.184 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0ebb437700 1 --2- 172.21.15.84:0/175918309 >> v2:172.21.15.142:3300/0 conn(0x7f0eb409d550 0x7f0eb409d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:45:34.184 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eba435700 1 --2- 172.21.15.84:0/175918309 >> v2:172.21.15.84:3300/0 conn(0x7f0eb409f8f0 0x7f0eb409fd20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0eb40a1720 tx=0x7f0ea80070c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:34.184 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eba435700 1 --2- 172.21.15.84:0/175918309 >> v2:172.21.15.84:3300/0 conn(0x7f0eb409f8f0 0x7f0eb409fd20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0eb40a1720 tx=0x7f0ea80070c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:34.184 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eba435700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb409f8f0 0x7f0eb409fd20 secure :-1 s=READY pgs=294 cs=0 l=1 rx=0x7f0eb40a1720 tx=0x7f0ea80070c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:34.184 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eba435700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb409f8f0 0x7f0eb409fd20 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7f0eb40a1720 tx=0x7f0ea80070c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:34.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eba435700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb409f8f0 0x7f0eb409fd20 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7f0eb40a1720 tx=0x7f0ea80070c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:34.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eba435700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb409f8f0 0x7f0eb409fd20 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7f0eb40a1720 tx=0x7f0ea80070c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:34.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eb37fe700 1 -- 172.21.15.84:0/175918309 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ea80058b0 con 0x7f0eb409f8f0 2020-01-16T05:45:34.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eb37fe700 1 -- 172.21.15.84:0/175918309 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea80056c0 con 0x7f0eb409f8f0 2020-01-16T05:45:34.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eb37fe700 1 -- 172.21.15.84:0/175918309 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ea800c4b0 con 0x7f0eb409f8f0 2020-01-16T05:45:34.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0ebc699700 1 -- 172.21.15.84:0/175918309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb40a21c0 con 0x7f0eb409f8f0 2020-01-16T05:45:34.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0ebc699700 1 -- 172.21.15.84:0/175918309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb409ded0 con 0x7f0eb409f8f0 2020-01-16T05:45:34.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eba435700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb409f8f0 0x7f0eb409fd20 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7f0eb40a1720 tx=0x7f0ea80070c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:34.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eb37fe700 1 -- 172.21.15.84:0/175918309 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f0ea800c7c0 con 0x7f0eb409f8f0 2020-01-16T05:45:34.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0eba435700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb409f8f0 0x7f0eb409fd20 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7f0eb40a1720 tx=0x7f0ea80070c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:34.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.168+0000 7f0ebc699700 1 -- 172.21.15.84:0/175918309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb405e1c0 con 0x7f0eb409f8f0 2020-01-16T05:45:34.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.172+0000 7f0eb37fe700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0e9403c2f0 0x7f0e9403e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:34.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.172+0000 7f0eb37fe700 1 -- 172.21.15.84:0/175918309 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f0ea804cc00 con 0x7f0eb409f8f0 2020-01-16T05:45:34.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.172+0000 7f0ebac36700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0e9403c2f0 0x7f0e9403e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:34.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.172+0000 7f0ebac36700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0e9403c2f0 0x7f0e9403e800 crc :-1 s=READY pgs=114 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:34.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.176+0000 7f0eba435700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb409f8f0 0x7f0eb409fd20 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7f0eb40a1720 tx=0x7f0ea80070c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:34.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.176+0000 7f0eb37fe700 1 -- 172.21.15.84:0/175918309 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f0ea8033480 con 0x7f0eb409f8f0 2020-01-16T05:45:34.337 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.336+0000 7f0ebc699700 1 -- 172.21.15.84:0/175918309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0eb405cbc0 con 0x7f0eb409f8f0 2020-01-16T05:45:34.338 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.336+0000 7f0eba435700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb409f8f0 0x7f0eb409fd20 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7f0eb40a1720 tx=0x7f0ea80070c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:34.338 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.336+0000 7f0eb37fe700 1 -- 172.21.15.84:0/175918309 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f0ea8034b10 con 0x7f0eb409f8f0 2020-01-16T05:45:34.338 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:34.338 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:34.339 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.336+0000 7f0ebc699700 1 -- 172.21.15.84:0/175918309 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0e9403c2f0 msgr2=0x7f0e9403e800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:34.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.336+0000 7f0ebc699700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0e9403c2f0 0x7f0e9403e800 crc :-1 s=READY pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:34.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.336+0000 7f0ebc699700 1 -- 172.21.15.84:0/175918309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb409f8f0 msgr2=0x7f0eb409fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:34.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.336+0000 7f0ebc699700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb409f8f0 0x7f0eb409fd20 secure :-1 s=READY pgs=294 cs=0 l=1 rx=0x7f0eb40a1720 tx=0x7f0ea80070c0).stop 2020-01-16T05:45:34.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.336+0000 7f0ebc699700 1 -- 172.21.15.84:0/175918309 shutdown_connections 2020-01-16T05:45:34.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.336+0000 7f0ebc699700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0e9403c2f0 0x7f0e9403e800 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:34.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.336+0000 7f0ebc699700 1 --2- 172.21.15.84:0/175918309 >> v2:172.21.15.142:3300/0 conn(0x7f0eb409d550 0x7f0eb409d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:34.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.336+0000 7f0ebc699700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb4125fd0 0x7f0eb40a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:34.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.336+0000 7f0ebc699700 1 --2- 172.21.15.84:0/175918309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb409f8f0 0x7f0eb409fd20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:34.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.336+0000 7f0ebc699700 1 -- 172.21.15.84:0/175918309 shutdown_connections 2020-01-16T05:45:34.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.336+0000 7f0ebc699700 1 -- 172.21.15.84:0/175918309 wait complete. 2020-01-16T05:45:34.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:34.336+0000 7f0ebc699700 1 -- 172.21.15.84:0/175918309 >> 172.21.15.84:0/175918309 conn(0x7f0eb40a9760 msgr2=0x7f0eb40a6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:34.341 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:45:34.354 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:45:36.355 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.444+0000 7f809ffff700 1 Processor -- start 2020-01-16T05:45:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.444+0000 7f809ffff700 1 -- start start 2020-01-16T05:45:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.444+0000 7f809ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a007ff10 0x7f80a00abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.444+0000 7f809ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f80a00a4250 0x7f80a0066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.444+0000 7f809ffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a0066dd0 con 0x7f80a00a9b30 2020-01-16T05:45:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.444+0000 7f809ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a00a4830 con 0x7f80a00a4250 2020-01-16T05:45:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.444+0000 7f809ffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a007f9d0 con 0x7f80a007ff10 2020-01-16T05:45:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.444+0000 7f809effd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a007ff10 0x7f80a00abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.444+0000 7f80a57d8700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f80a00a4250 0x7f80a0066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.444+0000 7f809effd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a007ff10 0x7f80a00abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:47464/0 (socket says 172.21.15.84:47464) 2020-01-16T05:45:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.444+0000 7f809effd700 1 -- 172.21.15.84:0/3180811730 learned_addr learned my addr 172.21.15.84:0/3180811730 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:45:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.444+0000 7f809effd700 1 -- 172.21.15.84:0/3180811730 >> v2:172.21.15.142:3300/0 conn(0x7f80a00a4250 msgr2=0x7f80a0066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.444+0000 7f809effd700 1 --2- 172.21.15.84:0/3180811730 >> v2:172.21.15.142:3300/0 conn(0x7f80a00a4250 0x7f80a0066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.444+0000 7f809effd700 1 -- 172.21.15.84:0/3180811730 >> v1:172.21.15.142:6789/0 conn(0x7f80a00a9b30 legacy=0x7f80a00a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.444+0000 7f809effd700 1 -- 172.21.15.84:0/3180811730 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a0150ce0 con 0x7f80a007ff10 2020-01-16T05:45:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.444+0000 7f80a57d8700 1 --2- 172.21.15.84:0/3180811730 >> v2:172.21.15.142:3300/0 conn(0x7f80a00a4250 0x7f80a0066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:45:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809effd700 1 --2- 172.21.15.84:0/3180811730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a007ff10 0x7f80a00abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8094008910 tx=0x7f809400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809effd700 1 --2- 172.21.15.84:0/3180811730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a007ff10 0x7f80a00abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8094008910 tx=0x7f809400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809effd700 1 --2- 172.21.15.84:0/3180811730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a007ff10 0x7f80a00abdd0 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f8094008910 tx=0x7f809400feb0).ready entity=mon.2 client_cookie=35d4b48de7e19590 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809effd700 1 --2- 172.21.15.84:0/3180811730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a007ff10 0x7f80a00abdd0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f8094008910 tx=0x7f809400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809e7fc700 1 -- 172.21.15.84:0/3180811730 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8094011720 con 0x7f80a007ff10 2020-01-16T05:45:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809effd700 1 --2- 172.21.15.84:0/3180811730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a007ff10 0x7f80a00abdd0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f8094008910 tx=0x7f809400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809e7fc700 1 -- 172.21.15.84:0/3180811730 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8094008d30 con 0x7f80a007ff10 2020-01-16T05:45:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809effd700 1 --2- 172.21.15.84:0/3180811730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a007ff10 0x7f80a00abdd0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f8094008910 tx=0x7f809400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809e7fc700 1 -- 172.21.15.84:0/3180811730 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8094011d00 con 0x7f80a007ff10 2020-01-16T05:45:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809ffff700 1 -- 172.21.15.84:0/3180811730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a007ff10 msgr2=0x7f80a00abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809ffff700 1 --2- 172.21.15.84:0/3180811730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a007ff10 0x7f80a00abdd0 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f8094008910 tx=0x7f809400feb0).stop 2020-01-16T05:45:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809ffff700 1 -- 172.21.15.84:0/3180811730 shutdown_connections 2020-01-16T05:45:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809ffff700 1 --2- 172.21.15.84:0/3180811730 >> v2:172.21.15.142:3300/0 conn(0x7f80a00a4250 0x7f80a0066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809ffff700 1 --2- 172.21.15.84:0/3180811730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a007ff10 0x7f80a00abdd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809ffff700 1 -- 172.21.15.84:0/3180811730 shutdown_connections 2020-01-16T05:45:36.455 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809ffff700 1 -- 172.21.15.84:0/3180811730 wait complete. 2020-01-16T05:45:36.455 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809ffff700 1 -- 172.21.15.84:0/3180811730 >> 172.21.15.84:0/3180811730 conn(0x7f80a00acfc0 msgr2=0x7f80a00a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:36.458 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809ffff700 1 Processor -- start 2020-01-16T05:45:36.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809ffff700 1 -- start start 2020-01-16T05:45:36.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f80a005bef0 0x7f80a0090dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:36.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f80a0091320 0x7f80a007bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:36.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809ffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a00a3610 con 0x7f80a0091b70 2020-01-16T05:45:36.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809ffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a00a2e30 con 0x7f80a005bef0 2020-01-16T05:45:36.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a00a30d0 con 0x7f80a0091320 2020-01-16T05:45:36.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f80a005bef0 0x7f80a0090dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:36.460 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f80a005bef0 0x7f80a0090dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35226/0 (socket says 172.21.15.84:35226) 2020-01-16T05:45:36.460 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809effd700 1 -- 172.21.15.84:0/1191336117 learned_addr learned my addr 172.21.15.84:0/1191336117 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:45:36.460 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f80a57d8700 1 --2- 172.21.15.84:0/1191336117 >> v2:172.21.15.142:3300/0 conn(0x7f80a0091320 0x7f80a007bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:36.460 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809effd700 1 -- 172.21.15.84:0/1191336117 >> v2:172.21.15.142:3300/0 conn(0x7f80a0091320 msgr2=0x7f80a007bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:36.460 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809effd700 1 --2- 172.21.15.84:0/1191336117 >> v2:172.21.15.142:3300/0 conn(0x7f80a0091320 0x7f80a007bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:36.460 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809effd700 1 -- 172.21.15.84:0/1191336117 >> v1:172.21.15.142:6789/0 conn(0x7f80a0091b70 legacy=0x7f80a00a24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:36.460 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809effd700 1 -- 172.21.15.84:0/1191336117 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a007c1b0 con 0x7f80a005bef0 2020-01-16T05:45:36.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809effd700 1 --2- 172.21.15.84:0/1191336117 >> v2:172.21.15.84:3300/0 conn(0x7f80a005bef0 0x7f80a0090dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80a00a2ff0 tx=0x7f80940117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:36.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809effd700 1 --2- 172.21.15.84:0/1191336117 >> v2:172.21.15.84:3300/0 conn(0x7f80a005bef0 0x7f80a0090dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80a00a2ff0 tx=0x7f80940117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:36.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809effd700 1 --2- 172.21.15.84:0/1191336117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80a005bef0 0x7f80a0090dd0 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7f80a00a2ff0 tx=0x7f80940117e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:36.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809effd700 1 --2- 172.21.15.84:0/1191336117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80a005bef0 0x7f80a0090dd0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f80a00a2ff0 tx=0x7f80940117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:36.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f8087fff700 1 -- 172.21.15.84:0/1191336117 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f809400f760 con 0x7f80a005bef0 2020-01-16T05:45:36.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809ffff700 1 -- 172.21.15.84:0/1191336117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a007c480 con 0x7f80a005bef0 2020-01-16T05:45:36.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.448+0000 7f809effd700 1 --2- 172.21.15.84:0/1191336117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80a005bef0 0x7f80a0090dd0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f80a00a2ff0 tx=0x7f80940117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:36.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.452+0000 7f809ffff700 1 -- 172.21.15.84:0/1191336117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a013d190 con 0x7f80a005bef0 2020-01-16T05:45:36.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.452+0000 7f8087fff700 1 -- 172.21.15.84:0/1191336117 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8094011920 con 0x7f80a005bef0 2020-01-16T05:45:36.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.452+0000 7f809effd700 1 --2- 172.21.15.84:0/1191336117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80a005bef0 0x7f80a0090dd0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f80a00a2ff0 tx=0x7f80940117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:36.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.452+0000 7f8087fff700 1 -- 172.21.15.84:0/1191336117 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8094007530 con 0x7f80a005bef0 2020-01-16T05:45:36.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.452+0000 7f809effd700 1 --2- 172.21.15.84:0/1191336117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80a005bef0 0x7f80a0090dd0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f80a00a2ff0 tx=0x7f80940117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:36.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.452+0000 7f809ffff700 1 -- 172.21.15.84:0/1191336117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a005e1c0 con 0x7f80a005bef0 2020-01-16T05:45:36.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.452+0000 7f8087fff700 1 -- 172.21.15.84:0/1191336117 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f80940056c0 con 0x7f80a005bef0 2020-01-16T05:45:36.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.452+0000 7f809effd700 1 --2- 172.21.15.84:0/1191336117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80a005bef0 0x7f80a0090dd0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f80a00a2ff0 tx=0x7f80940117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:36.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.452+0000 7f8087fff700 1 --2- 172.21.15.84:0/1191336117 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f808003c270 0x7f808003e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:36.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.452+0000 7f8087fff700 1 -- 172.21.15.84:0/1191336117 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f809404ce90 con 0x7f80a005bef0 2020-01-16T05:45:36.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.452+0000 7f809f7fe700 1 --2- 172.21.15.84:0/1191336117 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f808003c270 0x7f808003e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:36.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.452+0000 7f809f7fe700 1 --2- 172.21.15.84:0/1191336117 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f808003c270 0x7f808003e780 crc :-1 s=READY pgs=115 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:36.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.456+0000 7f809effd700 1 --2- 172.21.15.84:0/1191336117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80a005bef0 0x7f80a0090dd0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f80a00a2ff0 tx=0x7f80940117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:36.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.456+0000 7f8087fff700 1 -- 172.21.15.84:0/1191336117 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f8094033490 con 0x7f80a005bef0 2020-01-16T05:45:36.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.620+0000 7f809ffff700 1 -- 172.21.15.84:0/1191336117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80a005cbc0 con 0x7f80a005bef0 2020-01-16T05:45:36.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.620+0000 7f809effd700 1 --2- 172.21.15.84:0/1191336117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80a005bef0 0x7f80a0090dd0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f80a00a2ff0 tx=0x7f80940117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:36.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.620+0000 7f8087fff700 1 -- 172.21.15.84:0/1191336117 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f80940336f0 con 0x7f80a005bef0 2020-01-16T05:45:36.623 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:36.624 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:36.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.624+0000 7f809ffff700 1 -- 172.21.15.84:0/1191336117 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f808003c270 msgr2=0x7f808003e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:36.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.624+0000 7f809ffff700 1 --2- 172.21.15.84:0/1191336117 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f808003c270 0x7f808003e780 crc :-1 s=READY pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:36.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.624+0000 7f809ffff700 1 -- 172.21.15.84:0/1191336117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80a005bef0 msgr2=0x7f80a0090dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:36.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.624+0000 7f809ffff700 1 --2- 172.21.15.84:0/1191336117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80a005bef0 0x7f80a0090dd0 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7f80a00a2ff0 tx=0x7f80940117e0).stop 2020-01-16T05:45:36.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.624+0000 7f809ffff700 1 -- 172.21.15.84:0/1191336117 shutdown_connections 2020-01-16T05:45:36.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.624+0000 7f809ffff700 1 --2- 172.21.15.84:0/1191336117 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f808003c270 0x7f808003e780 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:36.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.624+0000 7f809ffff700 1 --2- 172.21.15.84:0/1191336117 >> v2:172.21.15.142:3300/0 conn(0x7f80a0091320 0x7f80a007bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:36.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.624+0000 7f809ffff700 1 --2- 172.21.15.84:0/1191336117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80a005bef0 0x7f80a0090dd0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:36.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.624+0000 7f809ffff700 1 -- 172.21.15.84:0/1191336117 shutdown_connections 2020-01-16T05:45:36.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.624+0000 7f809ffff700 1 -- 172.21.15.84:0/1191336117 wait complete. 2020-01-16T05:45:36.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:36.624+0000 7f809ffff700 1 -- 172.21.15.84:0/1191336117 >> 172.21.15.84:0/1191336117 conn(0x7f80a0066650 msgr2=0x7f80a00246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:36.627 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:45:36.638 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:45:37.414 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~70s 2020-01-16T05:45:38.639 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:38.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3edeadf700 1 Processor -- start 2020-01-16T05:45:38.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3edeadf700 1 -- start start 2020-01-16T05:45:38.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3edeadf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3ed807ff10 0x7f3ed80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:38.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3edeadf700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed8066880 con 0x7f3ed80a9b30 2020-01-16T05:45:38.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3edeadf700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed8066ab0 con 0x7f3ed80a4250 2020-01-16T05:45:38.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3edeadf700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed80a4830 con 0x7f3ed807ff10 2020-01-16T05:45:38.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3eddadd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3ed807ff10 0x7f3ed80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:38.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3eddadd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3ed807ff10 0x7f3ed80abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35238/0 (socket says 172.21.15.84:35238) 2020-01-16T05:45:38.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3ede2de700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3ed80a9b30 0x7f3ed80a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52436/0 (socket says 172.21.15.84:52436) 2020-01-16T05:45:38.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3eddadd700 1 -- 172.21.15.84:0/4195228087 learned_addr learned my addr 172.21.15.84:0/4195228087 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:45:38.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3eddadd700 1 -- 172.21.15.84:0/4195228087 >> v1:172.21.15.142:6789/0 conn(0x7f3ed80a4250 legacy=0x7f3ed814fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:38.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3eddadd700 1 -- 172.21.15.84:0/4195228087 >> v1:172.21.15.84:6789/0 conn(0x7f3ed80a9b30 legacy=0x7f3ed80a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:38.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3eddadd700 1 -- 172.21.15.84:0/4195228087 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed8066ce0 con 0x7f3ed807ff10 2020-01-16T05:45:38.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3edd2dc700 1 -- 172.21.15.84:0/4195228087 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602179527 0 0) 0x7f3ed8066880 con 0x7f3ed80a9b30 2020-01-16T05:45:38.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3eddadd700 1 --2- 172.21.15.84:0/4195228087 >> v2:172.21.15.84:3300/0 conn(0x7f3ed807ff10 0x7f3ed80abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3ec8008910 tx=0x7f3ec800fe30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:38.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3eddadd700 1 --2- 172.21.15.84:0/4195228087 >> v2:172.21.15.84:3300/0 conn(0x7f3ed807ff10 0x7f3ed80abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3ec8008910 tx=0x7f3ec800fe30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:38.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3eddadd700 1 --2- 172.21.15.84:0/4195228087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed807ff10 0x7f3ed80abdd0 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7f3ec8008910 tx=0x7f3ec800fe30).ready entity=mon.0 client_cookie=3cf0d3d95a064b2e server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:38.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3eddadd700 1 --2- 172.21.15.84:0/4195228087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed807ff10 0x7f3ed80abdd0 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f3ec8008910 tx=0x7f3ec800fe30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:38.775 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3edd2dc700 1 -- 172.21.15.84:0/4195228087 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ec8011890 con 0x7f3ed807ff10 2020-01-16T05:45:38.775 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3eddadd700 1 --2- 172.21.15.84:0/4195228087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed807ff10 0x7f3ed80abdd0 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f3ec8008910 tx=0x7f3ec800fe30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:38.775 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3eddadd700 1 --2- 172.21.15.84:0/4195228087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed807ff10 0x7f3ed80abdd0 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f3ec8008910 tx=0x7f3ec800fe30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:38.775 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3edd2dc700 1 -- 172.21.15.84:0/4195228087 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec80114b0 con 0x7f3ed807ff10 2020-01-16T05:45:38.776 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3edd2dc700 1 -- 172.21.15.84:0/4195228087 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ec800a160 con 0x7f3ed807ff10 2020-01-16T05:45:38.776 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3edeadf700 1 -- 172.21.15.84:0/4195228087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed807ff10 msgr2=0x7f3ed80abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:38.776 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3edeadf700 1 --2- 172.21.15.84:0/4195228087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed807ff10 0x7f3ed80abdd0 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7f3ec8008910 tx=0x7f3ec800fe30).stop 2020-01-16T05:45:38.776 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3edeadf700 1 -- 172.21.15.84:0/4195228087 shutdown_connections 2020-01-16T05:45:38.776 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3edeadf700 1 --2- 172.21.15.84:0/4195228087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed807ff10 0x7f3ed80abdd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:38.776 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3edeadf700 1 -- 172.21.15.84:0/4195228087 shutdown_connections 2020-01-16T05:45:38.776 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3edeadf700 1 -- 172.21.15.84:0/4195228087 wait complete. 2020-01-16T05:45:38.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.768+0000 7f3edeadf700 1 -- 172.21.15.84:0/4195228087 >> 172.21.15.84:0/4195228087 conn(0x7f3ed80acfc0 msgr2=0x7f3ed80a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:38.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3edeadf700 1 Processor -- start 2020-01-16T05:45:38.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3edeadf700 1 -- start start 2020-01-16T05:45:38.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3edeadf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3ed80a0a40 0x7f3ed8131550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:38.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3edeadf700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3ed80a1830 0x7f3ed80656e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:38.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3edeadf700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed8091ab0 con 0x7f3ed8065c30 2020-01-16T05:45:38.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3edeadf700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed80a0540 con 0x7f3ed80a0a40 2020-01-16T05:45:38.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3edeadf700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed80a07a0 con 0x7f3ed80a1830 2020-01-16T05:45:38.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3ede2de700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3ed80a0a40 0x7f3ed8131550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:38.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3ede2de700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3ed80a0a40 0x7f3ed8131550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35242/0 (socket says 172.21.15.84:35242) 2020-01-16T05:45:38.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3ede2de700 1 -- 172.21.15.84:0/2774600469 learned_addr learned my addr 172.21.15.84:0/2774600469 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:45:38.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3eddadd700 1 --2- 172.21.15.84:0/2774600469 >> v2:172.21.15.142:3300/0 conn(0x7f3ed80a1830 0x7f3ed80656e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:38.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3ede2de700 1 -- 172.21.15.84:0/2774600469 >> v2:172.21.15.142:3300/0 conn(0x7f3ed80a1830 msgr2=0x7f3ed80656e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:38.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3ede2de700 1 --2- 172.21.15.84:0/2774600469 >> v2:172.21.15.142:3300/0 conn(0x7f3ed80a1830 0x7f3ed80656e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:38.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3ede2de700 1 -- 172.21.15.84:0/2774600469 >> v1:172.21.15.84:6789/0 conn(0x7f3ed8065c30 legacy=0x7f3ed8134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:38.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3ede2de700 1 -- 172.21.15.84:0/2774600469 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed80ab090 con 0x7f3ed80a0a40 2020-01-16T05:45:38.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3ede2de700 1 --2- 172.21.15.84:0/2774600469 >> v2:172.21.15.84:3300/0 conn(0x7f3ed80a0a40 0x7f3ed8131550 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ed00013c0 tx=0x7f3ed0001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:38.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3ede2de700 1 --2- 172.21.15.84:0/2774600469 >> v2:172.21.15.84:3300/0 conn(0x7f3ed80a0a40 0x7f3ed8131550 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ed00013c0 tx=0x7f3ed0001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:38.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3ede2de700 1 --2- 172.21.15.84:0/2774600469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed80a0a40 0x7f3ed8131550 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f3ed00013c0 tx=0x7f3ed0001400).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:38.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3ede2de700 1 --2- 172.21.15.84:0/2774600469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed80a0a40 0x7f3ed8131550 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f3ed00013c0 tx=0x7f3ed0001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:38.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3ede2de700 1 --2- 172.21.15.84:0/2774600469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed80a0a40 0x7f3ed8131550 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f3ed00013c0 tx=0x7f3ed0001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:38.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.772+0000 7f3ede2de700 1 --2- 172.21.15.84:0/2774600469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed80a0a40 0x7f3ed8131550 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f3ed00013c0 tx=0x7f3ed0001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:38.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.776+0000 7f3eceffd700 1 -- 172.21.15.84:0/2774600469 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ed400cc50 con 0x7f3ed80a0a40 2020-01-16T05:45:38.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.776+0000 7f3eceffd700 1 -- 172.21.15.84:0/2774600469 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed400c870 con 0x7f3ed80a0a40 2020-01-16T05:45:38.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.776+0000 7f3edeadf700 1 -- 172.21.15.84:0/2774600469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed8091d90 con 0x7f3ed80a0a40 2020-01-16T05:45:38.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.776+0000 7f3eceffd700 1 -- 172.21.15.84:0/2774600469 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ed40048d0 con 0x7f3ed80a0a40 2020-01-16T05:45:38.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.776+0000 7f3edeadf700 1 -- 172.21.15.84:0/2774600469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed80a3230 con 0x7f3ed80a0a40 2020-01-16T05:45:38.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.776+0000 7f3ede2de700 1 --2- 172.21.15.84:0/2774600469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed80a0a40 0x7f3ed8131550 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f3ed00013c0 tx=0x7f3ed0001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:38.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.776+0000 7f3eceffd700 1 -- 172.21.15.84:0/2774600469 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f3ed4004ad0 con 0x7f3ed80a0a40 2020-01-16T05:45:38.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.776+0000 7f3ede2de700 1 --2- 172.21.15.84:0/2774600469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed80a0a40 0x7f3ed8131550 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f3ed00013c0 tx=0x7f3ed0001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:38.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.776+0000 7f3edeadf700 1 -- 172.21.15.84:0/2774600469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed805e1c0 con 0x7f3ed80a0a40 2020-01-16T05:45:38.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.776+0000 7f3eceffd700 1 --2- 172.21.15.84:0/2774600469 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3ec003e550 0x7f3ec0040a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:38.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.776+0000 7f3eceffd700 1 -- 172.21.15.84:0/2774600469 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f3ed404c4d0 con 0x7f3ed80a0a40 2020-01-16T05:45:38.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.776+0000 7f3eddadd700 1 --2- 172.21.15.84:0/2774600469 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3ec003e550 0x7f3ec0040a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:38.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.776+0000 7f3eddadd700 1 --2- 172.21.15.84:0/2774600469 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3ec003e550 0x7f3ec0040a60 crc :-1 s=READY pgs=116 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:38.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.780+0000 7f3ede2de700 1 --2- 172.21.15.84:0/2774600469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed80a0a40 0x7f3ed8131550 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f3ed00013c0 tx=0x7f3ed0001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:38.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.780+0000 7f3eceffd700 1 -- 172.21.15.84:0/2774600469 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f3ed4004de0 con 0x7f3ed80a0a40 2020-01-16T05:45:38.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.932+0000 7f3edeadf700 1 -- 172.21.15.84:0/2774600469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ed80a35c0 con 0x7f3ed80a0a40 2020-01-16T05:45:38.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.932+0000 7f3ede2de700 1 --2- 172.21.15.84:0/2774600469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed80a0a40 0x7f3ed8131550 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f3ed00013c0 tx=0x7f3ed0001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:38.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.932+0000 7f3eceffd700 1 -- 172.21.15.84:0/2774600469 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f3ed4032af0 con 0x7f3ed80a0a40 2020-01-16T05:45:38.934 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:38.934 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:38.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.932+0000 7f3edeadf700 1 -- 172.21.15.84:0/2774600469 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3ec003e550 msgr2=0x7f3ec0040a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:38.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.932+0000 7f3edeadf700 1 --2- 172.21.15.84:0/2774600469 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3ec003e550 0x7f3ec0040a60 crc :-1 s=READY pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.932+0000 7f3edeadf700 1 -- 172.21.15.84:0/2774600469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed80a0a40 msgr2=0x7f3ed8131550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.932+0000 7f3edeadf700 1 --2- 172.21.15.84:0/2774600469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed80a0a40 0x7f3ed8131550 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f3ed00013c0 tx=0x7f3ed0001400).stop 2020-01-16T05:45:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.932+0000 7f3edeadf700 1 -- 172.21.15.84:0/2774600469 shutdown_connections 2020-01-16T05:45:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.932+0000 7f3edeadf700 1 --2- 172.21.15.84:0/2774600469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed80a0a40 0x7f3ed8131550 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.932+0000 7f3edeadf700 1 --2- 172.21.15.84:0/2774600469 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3ec003e550 0x7f3ec0040a60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.932+0000 7f3edeadf700 1 --2- 172.21.15.84:0/2774600469 >> v2:172.21.15.142:3300/0 conn(0x7f3ed80a1830 0x7f3ed80656e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.932+0000 7f3edeadf700 1 -- 172.21.15.84:0/2774600469 shutdown_connections 2020-01-16T05:45:38.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.932+0000 7f3edeadf700 1 -- 172.21.15.84:0/2774600469 wait complete. 2020-01-16T05:45:38.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:38.932+0000 7f3edeadf700 1 -- 172.21.15.84:0/2774600469 >> 172.21.15.84:0/2774600469 conn(0x7f3ed80a6410 msgr2=0x7f3ed80a3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:38.937 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:45:38.945 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:45:40.946 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:41.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad3fff700 1 Processor -- start 2020-01-16T05:45:41.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad3fff700 1 -- start start 2020-01-16T05:45:41.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad3fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbad407ff10 0x7fbad40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:41.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbad40a4250 0x7fbad4066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:41.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad3fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad4066dd0 con 0x7fbad40a9b30 2020-01-16T05:45:41.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad3fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad40a4830 con 0x7fbad40a4250 2020-01-16T05:45:41.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad3fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad407f9d0 con 0x7fbad407ff10 2020-01-16T05:45:41.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad9876700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbad40a4250 0x7fbad4066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:41.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad37fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbad40a9b30 0x7fbad40a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52450/0 (socket says 172.21.15.84:52450) 2020-01-16T05:45:41.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad37fe700 1 -- 172.21.15.84:0/387690110 learned_addr learned my addr 172.21.15.84:0/387690110 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:41.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad2ffd700 1 --2- 172.21.15.84:0/387690110 >> v2:172.21.15.142:3300/0 conn(0x7fbad407ff10 0x7fbad40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:41.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad9876700 1 -- 172.21.15.84:0/387690110 >> v2:172.21.15.142:3300/0 conn(0x7fbad407ff10 msgr2=0x7fbad40abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:41.078 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad9876700 1 --2- 172.21.15.84:0/387690110 >> v2:172.21.15.142:3300/0 conn(0x7fbad407ff10 0x7fbad40abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:41.078 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad9876700 1 -- 172.21.15.84:0/387690110 >> v1:172.21.15.84:6789/0 conn(0x7fbad40a9b30 legacy=0x7fbad40a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:41.078 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad9876700 1 -- 172.21.15.84:0/387690110 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad4150ce0 con 0x7fbad40a4250 2020-01-16T05:45:41.078 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad27fc700 1 -- 172.21.15.84:0/387690110 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830791060 0 0) 0x7fbad4066dd0 con 0x7fbad40a9b30 2020-01-16T05:45:41.078 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad9876700 1 --2- 172.21.15.84:0/387690110 >> v2:172.21.15.84:3300/0 conn(0x7fbad40a4250 0x7fbad4066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbad40a49f0 tx=0x7fbacc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:41.078 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad9876700 1 --2- 172.21.15.84:0/387690110 >> v2:172.21.15.84:3300/0 conn(0x7fbad40a4250 0x7fbad4066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbad40a49f0 tx=0x7fbacc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:41.078 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad9876700 1 --2- 172.21.15.84:0/387690110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbad40a4250 0x7fbad4066880 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7fbad40a49f0 tx=0x7fbacc010170).ready entity=mon.0 client_cookie=af68d8a2db2cc93c server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:41.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad9876700 1 --2- 172.21.15.84:0/387690110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbad40a4250 0x7fbad4066880 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7fbad40a49f0 tx=0x7fbacc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:41.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad27fc700 1 -- 172.21.15.84:0/387690110 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbacc00a160 con 0x7fbad40a4250 2020-01-16T05:45:41.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad9876700 1 --2- 172.21.15.84:0/387690110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbad40a4250 0x7fbad4066880 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7fbad40a49f0 tx=0x7fbacc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:41.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad27fc700 1 -- 172.21.15.84:0/387690110 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbacc011ab0 con 0x7fbad40a4250 2020-01-16T05:45:41.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad9876700 1 --2- 172.21.15.84:0/387690110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbad40a4250 0x7fbad4066880 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7fbad40a49f0 tx=0x7fbacc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:41.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad3fff700 1 -- 172.21.15.84:0/387690110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbad40a4250 msgr2=0x7fbad4066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:41.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad27fc700 1 -- 172.21.15.84:0/387690110 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbacc00a740 con 0x7fbad40a4250 2020-01-16T05:45:41.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad3fff700 1 --2- 172.21.15.84:0/387690110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbad40a4250 0x7fbad4066880 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7fbad40a49f0 tx=0x7fbacc010170).stop 2020-01-16T05:45:41.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad3fff700 1 -- 172.21.15.84:0/387690110 shutdown_connections 2020-01-16T05:45:41.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad3fff700 1 --2- 172.21.15.84:0/387690110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbad40a4250 0x7fbad4066880 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:41.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad3fff700 1 --2- 172.21.15.84:0/387690110 >> v2:172.21.15.142:3300/0 conn(0x7fbad407ff10 0x7fbad40abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:41.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad3fff700 1 -- 172.21.15.84:0/387690110 shutdown_connections 2020-01-16T05:45:41.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad3fff700 1 -- 172.21.15.84:0/387690110 wait complete. 2020-01-16T05:45:41.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.072+0000 7fbad3fff700 1 -- 172.21.15.84:0/387690110 >> 172.21.15.84:0/387690110 conn(0x7fbad40acfc0 msgr2=0x7fbad40a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:41.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad3fff700 1 Processor -- start 2020-01-16T05:45:41.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad3fff700 1 -- start start 2020-01-16T05:45:41.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad3fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbad4124100 0x7fbad41381f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:41.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbad4138740 0x7fbad4134bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:41.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad3fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad4135570 con 0x7fbad4135140 2020-01-16T05:45:41.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad3fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad4137cb0 con 0x7fbad4138740 2020-01-16T05:45:41.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad3fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad4137f50 con 0x7fbad4124100 2020-01-16T05:45:41.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad2ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbad4138740 0x7fbad4134bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:41.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad2ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbad4138740 0x7fbad4134bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35260/0 (socket says 172.21.15.84:35260) 2020-01-16T05:45:41.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad2ffd700 1 -- 172.21.15.84:0/1980677121 learned_addr learned my addr 172.21.15.84:0/1980677121 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:45:41.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad37fe700 1 --2- 172.21.15.84:0/1980677121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbad4124100 0x7fbad41381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:41.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad2ffd700 1 -- 172.21.15.84:0/1980677121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbad4124100 msgr2=0x7fbad41381f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:41.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad2ffd700 1 --2- 172.21.15.84:0/1980677121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbad4124100 0x7fbad41381f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:41.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad2ffd700 1 -- 172.21.15.84:0/1980677121 >> v1:172.21.15.142:6789/0 conn(0x7fbad4135140 legacy=0x7fbad40a5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:41.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad2ffd700 1 -- 172.21.15.84:0/1980677121 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad4125ea0 con 0x7fbad4138740 2020-01-16T05:45:41.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad2ffd700 1 --2- 172.21.15.84:0/1980677121 >> v2:172.21.15.84:3300/0 conn(0x7fbad4138740 0x7fbad4134bf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbad4091e70 tx=0x7fbac8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:41.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad2ffd700 1 --2- 172.21.15.84:0/1980677121 >> v2:172.21.15.84:3300/0 conn(0x7fbad4138740 0x7fbad4134bf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbad4091e70 tx=0x7fbac8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:41.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad2ffd700 1 --2- 172.21.15.84:0/1980677121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbad4138740 0x7fbad4134bf0 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7fbad4091e70 tx=0x7fbac8010d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:41.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad2ffd700 1 --2- 172.21.15.84:0/1980677121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbad4138740 0x7fbad4134bf0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7fbad4091e70 tx=0x7fbac8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:41.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad2ffd700 1 --2- 172.21.15.84:0/1980677121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbad4138740 0x7fbad4134bf0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7fbad4091e70 tx=0x7fbac8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:41.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbabbfff700 1 -- 172.21.15.84:0/1980677121 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbac8007160 con 0x7fbad4138740 2020-01-16T05:45:41.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad2ffd700 1 --2- 172.21.15.84:0/1980677121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbad4138740 0x7fbad4134bf0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7fbad4091e70 tx=0x7fbac8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:41.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbabbfff700 1 -- 172.21.15.84:0/1980677121 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac8005ab0 con 0x7fbad4138740 2020-01-16T05:45:41.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad3fff700 1 -- 172.21.15.84:0/1980677121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad4134650 con 0x7fbad4138740 2020-01-16T05:45:41.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbabbfff700 1 -- 172.21.15.84:0/1980677121 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbac8012590 con 0x7fbad4138740 2020-01-16T05:45:41.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad3fff700 1 -- 172.21.15.84:0/1980677121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad4125a40 con 0x7fbad4138740 2020-01-16T05:45:41.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad2ffd700 1 --2- 172.21.15.84:0/1980677121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbad4138740 0x7fbad4134bf0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7fbad4091e70 tx=0x7fbac8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:41.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbabbfff700 1 -- 172.21.15.84:0/1980677121 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fbac8012860 con 0x7fbad4138740 2020-01-16T05:45:41.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad2ffd700 1 --2- 172.21.15.84:0/1980677121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbad4138740 0x7fbad4134bf0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7fbad4091e70 tx=0x7fbac8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:41.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad3fff700 1 -- 172.21.15.84:0/1980677121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad405e1c0 con 0x7fbad4138740 2020-01-16T05:45:41.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbabbfff700 1 --2- 172.21.15.84:0/1980677121 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fbab403c2a0 0x7fbab403e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:41.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbabbfff700 1 -- 172.21.15.84:0/1980677121 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fbac804d0e0 con 0x7fbad4138740 2020-01-16T05:45:41.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.076+0000 7fbad37fe700 1 --2- 172.21.15.84:0/1980677121 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fbab403c2a0 0x7fbab403e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:41.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.080+0000 7fbad37fe700 1 --2- 172.21.15.84:0/1980677121 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fbab403c2a0 0x7fbab403e7b0 crc :-1 s=READY pgs=117 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:41.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.080+0000 7fbad2ffd700 1 --2- 172.21.15.84:0/1980677121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbad4138740 0x7fbad4134bf0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7fbad4091e70 tx=0x7fbac8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:41.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.080+0000 7fbabbfff700 1 -- 172.21.15.84:0/1980677121 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fbac8033700 con 0x7fbad4138740 2020-01-16T05:45:41.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.220+0000 7fbad3fff700 1 -- 172.21.15.84:0/1980677121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbad405cbc0 con 0x7fbad4138740 2020-01-16T05:45:41.222 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.220+0000 7fbad2ffd700 1 --2- 172.21.15.84:0/1980677121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbad4138740 0x7fbad4134bf0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7fbad4091e70 tx=0x7fbac8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:41.222 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.220+0000 7fbabbfff700 1 -- 172.21.15.84:0/1980677121 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fbac8033960 con 0x7fbad4138740 2020-01-16T05:45:41.223 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:41.223 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:41.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.220+0000 7fbad3fff700 1 -- 172.21.15.84:0/1980677121 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fbab403c2a0 msgr2=0x7fbab403e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:41.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.220+0000 7fbad3fff700 1 --2- 172.21.15.84:0/1980677121 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fbab403c2a0 0x7fbab403e7b0 crc :-1 s=READY pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:41.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.220+0000 7fbad3fff700 1 -- 172.21.15.84:0/1980677121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbad4138740 msgr2=0x7fbad4134bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:41.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.220+0000 7fbad3fff700 1 --2- 172.21.15.84:0/1980677121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbad4138740 0x7fbad4134bf0 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7fbad4091e70 tx=0x7fbac8010d60).stop 2020-01-16T05:45:41.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.220+0000 7fbad3fff700 1 -- 172.21.15.84:0/1980677121 shutdown_connections 2020-01-16T05:45:41.225 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.220+0000 7fbad3fff700 1 --2- 172.21.15.84:0/1980677121 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fbab403c2a0 0x7fbab403e7b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:41.225 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.220+0000 7fbad3fff700 1 --2- 172.21.15.84:0/1980677121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbad4124100 0x7fbad41381f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:41.225 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.220+0000 7fbad3fff700 1 --2- 172.21.15.84:0/1980677121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbad4138740 0x7fbad4134bf0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:41.225 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.220+0000 7fbad3fff700 1 -- 172.21.15.84:0/1980677121 shutdown_connections 2020-01-16T05:45:41.225 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.220+0000 7fbad3fff700 1 -- 172.21.15.84:0/1980677121 wait complete. 2020-01-16T05:45:41.225 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:41.220+0000 7fbad3fff700 1 -- 172.21.15.84:0/1980677121 >> 172.21.15.84:0/1980677121 conn(0x7fbad40a4e50 msgr2=0x7fbad40a8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:45:41.236 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:45:43.237 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:43.339 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8fc94a700 1 Processor -- start 2020-01-16T05:45:43.339 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8fc94a700 1 -- start start 2020-01-16T05:45:43.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8fc94a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb8f80a4250 0x7fb8f80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:43.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8fc94a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f8066880 con 0x7fb8f807ff10 2020-01-16T05:45:43.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8fc94a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f8066ab0 con 0x7fb8f80a9b30 2020-01-16T05:45:43.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8fc94a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f80a4830 con 0x7fb8f80a4250 2020-01-16T05:45:43.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8ef7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb8f807ff10 0x7fb8f814dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52466/0 (socket says 172.21.15.84:52466) 2020-01-16T05:45:43.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8ef7fe700 1 -- 172.21.15.84:0/2148037378 learned_addr learned my addr 172.21.15.84:0/2148037378 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:43.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8fdbac700 1 --2- 172.21.15.84:0/2148037378 >> v2:172.21.15.142:3300/0 conn(0x7fb8f80a4250 0x7fb8f80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:43.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8f77fe700 1 -- 172.21.15.84:0/2148037378 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221911149 0 0) 0x7fb8f8066880 con 0x7fb8f807ff10 2020-01-16T05:45:43.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8f77fe700 1 -- 172.21.15.84:0/2148037378 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8e4003230 con 0x7fb8f807ff10 2020-01-16T05:45:43.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8f77fe700 1 -- 172.21.15.84:0/2148037378 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3993035223 0 0) 0x7fb8e4003230 con 0x7fb8f807ff10 2020-01-16T05:45:43.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8f77fe700 1 -- 172.21.15.84:0/2148037378 >> v2:172.21.15.142:3300/0 conn(0x7fb8f80a4250 msgr2=0x7fb8f80abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:43.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8f77fe700 1 --2- 172.21.15.84:0/2148037378 >> v2:172.21.15.142:3300/0 conn(0x7fb8f80a4250 0x7fb8f80abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:43.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8f77fe700 1 -- 172.21.15.84:0/2148037378 >> v1:172.21.15.142:6789/0 conn(0x7fb8f80a9b30 legacy=0x7fb8f80a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:43.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8f77fe700 1 -- 172.21.15.84:0/2148037378 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f8066ce0 con 0x7fb8f807ff10 2020-01-16T05:45:43.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8f77fe700 1 -- 172.21.15.84:0/2148037378 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7fb8e0001750 con 0x7fb8f807ff10 2020-01-16T05:45:43.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8f77fe700 1 -- 172.21.15.84:0/2148037378 >> v1:172.21.15.84:6789/0 conn(0x7fb8f807ff10 legacy=0x7fb8f814dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:43.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8f77fe700 1 --2- 172.21.15.84:0/2148037378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8e4003860 0x7fb8e4003cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:43.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8f77fe700 1 --2- 172.21.15.84:0/2148037378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e40045a0 0x7fb8e40049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:43.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8f77fe700 1 --2- 172.21.15.84:0/2148037378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8e4004f20 0x7fb8e400b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:43.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8f77fe700 1 -- 172.21.15.84:0/2148037378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80a4830 con 0x7fb8e4003860 2020-01-16T05:45:43.343 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.332+0000 7fb8f7fff700 1 --2- 172.21.15.84:0/2148037378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8e4003860 0x7fb8e4003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:43.343 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8f77fe700 1 -- 172.21.15.84:0/2148037378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e404fde0 con 0x7fb8e40045a0 2020-01-16T05:45:43.343 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8f77fe700 1 -- 172.21.15.84:0/2148037378 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e4050020 con 0x7fb8e4004f20 2020-01-16T05:45:43.343 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8fdbac700 1 --2- 172.21.15.84:0/2148037378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8e4004f20 0x7fb8e400b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:43.343 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8ef7fe700 1 --2- 172.21.15.84:0/2148037378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e40045a0 0x7fb8e40049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:43.343 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8f7fff700 1 -- 172.21.15.84:0/2148037378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8e4004f20 msgr2=0x7fb8e400b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:43.343 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8f7fff700 1 --2- 172.21.15.84:0/2148037378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8e4004f20 0x7fb8e400b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:43.343 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8f7fff700 1 -- 172.21.15.84:0/2148037378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e40045a0 msgr2=0x7fb8e40049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:43.344 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8f7fff700 1 --2- 172.21.15.84:0/2148037378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e40045a0 0x7fb8e40049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:43.344 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8f7fff700 1 -- 172.21.15.84:0/2148037378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e4050320 con 0x7fb8e4003860 2020-01-16T05:45:43.344 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8fdbac700 1 --2- 172.21.15.84:0/2148037378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8e4004f20 0x7fb8e400b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-01-16T05:45:43.344 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8ef7fe700 1 --2- 172.21.15.84:0/2148037378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e40045a0 0x7fb8e40049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-01-16T05:45:43.344 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8fdbac700 1 -- 172.21.15.84:0/2148037378 reap_dead start 2020-01-16T05:45:43.344 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8f7fff700 1 --2- 172.21.15.84:0/2148037378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8e4003860 0x7fb8e4003cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb8e8001000 tx=0x7fb8e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:43.344 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8f7fff700 1 --2- 172.21.15.84:0/2148037378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8e4003860 0x7fb8e4003cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb8e8001000 tx=0x7fb8e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:43.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8f7fff700 1 --2- 172.21.15.84:0/2148037378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8e4003860 0x7fb8e4003cd0 secure :-1 s=READY pgs=304 cs=0 l=1 rx=0x7fb8e8001000 tx=0x7fb8e800fe50).ready entity=mon.0 client_cookie=3146bbf270a02171 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:43.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8f7fff700 1 --2- 172.21.15.84:0/2148037378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8e4003860 0x7fb8e4003cd0 secure :-1 s=THROTTLE_DONE pgs=304 cs=0 l=1 rx=0x7fb8e8001000 tx=0x7fb8e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:43.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8f77fe700 1 -- 172.21.15.84:0/2148037378 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8e8003540 con 0x7fb8e4003860 2020-01-16T05:45:43.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8f7fff700 1 --2- 172.21.15.84:0/2148037378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8e4003860 0x7fb8e4003cd0 secure :-1 s=THROTTLE_DONE pgs=304 cs=0 l=1 rx=0x7fb8e8001000 tx=0x7fb8e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:43.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8f7fff700 1 --2- 172.21.15.84:0/2148037378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8e4003860 0x7fb8e4003cd0 secure :-1 s=THROTTLE_DONE pgs=304 cs=0 l=1 rx=0x7fb8e8001000 tx=0x7fb8e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:43.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8f77fe700 1 -- 172.21.15.84:0/2148037378 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e8003160 con 0x7fb8e4003860 2020-01-16T05:45:43.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8f77fe700 1 -- 172.21.15.84:0/2148037378 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8e8003b20 con 0x7fb8e4003860 2020-01-16T05:45:43.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8fc94a700 1 -- 172.21.15.84:0/2148037378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8e4003860 msgr2=0x7fb8e4003cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:43.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8fc94a700 1 --2- 172.21.15.84:0/2148037378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8e4003860 0x7fb8e4003cd0 secure :-1 s=READY pgs=304 cs=0 l=1 rx=0x7fb8e8001000 tx=0x7fb8e800fe50).stop 2020-01-16T05:45:43.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8fc94a700 1 -- 172.21.15.84:0/2148037378 shutdown_connections 2020-01-16T05:45:43.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8fc94a700 1 --2- 172.21.15.84:0/2148037378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8e4003860 0x7fb8e4003cd0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:43.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8fc94a700 1 -- 172.21.15.84:0/2148037378 shutdown_connections 2020-01-16T05:45:43.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8fc94a700 1 -- 172.21.15.84:0/2148037378 wait complete. 2020-01-16T05:45:43.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8fc94a700 1 -- 172.21.15.84:0/2148037378 >> 172.21.15.84:0/2148037378 conn(0x7fb8f80acfc0 msgr2=0x7fb8f80a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:43.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8fc94a700 1 Processor -- start 2020-01-16T05:45:43.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.336+0000 7fb8fc94a700 1 -- start start 2020-01-16T05:45:43.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8fc94a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb8f80a5640 0x7fb8f807aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:43.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8fc94a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8f809f3d0 0x7fb8f809f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:43.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8fc94a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f807a750 con 0x7fb8f8135ea0 2020-01-16T05:45:43.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8fc94a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f80a70c0 con 0x7fb8f80a5640 2020-01-16T05:45:43.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8fc94a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f807bdd0 con 0x7fb8f809f3d0 2020-01-16T05:45:43.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8f7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb8f80a5640 0x7fb8f807aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:43.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8ef7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8f809f3d0 0x7fb8f809f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:43.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8fdbac700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb8f8135ea0 0x7fb8f81362d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:50706/0 (socket says 172.21.15.84:50706) 2020-01-16T05:45:43.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8ef7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8f809f3d0 0x7fb8f809f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:47522/0 (socket says 172.21.15.84:47522) 2020-01-16T05:45:43.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8f7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb8f80a5640 0x7fb8f807aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.84:45260/0 (socket says 172.21.15.84:45260) 2020-01-16T05:45:43.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8fdbac700 1 -- 172.21.15.84:0/1244367427 learned_addr learned my addr 172.21.15.84:0/1244367427 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:43.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8ef7fe700 1 -- 172.21.15.84:0/1244367427 >> v2:172.21.15.142:3300/0 conn(0x7fb8f80a5640 msgr2=0x7fb8f807aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8ef7fe700 1 --2- 172.21.15.84:0/1244367427 >> v2:172.21.15.142:3300/0 conn(0x7fb8f80a5640 0x7fb8f807aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8ef7fe700 1 -- 172.21.15.84:0/1244367427 >> v1:172.21.15.142:6789/0 conn(0x7fb8f8135ea0 legacy=0x7fb8f81362d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8ef7fe700 1 -- 172.21.15.84:0/1244367427 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f807c500 con 0x7fb8f809f3d0 2020-01-16T05:45:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8f7fff700 1 --2- 172.21.15.84:0/1244367427 >> v2:172.21.15.142:3300/0 conn(0x7fb8f80a5640 0x7fb8f807aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:45:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8ef7fe700 1 --2- 172.21.15.84:0/1244367427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8f809f3d0 0x7fb8f809f800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb8f8092550 tx=0x7fb8e0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8ef7fe700 1 --2- 172.21.15.84:0/1244367427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8f809f3d0 0x7fb8f809f800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb8f8092550 tx=0x7fb8e0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8ef7fe700 1 --2- 172.21.15.84:0/1244367427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8f809f3d0 0x7fb8f809f800 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7fb8f8092550 tx=0x7fb8e0010aa0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:43.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8ef7fe700 1 --2- 172.21.15.84:0/1244367427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8f809f3d0 0x7fb8f809f800 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fb8f8092550 tx=0x7fb8e0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:43.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8f57fa700 1 -- 172.21.15.84:0/1244367427 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8e000cc30 con 0x7fb8f809f3d0 2020-01-16T05:45:43.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8fc94a700 1 -- 172.21.15.84:0/1244367427 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f813d290 con 0x7fb8f809f3d0 2020-01-16T05:45:43.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8ef7fe700 1 --2- 172.21.15.84:0/1244367427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8f809f3d0 0x7fb8f809f800 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fb8f8092550 tx=0x7fb8e0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:43.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8f57fa700 1 -- 172.21.15.84:0/1244367427 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e000c850 con 0x7fb8f809f3d0 2020-01-16T05:45:43.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8ef7fe700 1 --2- 172.21.15.84:0/1244367427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8f809f3d0 0x7fb8f809f800 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fb8f8092550 tx=0x7fb8e0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:43.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8f57fa700 1 -- 172.21.15.84:0/1244367427 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8e00048d0 con 0x7fb8f809f3d0 2020-01-16T05:45:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8fc94a700 1 -- 172.21.15.84:0/1244367427 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f813d4a0 con 0x7fb8f809f3d0 2020-01-16T05:45:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8fc94a700 1 -- 172.21.15.84:0/1244367427 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f805e1c0 con 0x7fb8f809f3d0 2020-01-16T05:45:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8ef7fe700 1 --2- 172.21.15.84:0/1244367427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8f809f3d0 0x7fb8f809f800 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fb8f8092550 tx=0x7fb8e0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8f57fa700 1 -- 172.21.15.84:0/1244367427 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fb8e0004bf0 con 0x7fb8f809f3d0 2020-01-16T05:45:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8ef7fe700 1 --2- 172.21.15.84:0/1244367427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8f809f3d0 0x7fb8f809f800 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fb8f8092550 tx=0x7fb8e0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8f57fa700 1 --2- 172.21.15.84:0/1244367427 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb8dc03c240 0x7fb8dc03e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8f57fa700 1 -- 172.21.15.84:0/1244367427 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fb8e004c560 con 0x7fb8f809f3d0 2020-01-16T05:45:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.340+0000 7fb8f7fff700 1 --2- 172.21.15.84:0/1244367427 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb8dc03c240 0x7fb8dc03e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:43.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.344+0000 7fb8f7fff700 1 --2- 172.21.15.84:0/1244367427 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb8dc03c240 0x7fb8dc03e750 crc :-1 s=READY pgs=118 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:43.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.348+0000 7fb8ef7fe700 1 --2- 172.21.15.84:0/1244367427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8f809f3d0 0x7fb8f809f800 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fb8f8092550 tx=0x7fb8e0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:43.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.348+0000 7fb8f57fa700 1 -- 172.21.15.84:0/1244367427 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fb8e0034450 con 0x7fb8f809f3d0 2020-01-16T05:45:43.494 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.492+0000 7fb8fc94a700 1 -- 172.21.15.84:0/1244367427 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8f80ad1d0 con 0x7fb8f809f3d0 2020-01-16T05:45:43.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.492+0000 7fb8ef7fe700 1 --2- 172.21.15.84:0/1244367427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8f809f3d0 0x7fb8f809f800 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fb8f8092550 tx=0x7fb8e0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:43.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.492+0000 7fb8f57fa700 1 -- 172.21.15.84:0/1244367427 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fb8e0033990 con 0x7fb8f809f3d0 2020-01-16T05:45:43.496 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:43.496 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:43.497 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.496+0000 7fb8fc94a700 1 -- 172.21.15.84:0/1244367427 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb8dc03c240 msgr2=0x7fb8dc03e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:43.497 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.496+0000 7fb8fc94a700 1 --2- 172.21.15.84:0/1244367427 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb8dc03c240 0x7fb8dc03e750 crc :-1 s=READY pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:43.497 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.496+0000 7fb8fc94a700 1 -- 172.21.15.84:0/1244367427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8f809f3d0 msgr2=0x7fb8f809f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:43.497 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.496+0000 7fb8fc94a700 1 --2- 172.21.15.84:0/1244367427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8f809f3d0 0x7fb8f809f800 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7fb8f8092550 tx=0x7fb8e0010aa0).stop 2020-01-16T05:45:43.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.496+0000 7fb8fc94a700 1 -- 172.21.15.84:0/1244367427 shutdown_connections 2020-01-16T05:45:43.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.496+0000 7fb8fc94a700 1 --2- 172.21.15.84:0/1244367427 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb8dc03c240 0x7fb8dc03e750 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:43.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.496+0000 7fb8fc94a700 1 --2- 172.21.15.84:0/1244367427 >> v2:172.21.15.142:3300/0 conn(0x7fb8f80a5640 0x7fb8f807aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:43.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.496+0000 7fb8fc94a700 1 --2- 172.21.15.84:0/1244367427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8f809f3d0 0x7fb8f809f800 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:43.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.496+0000 7fb8fc94a700 1 -- 172.21.15.84:0/1244367427 shutdown_connections 2020-01-16T05:45:43.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.496+0000 7fb8fc94a700 1 -- 172.21.15.84:0/1244367427 wait complete. 2020-01-16T05:45:43.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:43.496+0000 7fb8fc94a700 1 -- 172.21.15.84:0/1244367427 >> 172.21.15.84:0/1244367427 conn(0x7fb8f80a4bb0 msgr2=0x7fb8f8126f20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:43.499 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:45:43.509 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:45:43.734 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~77s 2020-01-16T05:45:44.001 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:45:44.004 INFO:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:45:45.510 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:45.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd41520700 1 Processor -- start 2020-01-16T05:45:45.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd41520700 1 -- start start 2020-01-16T05:45:45.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd41520700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd3c0a9b30 0x7fcd3c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:45.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd41520700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcd3c0a4250 0x7fcd3c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:45.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd41520700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3c066dd0 con 0x7fcd3c07ff10 2020-01-16T05:45:45.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd41520700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd3c0a4830 con 0x7fcd3c0a4250 2020-01-16T05:45:45.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd41520700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c07f9d0 con 0x7fcd3c0a9b30 2020-01-16T05:45:45.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd42782700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcd3c0a4250 0x7fcd3c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:45.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd33fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcd3c07ff10 0x7fcd3c0a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52484/0 (socket says 172.21.15.84:52484) 2020-01-16T05:45:45.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd42782700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcd3c0a4250 0x7fcd3c066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35288/0 (socket says 172.21.15.84:35288) 2020-01-16T05:45:45.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd33fff700 1 -- 172.21.15.84:0/3291309916 learned_addr learned my addr 172.21.15.84:0/3291309916 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:45.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd40d1f700 1 --2- 172.21.15.84:0/3291309916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd3c0a9b30 0x7fcd3c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:45.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd42782700 1 -- 172.21.15.84:0/3291309916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd3c0a9b30 msgr2=0x7fcd3c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:45.639 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd42782700 1 --2- 172.21.15.84:0/3291309916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd3c0a9b30 0x7fcd3c0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:45.639 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd42782700 1 -- 172.21.15.84:0/3291309916 >> v1:172.21.15.84:6789/0 conn(0x7fcd3c07ff10 legacy=0x7fcd3c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:45.639 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd42782700 1 -- 172.21.15.84:0/3291309916 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c150ce0 con 0x7fcd3c0a4250 2020-01-16T05:45:45.639 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd337fe700 1 -- 172.21.15.84:0/3291309916 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800782061 0 0) 0x7fcd3c066dd0 con 0x7fcd3c07ff10 2020-01-16T05:45:45.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd42782700 1 --2- 172.21.15.84:0/3291309916 >> v2:172.21.15.84:3300/0 conn(0x7fcd3c0a4250 0x7fcd3c066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcd34008c90 tx=0x7fcd34010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:45.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd42782700 1 --2- 172.21.15.84:0/3291309916 >> v2:172.21.15.84:3300/0 conn(0x7fcd3c0a4250 0x7fcd3c066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcd34008c90 tx=0x7fcd34010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:45.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd42782700 1 --2- 172.21.15.84:0/3291309916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c0a4250 0x7fcd3c066880 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7fcd34008c90 tx=0x7fcd34010170).ready entity=mon.0 client_cookie=d28ce1b0f43a38a0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:45.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd42782700 1 --2- 172.21.15.84:0/3291309916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c0a4250 0x7fcd3c066880 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7fcd34008c90 tx=0x7fcd34010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:45.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd337fe700 1 -- 172.21.15.84:0/3291309916 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd3400a160 con 0x7fcd3c0a4250 2020-01-16T05:45:45.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd42782700 1 --2- 172.21.15.84:0/3291309916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c0a4250 0x7fcd3c066880 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7fcd34008c90 tx=0x7fcd34010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:45.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd337fe700 1 -- 172.21.15.84:0/3291309916 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd34011af0 con 0x7fcd3c0a4250 2020-01-16T05:45:45.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd42782700 1 --2- 172.21.15.84:0/3291309916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c0a4250 0x7fcd3c066880 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7fcd34008c90 tx=0x7fcd34010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:45.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd41520700 1 -- 172.21.15.84:0/3291309916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c0a4250 msgr2=0x7fcd3c066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:45.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd337fe700 1 -- 172.21.15.84:0/3291309916 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd3400a740 con 0x7fcd3c0a4250 2020-01-16T05:45:45.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd41520700 1 --2- 172.21.15.84:0/3291309916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c0a4250 0x7fcd3c066880 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7fcd34008c90 tx=0x7fcd34010170).stop 2020-01-16T05:45:45.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd41520700 1 -- 172.21.15.84:0/3291309916 shutdown_connections 2020-01-16T05:45:45.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.624+0000 7fcd41520700 1 --2- 172.21.15.84:0/3291309916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c0a4250 0x7fcd3c066880 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:45.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd41520700 1 --2- 172.21.15.84:0/3291309916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd3c0a9b30 0x7fcd3c0abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:45.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd41520700 1 -- 172.21.15.84:0/3291309916 shutdown_connections 2020-01-16T05:45:45.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd41520700 1 -- 172.21.15.84:0/3291309916 wait complete. 2020-01-16T05:45:45.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd41520700 1 -- 172.21.15.84:0/3291309916 >> 172.21.15.84:0/3291309916 conn(0x7fcd3c0acfc0 msgr2=0x7fcd3c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:45.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd41520700 1 Processor -- start 2020-01-16T05:45:45.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd41520700 1 -- start start 2020-01-16T05:45:45.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd41520700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd3c05bef0 0x7fcd3c0a7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:45.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd41520700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcd3c0a87e0 0x7fcd3c07c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:45.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd41520700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3c07d1b0 con 0x7fcd3c07cd80 2020-01-16T05:45:45.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd41520700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd3c0a8e60 con 0x7fcd3c0a87e0 2020-01-16T05:45:45.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd41520700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c0a9100 con 0x7fcd3c05bef0 2020-01-16T05:45:45.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd33fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcd3c0a87e0 0x7fcd3c07c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:45.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd33fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcd3c0a87e0 0x7fcd3c07c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35294/0 (socket says 172.21.15.84:35294) 2020-01-16T05:45:45.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd33fff700 1 -- 172.21.15.84:0/453611267 learned_addr learned my addr 172.21.15.84:0/453611267 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:45:45.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd40d1f700 1 --2- 172.21.15.84:0/453611267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd3c05bef0 0x7fcd3c0a7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:45.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd33fff700 1 -- 172.21.15.84:0/453611267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd3c05bef0 msgr2=0x7fcd3c0a7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:45.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd33fff700 1 --2- 172.21.15.84:0/453611267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd3c05bef0 0x7fcd3c0a7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:45.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd33fff700 1 -- 172.21.15.84:0/453611267 >> v1:172.21.15.142:6789/0 conn(0x7fcd3c07cd80 legacy=0x7fcd3c137cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:45.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd33fff700 1 -- 172.21.15.84:0/453611267 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c0ab090 con 0x7fcd3c0a87e0 2020-01-16T05:45:45.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd33fff700 1 --2- 172.21.15.84:0/453611267 >> v2:172.21.15.84:3300/0 conn(0x7fcd3c0a87e0 0x7fcd3c07c830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcd3c0a9020 tx=0x7fcd2c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:45.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd33fff700 1 --2- 172.21.15.84:0/453611267 >> v2:172.21.15.84:3300/0 conn(0x7fcd3c0a87e0 0x7fcd3c07c830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcd3c0a9020 tx=0x7fcd2c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:45.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd33fff700 1 --2- 172.21.15.84:0/453611267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c0a87e0 0x7fcd3c07c830 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7fcd3c0a9020 tx=0x7fcd2c010af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:45.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd33fff700 1 --2- 172.21.15.84:0/453611267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c0a87e0 0x7fcd3c07c830 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7fcd3c0a9020 tx=0x7fcd2c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:45.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd33fff700 1 --2- 172.21.15.84:0/453611267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c0a87e0 0x7fcd3c07c830 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7fcd3c0a9020 tx=0x7fcd2c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:45.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd317fa700 1 -- 172.21.15.84:0/453611267 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd2c004990 con 0x7fcd3c0a87e0 2020-01-16T05:45:45.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd33fff700 1 --2- 172.21.15.84:0/453611267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c0a87e0 0x7fcd3c07c830 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7fcd3c0a9020 tx=0x7fcd2c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:45.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd317fa700 1 -- 172.21.15.84:0/453611267 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c0045b0 con 0x7fcd3c0a87e0 2020-01-16T05:45:45.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd41520700 1 -- 172.21.15.84:0/453611267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3c0a9550 con 0x7fcd3c0a87e0 2020-01-16T05:45:45.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd317fa700 1 -- 172.21.15.84:0/453611267 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd2c012470 con 0x7fcd3c0a87e0 2020-01-16T05:45:45.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.628+0000 7fcd41520700 1 -- 172.21.15.84:0/453611267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3c1384b0 con 0x7fcd3c0a87e0 2020-01-16T05:45:45.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.632+0000 7fcd33fff700 1 --2- 172.21.15.84:0/453611267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c0a87e0 0x7fcd3c07c830 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7fcd3c0a9020 tx=0x7fcd2c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:45.649 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.632+0000 7fcd317fa700 1 -- 172.21.15.84:0/453611267 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fcd2c012780 con 0x7fcd3c0a87e0 2020-01-16T05:45:45.649 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.632+0000 7fcd33fff700 1 --2- 172.21.15.84:0/453611267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c0a87e0 0x7fcd3c07c830 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7fcd3c0a9020 tx=0x7fcd2c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:45.649 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.632+0000 7fcd317fa700 1 --2- 172.21.15.84:0/453611267 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fcd1c03c270 0x7fcd1c03e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:45.649 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.632+0000 7fcd317fa700 1 -- 172.21.15.84:0/453611267 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fcd2c04c9e0 con 0x7fcd3c0a87e0 2020-01-16T05:45:45.649 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.632+0000 7fcd40d1f700 1 --2- 172.21.15.84:0/453611267 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fcd1c03c270 0x7fcd1c03e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:45.649 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.632+0000 7fcd40d1f700 1 --2- 172.21.15.84:0/453611267 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fcd1c03c270 0x7fcd1c03e780 crc :-1 s=READY pgs=119 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:45.650 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.636+0000 7fcd41520700 1 -- 172.21.15.84:0/453611267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3c05e1c0 con 0x7fcd3c0a87e0 2020-01-16T05:45:45.650 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.640+0000 7fcd33fff700 1 --2- 172.21.15.84:0/453611267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c0a87e0 0x7fcd3c07c830 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7fcd3c0a9020 tx=0x7fcd2c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:45.650 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.640+0000 7fcd317fa700 1 -- 172.21.15.84:0/453611267 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fcd2c0300c0 con 0x7fcd3c0a87e0 2020-01-16T05:45:45.789 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.788+0000 7fcd41520700 1 -- 172.21.15.84:0/453611267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd3c05cbc0 con 0x7fcd3c0a87e0 2020-01-16T05:45:45.790 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.788+0000 7fcd33fff700 1 --2- 172.21.15.84:0/453611267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c0a87e0 0x7fcd3c07c830 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7fcd3c0a9020 tx=0x7fcd2c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:45.790 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.788+0000 7fcd317fa700 1 -- 172.21.15.84:0/453611267 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fcd2c033000 con 0x7fcd3c0a87e0 2020-01-16T05:45:45.790 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:45.790 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:45.791 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.788+0000 7fcd41520700 1 -- 172.21.15.84:0/453611267 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fcd1c03c270 msgr2=0x7fcd1c03e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:45.791 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.788+0000 7fcd41520700 1 --2- 172.21.15.84:0/453611267 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fcd1c03c270 0x7fcd1c03e780 crc :-1 s=READY pgs=119 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:45.792 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.788+0000 7fcd41520700 1 -- 172.21.15.84:0/453611267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c0a87e0 msgr2=0x7fcd3c07c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:45.792 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.788+0000 7fcd41520700 1 --2- 172.21.15.84:0/453611267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c0a87e0 0x7fcd3c07c830 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7fcd3c0a9020 tx=0x7fcd2c010af0).stop 2020-01-16T05:45:45.792 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.788+0000 7fcd41520700 1 -- 172.21.15.84:0/453611267 shutdown_connections 2020-01-16T05:45:45.792 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.788+0000 7fcd41520700 1 --2- 172.21.15.84:0/453611267 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fcd1c03c270 0x7fcd1c03e780 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:45.792 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.788+0000 7fcd41520700 1 --2- 172.21.15.84:0/453611267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd3c05bef0 0x7fcd3c0a7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:45.792 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.788+0000 7fcd41520700 1 --2- 172.21.15.84:0/453611267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c0a87e0 0x7fcd3c07c830 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:45.792 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.788+0000 7fcd41520700 1 -- 172.21.15.84:0/453611267 shutdown_connections 2020-01-16T05:45:45.793 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.788+0000 7fcd41520700 1 -- 172.21.15.84:0/453611267 wait complete. 2020-01-16T05:45:45.793 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:45.788+0000 7fcd41520700 1 -- 172.21.15.84:0/453611267 >> 172.21.15.84:0/453611267 conn(0x7fcd3c0a3db0 msgr2=0x7fcd3c0246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:45.793 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:45:45.801 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:45:47.803 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:47.901 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1b3bd700 1 Processor -- start 2020-01-16T05:45:47.901 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1b3bd700 1 -- start start 2020-01-16T05:45:47.901 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1b3bd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3c1407ff10 0x7f3c140abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:47.901 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1b3bd700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c14066880 con 0x7f3c140a9b30 2020-01-16T05:45:47.901 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1b3bd700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c14066ab0 con 0x7f3c140a4250 2020-01-16T05:45:47.902 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1b3bd700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c140a4830 con 0x7f3c1407ff10 2020-01-16T05:45:47.902 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1a3bb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3c1407ff10 0x7f3c140abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:47.902 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1abbc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3c140a9b30 0x7f3c140a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52500/0 (socket says 172.21.15.84:52500) 2020-01-16T05:45:47.902 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1a3bb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3c1407ff10 0x7f3c140abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35302/0 (socket says 172.21.15.84:35302) 2020-01-16T05:45:47.902 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1abbc700 1 -- 172.21.15.84:0/3502172966 learned_addr learned my addr 172.21.15.84:0/3502172966 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:47.903 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1a3bb700 1 -- 172.21.15.84:0/3502172966 >> v1:172.21.15.142:6789/0 conn(0x7f3c140a4250 legacy=0x7f3c1414fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:47.903 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1a3bb700 1 -- 172.21.15.84:0/3502172966 >> v1:172.21.15.84:6789/0 conn(0x7f3c140a9b30 legacy=0x7f3c140a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:47.903 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1a3bb700 1 -- 172.21.15.84:0/3502172966 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c14066ce0 con 0x7f3c1407ff10 2020-01-16T05:45:47.903 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c19bba700 1 -- 172.21.15.84:0/3502172966 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193350874 0 0) 0x7f3c14066880 con 0x7f3c140a9b30 2020-01-16T05:45:47.903 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1a3bb700 1 --2- 172.21.15.84:0/3502172966 >> v2:172.21.15.84:3300/0 conn(0x7f3c1407ff10 0x7f3c140abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3c04008910 tx=0x7f3c0400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:47.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1a3bb700 1 --2- 172.21.15.84:0/3502172966 >> v2:172.21.15.84:3300/0 conn(0x7f3c1407ff10 0x7f3c140abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3c04008910 tx=0x7f3c0400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:47.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1a3bb700 1 --2- 172.21.15.84:0/3502172966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1407ff10 0x7f3c140abdd0 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7f3c04008910 tx=0x7f3c0400fd70).ready entity=mon.0 client_cookie=42ec72bcd710eb3b server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:47.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1a3bb700 1 --2- 172.21.15.84:0/3502172966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1407ff10 0x7f3c140abdd0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f3c04008910 tx=0x7f3c0400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:47.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c19bba700 1 -- 172.21.15.84:0/3502172966 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c040115e0 con 0x7f3c1407ff10 2020-01-16T05:45:47.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1a3bb700 1 --2- 172.21.15.84:0/3502172966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1407ff10 0x7f3c140abdd0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f3c04008910 tx=0x7f3c0400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:47.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1a3bb700 1 --2- 172.21.15.84:0/3502172966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1407ff10 0x7f3c140abdd0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f3c04008910 tx=0x7f3c0400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:47.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c19bba700 1 -- 172.21.15.84:0/3502172966 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c04008d40 con 0x7f3c1407ff10 2020-01-16T05:45:47.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c19bba700 1 -- 172.21.15.84:0/3502172966 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c04011bc0 con 0x7f3c1407ff10 2020-01-16T05:45:47.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1b3bd700 1 -- 172.21.15.84:0/3502172966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1407ff10 msgr2=0x7f3c140abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:47.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1b3bd700 1 --2- 172.21.15.84:0/3502172966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1407ff10 0x7f3c140abdd0 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7f3c04008910 tx=0x7f3c0400fd70).stop 2020-01-16T05:45:47.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1b3bd700 1 -- 172.21.15.84:0/3502172966 shutdown_connections 2020-01-16T05:45:47.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1b3bd700 1 --2- 172.21.15.84:0/3502172966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1407ff10 0x7f3c140abdd0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:47.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1b3bd700 1 -- 172.21.15.84:0/3502172966 shutdown_connections 2020-01-16T05:45:47.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1b3bd700 1 -- 172.21.15.84:0/3502172966 wait complete. 2020-01-16T05:45:47.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.896+0000 7f3c1b3bd700 1 -- 172.21.15.84:0/3502172966 >> 172.21.15.84:0/3502172966 conn(0x7f3c140acfc0 msgr2=0x7f3c140a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:47.910 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1b3bd700 1 Processor -- start 2020-01-16T05:45:47.911 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1b3bd700 1 -- start start 2020-01-16T05:45:47.911 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1b3bd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3c140a8aa0 0x7f3c1407c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:47.911 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1b3bd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c1407ce70 0x7f3c1413f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:47.911 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1b3bd700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c141381f0 con 0x7f3c1409f160 2020-01-16T05:45:47.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1b3bd700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c1407d2a0 con 0x7f3c140a8aa0 2020-01-16T05:45:47.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1b3bd700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c140a87d0 con 0x7f3c1407ce70 2020-01-16T05:45:47.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1a3bb700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3c140a8aa0 0x7f3c1407c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:47.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1c61f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c1407ce70 0x7f3c1413f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:47.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1a3bb700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3c140a8aa0 0x7f3c1407c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.84:45292/0 (socket says 172.21.15.84:45292) 2020-01-16T05:45:47.913 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1a3bb700 1 -- 172.21.15.84:0/3916007765 learned_addr learned my addr 172.21.15.84:0/3916007765 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:45:47.913 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1a3bb700 1 -- 172.21.15.84:0/3916007765 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c1407ce70 msgr2=0x7f3c1413f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:47.913 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1a3bb700 1 --2- 172.21.15.84:0/3916007765 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c1407ce70 0x7f3c1413f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:47.913 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1a3bb700 1 -- 172.21.15.84:0/3916007765 >> v1:172.21.15.142:6789/0 conn(0x7f3c1409f160 legacy=0x7f3c141389b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:47.913 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1a3bb700 1 -- 172.21.15.84:0/3916007765 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c140a8ed0 con 0x7f3c140a8aa0 2020-01-16T05:45:47.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1a3bb700 1 --2- 172.21.15.84:0/3916007765 >> v2:172.21.15.142:3300/0 conn(0x7f3c140a8aa0 0x7f3c1407c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c04008910 tx=0x7f3c040116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:47.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1a3bb700 1 --2- 172.21.15.84:0/3916007765 >> v2:172.21.15.142:3300/0 conn(0x7f3c140a8aa0 0x7f3c1407c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c04008910 tx=0x7f3c040116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:47.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1a3bb700 1 --2- 172.21.15.84:0/3916007765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c140a8aa0 0x7f3c1407c920 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7f3c04008910 tx=0x7f3c040116a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:47.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.900+0000 7f3c1a3bb700 1 --2- 172.21.15.84:0/3916007765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c140a8aa0 0x7f3c1407c920 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f3c04008910 tx=0x7f3c040116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:47.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.904+0000 7f3c0b7fe700 1 -- 172.21.15.84:0/3916007765 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c0400f780 con 0x7f3c140a8aa0 2020-01-16T05:45:47.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.904+0000 7f3c1a3bb700 1 --2- 172.21.15.84:0/3916007765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c140a8aa0 0x7f3c1407c920 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f3c04008910 tx=0x7f3c040116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:47.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.904+0000 7f3c1a3bb700 1 --2- 172.21.15.84:0/3916007765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c140a8aa0 0x7f3c1407c920 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f3c04008910 tx=0x7f3c040116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:47.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.904+0000 7f3c0b7fe700 1 -- 172.21.15.84:0/3916007765 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c040117e0 con 0x7f3c140a8aa0 2020-01-16T05:45:47.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.904+0000 7f3c0b7fe700 1 -- 172.21.15.84:0/3916007765 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c040056c0 con 0x7f3c140a8aa0 2020-01-16T05:45:47.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.904+0000 7f3c1b3bd700 1 -- 172.21.15.84:0/3916007765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1413fb30 con 0x7f3c140a8aa0 2020-01-16T05:45:47.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.904+0000 7f3c1b3bd700 1 -- 172.21.15.84:0/3916007765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1413fd40 con 0x7f3c140a8aa0 2020-01-16T05:45:47.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.904+0000 7f3c1a3bb700 1 --2- 172.21.15.84:0/3916007765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c140a8aa0 0x7f3c1407c920 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f3c04008910 tx=0x7f3c040116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:47.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.904+0000 7f3c0b7fe700 1 -- 172.21.15.84:0/3916007765 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f3c04005960 con 0x7f3c140a8aa0 2020-01-16T05:45:47.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.904+0000 7f3c1a3bb700 1 --2- 172.21.15.84:0/3916007765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c140a8aa0 0x7f3c1407c920 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f3c04008910 tx=0x7f3c040116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:47.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.904+0000 7f3c1b3bd700 1 -- 172.21.15.84:0/3916007765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf0003360 con 0x7f3c140a8aa0 2020-01-16T05:45:47.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.904+0000 7f3c0b7fe700 1 --2- 172.21.15.84:0/3916007765 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3bfc03c2b0 0x7f3bfc03e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:47.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.904+0000 7f3c0b7fe700 1 -- 172.21.15.84:0/3916007765 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f3c0404ced0 con 0x7f3c140a8aa0 2020-01-16T05:45:47.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.904+0000 7f3c1abbc700 1 --2- 172.21.15.84:0/3916007765 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3bfc03c2b0 0x7f3bfc03e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:47.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.904+0000 7f3c1abbc700 1 --2- 172.21.15.84:0/3916007765 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3bfc03c2b0 0x7f3bfc03e7c0 crc :-1 s=READY pgs=122 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:47.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.912+0000 7f3c1a3bb700 1 --2- 172.21.15.84:0/3916007765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c140a8aa0 0x7f3c1407c920 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f3c04008910 tx=0x7f3c040116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:47.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:47.912+0000 7f3c0b7fe700 1 -- 172.21.15.84:0/3916007765 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f3c040334d0 con 0x7f3c140a8aa0 2020-01-16T05:45:48.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:48.084+0000 7f3c1b3bd700 1 -- 172.21.15.84:0/3916007765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bf0003790 con 0x7f3c140a8aa0 2020-01-16T05:45:48.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:48.084+0000 7f3c1a3bb700 1 --2- 172.21.15.84:0/3916007765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c140a8aa0 0x7f3c1407c920 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f3c04008910 tx=0x7f3c040116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:48.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:48.084+0000 7f3c0b7fe700 1 -- 172.21.15.84:0/3916007765 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f3c04033730 con 0x7f3c140a8aa0 2020-01-16T05:45:48.087 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:48.087 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:48.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:48.088+0000 7f3c1b3bd700 1 -- 172.21.15.84:0/3916007765 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3bfc03c2b0 msgr2=0x7f3bfc03e7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:48.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:48.088+0000 7f3c1b3bd700 1 --2- 172.21.15.84:0/3916007765 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3bfc03c2b0 0x7f3bfc03e7c0 crc :-1 s=READY pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:48.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:48.088+0000 7f3c1b3bd700 1 -- 172.21.15.84:0/3916007765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c140a8aa0 msgr2=0x7f3c1407c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:48.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:48.088+0000 7f3c1b3bd700 1 --2- 172.21.15.84:0/3916007765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c140a8aa0 0x7f3c1407c920 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7f3c04008910 tx=0x7f3c040116a0).stop 2020-01-16T05:45:48.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:48.088+0000 7f3c1b3bd700 1 -- 172.21.15.84:0/3916007765 shutdown_connections 2020-01-16T05:45:48.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:48.088+0000 7f3c1b3bd700 1 --2- 172.21.15.84:0/3916007765 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c1407ce70 0x7f3c1413f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:48.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:48.088+0000 7f3c1b3bd700 1 --2- 172.21.15.84:0/3916007765 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3bfc03c2b0 0x7f3bfc03e7c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:48.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:48.088+0000 7f3c1b3bd700 1 --2- 172.21.15.84:0/3916007765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c140a8aa0 0x7f3c1407c920 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:48.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:48.088+0000 7f3c1b3bd700 1 -- 172.21.15.84:0/3916007765 shutdown_connections 2020-01-16T05:45:48.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:48.088+0000 7f3c1b3bd700 1 -- 172.21.15.84:0/3916007765 wait complete. 2020-01-16T05:45:48.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:48.088+0000 7f3c1b3bd700 1 -- 172.21.15.84:0/3916007765 >> 172.21.15.84:0/3916007765 conn(0x7f3c140a4e50 msgr2=0x7f3c140246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:48.090 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:45:48.098 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:45:50.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~83s 2020-01-16T05:45:50.099 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:50.195 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe271339700 1 Processor -- start 2020-01-16T05:45:50.195 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe271339700 1 -- start start 2020-01-16T05:45:50.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe271339700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c07ff10 0x7fe26c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:50.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe271339700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe26c0a4250 0x7fe26c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:50.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe271339700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26c066dd0 con 0x7fe26c0a9b30 2020-01-16T05:45:50.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe271339700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26c0a4830 con 0x7fe26c0a4250 2020-01-16T05:45:50.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe271339700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c07f9d0 con 0x7fe26c07ff10 2020-01-16T05:45:50.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe27259b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe26c0a4250 0x7fe26c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:50.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe270b38700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe26c0a9b30 0x7fe26c0a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52514/0 (socket says 172.21.15.84:52514) 2020-01-16T05:45:50.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe27259b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe26c0a4250 0x7fe26c066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35318/0 (socket says 172.21.15.84:35318) 2020-01-16T05:45:50.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe270b38700 1 -- 172.21.15.84:0/1160038322 learned_addr learned my addr 172.21.15.84:0/1160038322 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:50.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe26bfff700 1 --2- 172.21.15.84:0/1160038322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c07ff10 0x7fe26c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:50.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe27259b700 1 -- 172.21.15.84:0/1160038322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c07ff10 msgr2=0x7fe26c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:50.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe27259b700 1 --2- 172.21.15.84:0/1160038322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c07ff10 0x7fe26c0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:50.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe27259b700 1 -- 172.21.15.84:0/1160038322 >> v1:172.21.15.84:6789/0 conn(0x7fe26c0a9b30 legacy=0x7fe26c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:50.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe26b7fe700 1 -- 172.21.15.84:0/1160038322 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211907591 0 0) 0x7fe26c066dd0 con 0x7fe26c0a9b30 2020-01-16T05:45:50.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe27259b700 1 -- 172.21.15.84:0/1160038322 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c150ce0 con 0x7fe26c0a4250 2020-01-16T05:45:50.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe26bfff700 1 --2- 172.21.15.84:0/1160038322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c07ff10 0x7fe26c0abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:45:50.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe27259b700 1 --2- 172.21.15.84:0/1160038322 >> v2:172.21.15.84:3300/0 conn(0x7fe26c0a4250 0x7fe26c066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe264008c90 tx=0x7fe264010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:50.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe27259b700 1 --2- 172.21.15.84:0/1160038322 >> v2:172.21.15.84:3300/0 conn(0x7fe26c0a4250 0x7fe26c066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe264008c90 tx=0x7fe264010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:50.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe27259b700 1 --2- 172.21.15.84:0/1160038322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe26c0a4250 0x7fe26c066880 secure :-1 s=READY pgs=311 cs=0 l=1 rx=0x7fe264008c90 tx=0x7fe264010170).ready entity=mon.0 client_cookie=9a11b9139ad7671 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe27259b700 1 --2- 172.21.15.84:0/1160038322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe26c0a4250 0x7fe26c066880 secure :-1 s=THROTTLE_DONE pgs=311 cs=0 l=1 rx=0x7fe264008c90 tx=0x7fe264010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe26b7fe700 1 -- 172.21.15.84:0/1160038322 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe26400a160 con 0x7fe26c0a4250 2020-01-16T05:45:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe27259b700 1 --2- 172.21.15.84:0/1160038322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe26c0a4250 0x7fe26c066880 secure :-1 s=THROTTLE_DONE pgs=311 cs=0 l=1 rx=0x7fe264008c90 tx=0x7fe264010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe27259b700 1 --2- 172.21.15.84:0/1160038322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe26c0a4250 0x7fe26c066880 secure :-1 s=THROTTLE_DONE pgs=311 cs=0 l=1 rx=0x7fe264008c90 tx=0x7fe264010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe26b7fe700 1 -- 172.21.15.84:0/1160038322 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe264011af0 con 0x7fe26c0a4250 2020-01-16T05:45:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe26b7fe700 1 -- 172.21.15.84:0/1160038322 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe26400a740 con 0x7fe26c0a4250 2020-01-16T05:45:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe271339700 1 -- 172.21.15.84:0/1160038322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe26c0a4250 msgr2=0x7fe26c066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe271339700 1 --2- 172.21.15.84:0/1160038322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe26c0a4250 0x7fe26c066880 secure :-1 s=READY pgs=311 cs=0 l=1 rx=0x7fe264008c90 tx=0x7fe264010170).stop 2020-01-16T05:45:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe271339700 1 -- 172.21.15.84:0/1160038322 shutdown_connections 2020-01-16T05:45:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe271339700 1 --2- 172.21.15.84:0/1160038322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe26c0a4250 0x7fe26c066880 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe271339700 1 --2- 172.21.15.84:0/1160038322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c07ff10 0x7fe26c0abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe271339700 1 -- 172.21.15.84:0/1160038322 shutdown_connections 2020-01-16T05:45:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe271339700 1 -- 172.21.15.84:0/1160038322 wait complete. 2020-01-16T05:45:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.192+0000 7fe271339700 1 -- 172.21.15.84:0/1160038322 >> 172.21.15.84:0/1160038322 conn(0x7fe26c0acfc0 msgr2=0x7fe26c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:50.204 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe271339700 1 Processor -- start 2020-01-16T05:45:50.205 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe271339700 1 -- start start 2020-01-16T05:45:50.205 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe271339700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c127bb0 0x7fe26c131fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:50.205 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe271339700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe26c09f2c0 0x7fe26c13c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:50.205 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe271339700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26c1252d0 con 0x7fe26c132500 2020-01-16T05:45:50.205 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe271339700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26c131ab0 con 0x7fe26c09f2c0 2020-01-16T05:45:50.205 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe271339700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c132930 con 0x7fe26c127bb0 2020-01-16T05:45:50.205 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe26bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe26c132500 0x7fe26c09eac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52522/0 (socket says 172.21.15.84:52522) 2020-01-16T05:45:50.206 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe26bfff700 1 -- 172.21.15.84:0/3788501430 learned_addr learned my addr 172.21.15.84:0/3788501430 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:50.206 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe26bfff700 1 -- 172.21.15.84:0/3788501430 >> v1:172.21.15.84:6789/0 conn(0x7fe26c132500 legacy=0x7fe26c09eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-01-16T05:45:50.206 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe26bfff700 1 -- 172.21.15.84:0/3788501430 >> v1:172.21.15.84:6789/0 conn(0x7fe26c132500 legacy=0x7fe26c09eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-01-16T05:45:50.206 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe26bfff700 1 --1- 172.21.15.84:0/3788501430 >> v1:172.21.15.84:6789/0 conn(0x7fe26c132500 0x7fe26c09eac0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2020-01-16T05:45:50.206 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe26bfff700 1 --1- 172.21.15.84:0/3788501430 >> v1:172.21.15.84:6789/0 conn(0x7fe26c132500 0x7fe26c09eac0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2020-01-16T05:45:50.206 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe270b38700 1 --2- 172.21.15.84:0/3788501430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c127bb0 0x7fe26c131fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:50.206 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe27259b700 1 --2- 172.21.15.84:0/3788501430 >> v2:172.21.15.142:3300/0 conn(0x7fe26c09f2c0 0x7fe26c13c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:50.207 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe270b38700 1 -- 172.21.15.84:0/3788501430 >> v2:172.21.15.142:3300/0 conn(0x7fe26c09f2c0 msgr2=0x7fe26c13c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:50.207 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe270b38700 1 --2- 172.21.15.84:0/3788501430 >> v2:172.21.15.142:3300/0 conn(0x7fe26c09f2c0 0x7fe26c13c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:50.207 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe270b38700 1 -- 172.21.15.84:0/3788501430 >> v1:172.21.15.84:6789/0 conn(0x7fe26c132500 legacy=0x7fe26c09eac0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-01-16T05:45:50.207 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe270b38700 1 -- 172.21.15.84:0/3788501430 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c1261c0 con 0x7fe26c127bb0 2020-01-16T05:45:50.207 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe270b38700 1 --2- 172.21.15.84:0/3788501430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c127bb0 0x7fe26c131fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe260004520 tx=0x7fe260010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:50.207 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe270b38700 1 --2- 172.21.15.84:0/3788501430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c127bb0 0x7fe26c131fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe260004520 tx=0x7fe260010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:50.207 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe270b38700 1 --2- 172.21.15.84:0/3788501430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c127bb0 0x7fe26c131fb0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7fe260004520 tx=0x7fe260010a20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:50.208 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe270b38700 1 --2- 172.21.15.84:0/3788501430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c127bb0 0x7fe26c131fb0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fe260004520 tx=0x7fe260010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:50.208 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe2697fa700 1 -- 172.21.15.84:0/3788501430 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe260004990 con 0x7fe26c127bb0 2020-01-16T05:45:50.208 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe270b38700 1 --2- 172.21.15.84:0/3788501430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c127bb0 0x7fe26c131fb0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fe260004520 tx=0x7fe260010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:50.208 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe271339700 1 -- 172.21.15.84:0/3788501430 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26c124e90 con 0x7fe26c127bb0 2020-01-16T05:45:50.208 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe2697fa700 1 -- 172.21.15.84:0/3788501430 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2600045b0 con 0x7fe26c127bb0 2020-01-16T05:45:50.208 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe270b38700 1 --2- 172.21.15.84:0/3788501430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c127bb0 0x7fe26c131fb0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fe260004520 tx=0x7fe260010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:50.208 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe2697fa700 1 -- 172.21.15.84:0/3788501430 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2600123e0 con 0x7fe26c127bb0 2020-01-16T05:45:50.209 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe271339700 1 -- 172.21.15.84:0/3788501430 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26c09f6f0 con 0x7fe26c127bb0 2020-01-16T05:45:50.209 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe271339700 1 -- 172.21.15.84:0/3788501430 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26c05e1c0 con 0x7fe26c127bb0 2020-01-16T05:45:50.209 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.196+0000 7fe270b38700 1 --2- 172.21.15.84:0/3788501430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c127bb0 0x7fe26c131fb0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fe260004520 tx=0x7fe260010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:50.209 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.200+0000 7fe2697fa700 1 -- 172.21.15.84:0/3788501430 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fe2600126c0 con 0x7fe26c127bb0 2020-01-16T05:45:50.209 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.200+0000 7fe270b38700 1 --2- 172.21.15.84:0/3788501430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c127bb0 0x7fe26c131fb0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fe260004520 tx=0x7fe260010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:50.209 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.200+0000 7fe2697fa700 1 --2- 172.21.15.84:0/3788501430 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe24c03e460 0x7fe24c040970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:50.209 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.200+0000 7fe2697fa700 1 -- 172.21.15.84:0/3788501430 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fe26004ca40 con 0x7fe26c127bb0 2020-01-16T05:45:50.210 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.200+0000 7fe26bfff700 1 --2- 172.21.15.84:0/3788501430 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe24c03e460 0x7fe24c040970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:50.210 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.200+0000 7fe26bfff700 1 --2- 172.21.15.84:0/3788501430 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe24c03e460 0x7fe24c040970 crc :-1 s=READY pgs=123 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:50.210 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.208+0000 7fe270b38700 1 --2- 172.21.15.84:0/3788501430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c127bb0 0x7fe26c131fb0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fe260004520 tx=0x7fe260010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:50.210 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.208+0000 7fe2697fa700 1 -- 172.21.15.84:0/3788501430 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fe260033040 con 0x7fe26c127bb0 2020-01-16T05:45:50.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.356+0000 7fe271339700 1 -- 172.21.15.84:0/3788501430 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe26c0662e0 con 0x7fe26c127bb0 2020-01-16T05:45:50.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.356+0000 7fe270b38700 1 --2- 172.21.15.84:0/3788501430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c127bb0 0x7fe26c131fb0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fe260004520 tx=0x7fe260010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:50.359 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.356+0000 7fe2697fa700 1 -- 172.21.15.84:0/3788501430 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fe2600332a0 con 0x7fe26c127bb0 2020-01-16T05:45:50.359 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:50.359 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:50.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.356+0000 7fe271339700 1 -- 172.21.15.84:0/3788501430 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe24c03e460 msgr2=0x7fe24c040970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:50.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.356+0000 7fe271339700 1 --2- 172.21.15.84:0/3788501430 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe24c03e460 0x7fe24c040970 crc :-1 s=READY pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:50.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.356+0000 7fe271339700 1 -- 172.21.15.84:0/3788501430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c127bb0 msgr2=0x7fe26c131fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:50.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.356+0000 7fe271339700 1 --2- 172.21.15.84:0/3788501430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c127bb0 0x7fe26c131fb0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7fe260004520 tx=0x7fe260010a20).stop 2020-01-16T05:45:50.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.356+0000 7fe271339700 1 -- 172.21.15.84:0/3788501430 shutdown_connections 2020-01-16T05:45:50.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.356+0000 7fe271339700 1 --2- 172.21.15.84:0/3788501430 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe24c03e460 0x7fe24c040970 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:50.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.356+0000 7fe271339700 1 --2- 172.21.15.84:0/3788501430 >> v2:172.21.15.142:3300/0 conn(0x7fe26c09f2c0 0x7fe26c13c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:50.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.356+0000 7fe271339700 1 --2- 172.21.15.84:0/3788501430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe26c127bb0 0x7fe26c131fb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:50.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.360+0000 7fe271339700 1 -- 172.21.15.84:0/3788501430 shutdown_connections 2020-01-16T05:45:50.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.360+0000 7fe271339700 1 -- 172.21.15.84:0/3788501430 wait complete. 2020-01-16T05:45:50.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:50.360+0000 7fe271339700 1 -- 172.21.15.84:0/3788501430 >> 172.21.15.84:0/3788501430 conn(0x7fe26c07e100 msgr2=0x7fe26c07ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:50.362 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:45:50.370 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:45:52.372 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5057fff700 1 Processor -- start 2020-01-16T05:45:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5057fff700 1 -- start start 2020-01-16T05:45:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5057fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f50580a9b30 0x7f50580abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5057fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50580a4250 0x7f5058066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5057fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5058066dd0 con 0x7f505807ff10 2020-01-16T05:45:52.492 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5057fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50580a4830 con 0x7f50580a9b30 2020-01-16T05:45:52.492 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5057fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505807f9d0 con 0x7f50580a4250 2020-01-16T05:45:52.492 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f504ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f505807ff10 0x7f50580a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52534/0 (socket says 172.21.15.84:52534) 2020-01-16T05:45:52.492 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f504ffff700 1 -- 172.21.15.84:0/4018038506 learned_addr learned my addr 172.21.15.84:0/4018038506 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:52.492 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f50577fe700 1 --2- 172.21.15.84:0/4018038506 >> v2:172.21.15.142:3300/0 conn(0x7f50580a9b30 0x7f50580abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f505d8d4700 1 --2- 172.21.15.84:0/4018038506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50580a4250 0x7f5058066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5056ffd700 1 -- 172.21.15.84:0/4018038506 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776613851 0 0) 0x7f5058066dd0 con 0x7f505807ff10 2020-01-16T05:45:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5056ffd700 1 -- 172.21.15.84:0/4018038506 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5044003230 con 0x7f505807ff10 2020-01-16T05:45:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5056ffd700 1 -- 172.21.15.84:0/4018038506 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2899957713 0 0) 0x7f5044003230 con 0x7f505807ff10 2020-01-16T05:45:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5056ffd700 1 -- 172.21.15.84:0/4018038506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50580a4250 msgr2=0x7f5058066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5056ffd700 1 --2- 172.21.15.84:0/4018038506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50580a4250 0x7f5058066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5056ffd700 1 -- 172.21.15.84:0/4018038506 >> v2:172.21.15.142:3300/0 conn(0x7f50580a9b30 msgr2=0x7f50580abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:52.494 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5056ffd700 1 --2- 172.21.15.84:0/4018038506 >> v2:172.21.15.142:3300/0 conn(0x7f50580a9b30 0x7f50580abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:52.494 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5056ffd700 1 -- 172.21.15.84:0/4018038506 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5058150ce0 con 0x7f505807ff10 2020-01-16T05:45:52.494 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5056ffd700 1 -- 172.21.15.84:0/4018038506 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f5040001750 con 0x7f505807ff10 2020-01-16T05:45:52.494 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5056ffd700 1 -- 172.21.15.84:0/4018038506 >> v1:172.21.15.84:6789/0 conn(0x7f505807ff10 legacy=0x7f50580a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:52.494 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5056ffd700 1 --2- 172.21.15.84:0/4018038506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5044003890 0x7f5044003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:52.494 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5056ffd700 1 --2- 172.21.15.84:0/4018038506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50440045a0 0x7f50440049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:52.494 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5056ffd700 1 --2- 172.21.15.84:0/4018038506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5044004f20 0x7f504404f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:52.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5056ffd700 1 -- 172.21.15.84:0/4018038506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50580a4830 con 0x7f5044003890 2020-01-16T05:45:52.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5056ffd700 1 -- 172.21.15.84:0/4018038506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505807f9d0 con 0x7f50440045a0 2020-01-16T05:45:52.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f5056ffd700 1 -- 172.21.15.84:0/4018038506 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5044005350 con 0x7f5044004f20 2020-01-16T05:45:52.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.484+0000 7f50577fe700 1 --2- 172.21.15.84:0/4018038506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5044003890 0x7f5044003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:52.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f505d8d4700 1 --2- 172.21.15.84:0/4018038506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5044004f20 0x7f504404f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:52.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f504ffff700 1 --2- 172.21.15.84:0/4018038506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50440045a0 0x7f50440049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:52.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f50577fe700 1 -- 172.21.15.84:0/4018038506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5044004f20 msgr2=0x7f504404f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:52.496 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f50577fe700 1 --2- 172.21.15.84:0/4018038506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5044004f20 0x7f504404f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:52.496 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f50577fe700 1 -- 172.21.15.84:0/4018038506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50440045a0 msgr2=0x7f50440049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:52.496 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f50577fe700 1 --2- 172.21.15.84:0/4018038506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50440045a0 0x7f50440049d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:52.496 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f50577fe700 1 -- 172.21.15.84:0/4018038506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504404fe10 con 0x7f5044003890 2020-01-16T05:45:52.496 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f505d8d4700 1 --2- 172.21.15.84:0/4018038506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5044004f20 0x7f504404f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-01-16T05:45:52.496 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f50577fe700 1 --2- 172.21.15.84:0/4018038506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5044003890 0x7f5044003cc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5048002f30 tx=0x7f5048010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:52.497 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f50577fe700 1 --2- 172.21.15.84:0/4018038506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5044003890 0x7f5044003cc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5048002f30 tx=0x7f5048010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:52.497 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f50577fe700 1 --2- 172.21.15.84:0/4018038506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5044003890 0x7f5044003cc0 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7f5048002f30 tx=0x7f5048010160).ready entity=mon.0 client_cookie=44bfe63a9249c987 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:52.497 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f50577fe700 1 --2- 172.21.15.84:0/4018038506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5044003890 0x7f5044003cc0 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f5048002f30 tx=0x7f5048010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:52.497 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f5056ffd700 1 -- 172.21.15.84:0/4018038506 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5048008970 con 0x7f5044003890 2020-01-16T05:45:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f50577fe700 1 --2- 172.21.15.84:0/4018038506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5044003890 0x7f5044003cc0 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f5048002f30 tx=0x7f5048010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f50577fe700 1 --2- 172.21.15.84:0/4018038506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5044003890 0x7f5044003cc0 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f5048002f30 tx=0x7f5048010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f5056ffd700 1 -- 172.21.15.84:0/4018038506 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5048010ab0 con 0x7f5044003890 2020-01-16T05:45:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f5056ffd700 1 -- 172.21.15.84:0/4018038506 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50480110c0 con 0x7f5044003890 2020-01-16T05:45:52.499 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f5057fff700 1 -- 172.21.15.84:0/4018038506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5044003890 msgr2=0x7f5044003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:52.499 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f5057fff700 1 --2- 172.21.15.84:0/4018038506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5044003890 0x7f5044003cc0 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7f5048002f30 tx=0x7f5048010160).stop 2020-01-16T05:45:52.499 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f505d8d4700 1 -- 172.21.15.84:0/4018038506 reap_dead start 2020-01-16T05:45:52.499 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f5057fff700 1 -- 172.21.15.84:0/4018038506 shutdown_connections 2020-01-16T05:45:52.499 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f5057fff700 1 -- 172.21.15.84:0/4018038506 shutdown_connections 2020-01-16T05:45:52.500 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f5057fff700 1 -- 172.21.15.84:0/4018038506 wait complete. 2020-01-16T05:45:52.500 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f5057fff700 1 -- 172.21.15.84:0/4018038506 >> 172.21.15.84:0/4018038506 conn(0x7f50580acfc0 msgr2=0x7f50580a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:52.500 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f5057fff700 1 Processor -- start 2020-01-16T05:45:52.500 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f5057fff700 1 -- start start 2020-01-16T05:45:52.506 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f5057fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5058090ce0 0x7f5058126480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:52.507 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f5057fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f505809ecd0 0x7f505809f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:52.507 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f5057fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5058127090 con 0x7f505805ec40 2020-01-16T05:45:52.507 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f5057fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5058091200 con 0x7f5058090ce0 2020-01-16T05:45:52.507 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f5057fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5058126b50 con 0x7f505809ecd0 2020-01-16T05:45:52.508 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f50577fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5058090ce0 0x7f5058126480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:52.508 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f504ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f505805ec40 0x7f50581273b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52546/0 (socket says 172.21.15.84:52546) 2020-01-16T05:45:52.508 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f504ffff700 1 -- 172.21.15.84:0/1779179027 learned_addr learned my addr 172.21.15.84:0/1779179027 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:52.508 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.488+0000 7f505d8d4700 1 --2- 172.21.15.84:0/1779179027 >> v2:172.21.15.142:3300/0 conn(0x7f505809ecd0 0x7f505809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:52.509 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f50577fe700 1 -- 172.21.15.84:0/1779179027 >> v2:172.21.15.142:3300/0 conn(0x7f505809ecd0 msgr2=0x7f505809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:52.509 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f50577fe700 1 --2- 172.21.15.84:0/1779179027 >> v2:172.21.15.142:3300/0 conn(0x7f505809ecd0 0x7f505809f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:52.509 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f50577fe700 1 -- 172.21.15.84:0/1779179027 >> v1:172.21.15.84:6789/0 conn(0x7f505805ec40 legacy=0x7f50581273b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:52.509 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f50577fe700 1 -- 172.21.15.84:0/1779179027 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5058127bb0 con 0x7f5058090ce0 2020-01-16T05:45:52.510 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f5054ff9700 1 -- 172.21.15.84:0/1779179027 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2394850676 0 0) 0x7f5058127090 con 0x7f505805ec40 2020-01-16T05:45:52.510 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f505d8d4700 1 --2- 172.21.15.84:0/1779179027 >> v2:172.21.15.142:3300/0 conn(0x7f505809ecd0 0x7f505809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:45:52.510 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f50577fe700 1 --2- 172.21.15.84:0/1779179027 >> v2:172.21.15.84:3300/0 conn(0x7f5058090ce0 0x7f5058126480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f50580913c0 tx=0x7f504800f450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:52.510 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f50577fe700 1 --2- 172.21.15.84:0/1779179027 >> v2:172.21.15.84:3300/0 conn(0x7f5058090ce0 0x7f5058126480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f50580913c0 tx=0x7f504800f450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:52.511 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f50577fe700 1 --2- 172.21.15.84:0/1779179027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5058090ce0 0x7f5058126480 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7f50580913c0 tx=0x7f504800f450).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:52.511 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f50577fe700 1 --2- 172.21.15.84:0/1779179027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5058090ce0 0x7f5058126480 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f50580913c0 tx=0x7f504800f450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:52.511 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f5054ff9700 1 -- 172.21.15.84:0/1779179027 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5048007160 con 0x7f5058090ce0 2020-01-16T05:45:52.511 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f50577fe700 1 --2- 172.21.15.84:0/1779179027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5058090ce0 0x7f5058126480 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f50580913c0 tx=0x7f504800f450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:52.512 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f50577fe700 1 --2- 172.21.15.84:0/1779179027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5058090ce0 0x7f5058126480 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f50580913c0 tx=0x7f504800f450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:52.512 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f5054ff9700 1 -- 172.21.15.84:0/1779179027 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5048008b70 con 0x7f5058090ce0 2020-01-16T05:45:52.512 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f5057fff700 1 -- 172.21.15.84:0/1779179027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505809f650 con 0x7f5058090ce0 2020-01-16T05:45:52.512 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f5054ff9700 1 -- 172.21.15.84:0/1779179027 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50480056c0 con 0x7f5058090ce0 2020-01-16T05:45:52.512 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f5057fff700 1 -- 172.21.15.84:0/1779179027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50580a5320 con 0x7f5058090ce0 2020-01-16T05:45:52.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f50577fe700 1 --2- 172.21.15.84:0/1779179027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5058090ce0 0x7f5058126480 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f50580913c0 tx=0x7f504800f450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:52.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f5054ff9700 1 -- 172.21.15.84:0/1779179027 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f50480059a0 con 0x7f5058090ce0 2020-01-16T05:45:52.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f50577fe700 1 --2- 172.21.15.84:0/1779179027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5058090ce0 0x7f5058126480 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f50580913c0 tx=0x7f504800f450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:52.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f5057fff700 1 -- 172.21.15.84:0/1779179027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505805e1c0 con 0x7f5058090ce0 2020-01-16T05:45:52.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f5054ff9700 1 --2- 172.21.15.84:0/1779179027 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f503c03e3c0 0x7f503c0408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:52.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f5054ff9700 1 -- 172.21.15.84:0/1779179027 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f504804ca70 con 0x7f5058090ce0 2020-01-16T05:45:52.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f504ffff700 1 --2- 172.21.15.84:0/1779179027 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f503c03e3c0 0x7f503c0408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:52.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.492+0000 7f504ffff700 1 --2- 172.21.15.84:0/1779179027 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f503c03e3c0 0x7f503c0408d0 crc :-1 s=READY pgs=124 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:52.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.496+0000 7f50577fe700 1 --2- 172.21.15.84:0/1779179027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5058090ce0 0x7f5058126480 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f50580913c0 tx=0x7f504800f450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:52.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.496+0000 7f5054ff9700 1 -- 172.21.15.84:0/1779179027 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f50480332d0 con 0x7f5058090ce0 2020-01-16T05:45:52.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.644+0000 7f5057fff700 1 -- 172.21.15.84:0/1779179027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f505805cbc0 con 0x7f5058090ce0 2020-01-16T05:45:52.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.644+0000 7f50577fe700 1 --2- 172.21.15.84:0/1779179027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5058090ce0 0x7f5058126480 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f50580913c0 tx=0x7f504800f450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:52.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.644+0000 7f5054ff9700 1 -- 172.21.15.84:0/1779179027 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f5048034960 con 0x7f5058090ce0 2020-01-16T05:45:52.646 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:52.647 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.644+0000 7f5057fff700 1 -- 172.21.15.84:0/1779179027 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f503c03e3c0 msgr2=0x7f503c0408d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.644+0000 7f5057fff700 1 --2- 172.21.15.84:0/1779179027 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f503c03e3c0 0x7f503c0408d0 crc :-1 s=READY pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.644+0000 7f5057fff700 1 -- 172.21.15.84:0/1779179027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5058090ce0 msgr2=0x7f5058126480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.644+0000 7f5057fff700 1 --2- 172.21.15.84:0/1779179027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5058090ce0 0x7f5058126480 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7f50580913c0 tx=0x7f504800f450).stop 2020-01-16T05:45:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.644+0000 7f5057fff700 1 -- 172.21.15.84:0/1779179027 shutdown_connections 2020-01-16T05:45:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.644+0000 7f5057fff700 1 --2- 172.21.15.84:0/1779179027 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f503c03e3c0 0x7f503c0408d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:52.649 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.644+0000 7f5057fff700 1 --2- 172.21.15.84:0/1779179027 >> v2:172.21.15.142:3300/0 conn(0x7f505809ecd0 0x7f505809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:52.649 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.644+0000 7f5057fff700 1 --2- 172.21.15.84:0/1779179027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5058090ce0 0x7f5058126480 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:52.649 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.644+0000 7f5057fff700 1 -- 172.21.15.84:0/1779179027 shutdown_connections 2020-01-16T05:45:52.649 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.644+0000 7f5057fff700 1 -- 172.21.15.84:0/1779179027 wait complete. 2020-01-16T05:45:52.649 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:52.644+0000 7f5057fff700 1 -- 172.21.15.84:0/1779179027 >> 172.21.15.84:0/1779179027 conn(0x7f505805bbb0 msgr2=0x7f505807dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:52.650 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:45:52.657 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:45:54.658 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:54.768 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.760+0000 7f7a2827b700 1 Processor -- start 2020-01-16T05:45:54.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.760+0000 7f7a2827b700 1 -- start start 2020-01-16T05:45:54.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a2827b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7a200a2f60 0x7f7a2005b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:54.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a2827b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7a200a8ff0 0x7f7a2008fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:54.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a2827b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a2007c560 0x7f7a2007c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:54.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a2827b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a200a3390 con 0x7f7a200a2f60 2020-01-16T05:45:54.769 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a2827b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a200905b0 con 0x7f7a200a8ff0 2020-01-16T05:45:54.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a2827b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a200a2a20 con 0x7f7a2007c560 2020-01-16T05:45:54.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a26818700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7a200a2f60 0x7f7a2005b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:54.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a26818700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7a200a2f60 0x7f7a2005b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35358/0 (socket says 172.21.15.84:35358) 2020-01-16T05:45:54.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a26818700 1 -- 172.21.15.84:0/3190405423 learned_addr learned my addr 172.21.15.84:0/3190405423 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:45:54.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a26017700 1 --2- 172.21.15.84:0/3190405423 >> v2:172.21.15.142:3300/0 conn(0x7f7a200a8ff0 0x7f7a2008fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a27019700 1 --2- 172.21.15.84:0/3190405423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a2007c560 0x7f7a2007c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a26818700 1 -- 172.21.15.84:0/3190405423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a2007c560 msgr2=0x7f7a2007c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a26818700 1 --2- 172.21.15.84:0/3190405423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a2007c560 0x7f7a2007c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a26818700 1 -- 172.21.15.84:0/3190405423 >> v2:172.21.15.142:3300/0 conn(0x7f7a200a8ff0 msgr2=0x7f7a2008fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a26818700 1 --2- 172.21.15.84:0/3190405423 >> v2:172.21.15.142:3300/0 conn(0x7f7a200a8ff0 0x7f7a2008fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a26818700 1 -- 172.21.15.84:0/3190405423 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a200902d0 con 0x7f7a200a2f60 2020-01-16T05:45:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a27019700 1 --2- 172.21.15.84:0/3190405423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a2007c560 0x7f7a2007c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:45:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a26818700 1 --2- 172.21.15.84:0/3190405423 >> v2:172.21.15.84:3300/0 conn(0x7f7a200a2f60 0x7f7a2005b0f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7a20090770 tx=0x7f7a1c00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a26818700 1 --2- 172.21.15.84:0/3190405423 >> v2:172.21.15.84:3300/0 conn(0x7f7a200a2f60 0x7f7a2005b0f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7a20090770 tx=0x7f7a1c00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a26818700 1 --2- 172.21.15.84:0/3190405423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a200a2f60 0x7f7a2005b0f0 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7f7a20090770 tx=0x7f7a1c00ff30).ready entity=mon.0 client_cookie=4c292607925c2963 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a26818700 1 --2- 172.21.15.84:0/3190405423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a200a2f60 0x7f7a2005b0f0 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f7a20090770 tx=0x7f7a1c00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a25816700 1 -- 172.21.15.84:0/3190405423 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a1c011760 con 0x7f7a200a2f60 2020-01-16T05:45:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a26818700 1 --2- 172.21.15.84:0/3190405423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a200a2f60 0x7f7a2005b0f0 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f7a20090770 tx=0x7f7a1c00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a26818700 1 --2- 172.21.15.84:0/3190405423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a200a2f60 0x7f7a2005b0f0 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f7a20090770 tx=0x7f7a1c00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a25816700 1 -- 172.21.15.84:0/3190405423 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c008d30 con 0x7f7a200a2f60 2020-01-16T05:45:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a25816700 1 -- 172.21.15.84:0/3190405423 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a1c011d40 con 0x7f7a200a2f60 2020-01-16T05:45:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a2827b700 1 -- 172.21.15.84:0/3190405423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a200a2f60 msgr2=0x7f7a2005b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a2827b700 1 --2- 172.21.15.84:0/3190405423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a200a2f60 0x7f7a2005b0f0 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7f7a20090770 tx=0x7f7a1c00ff30).stop 2020-01-16T05:45:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a2827b700 1 -- 172.21.15.84:0/3190405423 shutdown_connections 2020-01-16T05:45:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a2827b700 1 --2- 172.21.15.84:0/3190405423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a2007c560 0x7f7a2007c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a2827b700 1 --2- 172.21.15.84:0/3190405423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a200a2f60 0x7f7a2005b0f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a2827b700 1 --2- 172.21.15.84:0/3190405423 >> v2:172.21.15.142:3300/0 conn(0x7f7a200a8ff0 0x7f7a2008fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a2827b700 1 -- 172.21.15.84:0/3190405423 shutdown_connections 2020-01-16T05:45:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a2827b700 1 -- 172.21.15.84:0/3190405423 wait complete. 2020-01-16T05:45:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.764+0000 7f7a2827b700 1 -- 172.21.15.84:0/3190405423 >> 172.21.15.84:0/3190405423 conn(0x7f7a200abc10 msgr2=0x7f7a2005a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:54.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a2827b700 1 Processor -- start 2020-01-16T05:45:54.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a2827b700 1 -- start start 2020-01-16T05:45:54.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a2827b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7a200a4c00 0x7f7a20095b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:54.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a2827b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a200964c0 con 0x7f7a20096090 2020-01-16T05:45:54.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a2827b700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a200a01d0 con 0x7f7a20129280 2020-01-16T05:45:54.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a2827b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a200958a0 con 0x7f7a200a4c00 2020-01-16T05:45:54.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a27019700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7a20096090 0x7f7a2009f9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52568/0 (socket says 172.21.15.84:52568) 2020-01-16T05:45:54.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a27019700 1 -- 172.21.15.84:0/2720942807 learned_addr learned my addr 172.21.15.84:0/2720942807 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:54.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a26017700 1 --2- 172.21.15.84:0/2720942807 >> v2:172.21.15.142:3300/0 conn(0x7f7a200a4c00 0x7f7a20095b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:54.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a177fe700 1 -- 172.21.15.84:0/2720942807 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037506551 0 0) 0x7f7a200964c0 con 0x7f7a20096090 2020-01-16T05:45:54.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a177fe700 1 -- 172.21.15.84:0/2720942807 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a08003230 con 0x7f7a20096090 2020-01-16T05:45:54.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a177fe700 1 -- 172.21.15.84:0/2720942807 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3572913107 0 0) 0x7f7a08003230 con 0x7f7a20096090 2020-01-16T05:45:54.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a177fe700 1 -- 172.21.15.84:0/2720942807 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7a200964c0 con 0x7f7a20096090 2020-01-16T05:45:54.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a177fe700 1 -- 172.21.15.84:0/2720942807 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f7a18001810 con 0x7f7a20096090 2020-01-16T05:45:54.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a177fe700 1 -- 172.21.15.84:0/2720942807 >> v2:172.21.15.142:3300/0 conn(0x7f7a200a4c00 msgr2=0x7f7a20095b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:54.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a177fe700 1 --2- 172.21.15.84:0/2720942807 >> v2:172.21.15.142:3300/0 conn(0x7f7a200a4c00 0x7f7a20095b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:54.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a177fe700 1 -- 172.21.15.84:0/2720942807 >> v1:172.21.15.142:6789/0 conn(0x7f7a20129280 legacy=0x7f7a201388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:54.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a177fe700 1 -- 172.21.15.84:0/2720942807 >> v1:172.21.15.84:6789/0 conn(0x7f7a20096090 legacy=0x7f7a2009f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:54.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a177fe700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a08003a20 0x7f7a08003e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:54.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a177fe700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a080045a0 0x7f7a080049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:54.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a177fe700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a08005010 0x7f7a0800b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:54.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a177fe700 1 -- 172.21.15.84:0/2720942807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a200958a0 con 0x7f7a08003a20 2020-01-16T05:45:54.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a177fe700 1 -- 172.21.15.84:0/2720942807 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0800be80 con 0x7f7a080045a0 2020-01-16T05:45:54.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a177fe700 1 -- 172.21.15.84:0/2720942807 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0800c0c0 con 0x7f7a08005010 2020-01-16T05:45:54.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a26818700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a08003a20 0x7f7a08003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:54.782 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a26017700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a080045a0 0x7f7a080049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:54.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a27019700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a08005010 0x7f7a0800b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:54.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a26818700 1 -- 172.21.15.84:0/2720942807 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a08005010 msgr2=0x7f7a0800b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:54.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a26818700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a08005010 0x7f7a0800b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:54.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a26818700 1 -- 172.21.15.84:0/2720942807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a080045a0 msgr2=0x7f7a080049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:54.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a26818700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a080045a0 0x7f7a080049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:54.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a26818700 1 -- 172.21.15.84:0/2720942807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a080035e0 con 0x7f7a08003a20 2020-01-16T05:45:54.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a2827b700 1 -- 172.21.15.84:0/2720942807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a200a0400 con 0x7f7a08003a20 2020-01-16T05:45:54.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a27019700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a08005010 0x7f7a0800b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-01-16T05:45:54.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a26017700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a080045a0 0x7f7a080049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-01-16T05:45:54.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a26818700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a08003a20 0x7f7a08003e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7a1c007f00 tx=0x7f7a1c0118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:54.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a27019700 1 -- 172.21.15.84:0/2720942807 reap_dead start 2020-01-16T05:45:54.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a2827b700 1 -- 172.21.15.84:0/2720942807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a20129280 con 0x7f7a08003a20 2020-01-16T05:45:54.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a26818700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a08003a20 0x7f7a08003e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7a1c007f00 tx=0x7f7a1c0118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:54.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.768+0000 7f7a26818700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a08003a20 0x7f7a08003e90 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f7a1c007f00 tx=0x7f7a1c0118a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:54.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.772+0000 7f7a26818700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a08003a20 0x7f7a08003e90 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f7a1c007f00 tx=0x7f7a1c0118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:54.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.772+0000 7f7a177fe700 1 -- 172.21.15.84:0/2720942807 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a1c00f780 con 0x7f7a08003a20 2020-01-16T05:45:54.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.772+0000 7f7a26818700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a08003a20 0x7f7a08003e90 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f7a1c007f00 tx=0x7f7a1c0118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:54.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.772+0000 7f7a26818700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a08003a20 0x7f7a08003e90 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f7a1c007f00 tx=0x7f7a1c0118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:54.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.772+0000 7f7a177fe700 1 -- 172.21.15.84:0/2720942807 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c011960 con 0x7f7a08003a20 2020-01-16T05:45:54.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.772+0000 7f7a177fe700 1 -- 172.21.15.84:0/2720942807 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a1c005aa0 con 0x7f7a08003a20 2020-01-16T05:45:54.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.772+0000 7f7a26818700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a08003a20 0x7f7a08003e90 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f7a1c007f00 tx=0x7f7a1c0118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:54.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.772+0000 7f7a2827b700 1 -- 172.21.15.84:0/2720942807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79fc003360 con 0x7f7a08003a20 2020-01-16T05:45:54.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.772+0000 7f7a177fe700 1 -- 172.21.15.84:0/2720942807 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f7a1c005ca0 con 0x7f7a08003a20 2020-01-16T05:45:54.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.772+0000 7f7a26818700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a08003a20 0x7f7a08003e90 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f7a1c007f00 tx=0x7f7a1c0118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:54.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.772+0000 7f7a177fe700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7a0803ffa0 0x7f7a080424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:54.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.772+0000 7f7a177fe700 1 -- 172.21.15.84:0/2720942807 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f7a1c0150a0 con 0x7f7a08003a20 2020-01-16T05:45:54.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.772+0000 7f7a26017700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7a0803ffa0 0x7f7a080424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:54.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.772+0000 7f7a26017700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7a0803ffa0 0x7f7a080424b0 crc :-1 s=READY pgs=125 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:54.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.776+0000 7f7a26818700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a08003a20 0x7f7a08003e90 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f7a1c007f00 tx=0x7f7a1c0118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:54.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.776+0000 7f7a177fe700 1 -- 172.21.15.84:0/2720942807 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f7a1c033210 con 0x7f7a08003a20 2020-01-16T05:45:54.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.916+0000 7f7a2827b700 1 -- 172.21.15.84:0/2720942807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79fc003790 con 0x7f7a08003a20 2020-01-16T05:45:54.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.916+0000 7f7a26818700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a08003a20 0x7f7a08003e90 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f7a1c007f00 tx=0x7f7a1c0118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:54.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.916+0000 7f7a177fe700 1 -- 172.21.15.84:0/2720942807 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f7a1c033470 con 0x7f7a08003a20 2020-01-16T05:45:54.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.920+0000 7f7a2827b700 1 -- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7a0803ffa0 msgr2=0x7f7a080424b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:54.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.920+0000 7f7a2827b700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7a0803ffa0 0x7f7a080424b0 crc :-1 s=READY pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.920+0000 7f7a2827b700 1 -- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a08003a20 msgr2=0x7f7a08003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.920+0000 7f7a2827b700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a08003a20 0x7f7a08003e90 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f7a1c007f00 tx=0x7f7a1c0118a0).stop 2020-01-16T05:45:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.920+0000 7f7a2827b700 1 -- 172.21.15.84:0/2720942807 shutdown_connections 2020-01-16T05:45:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.920+0000 7f7a2827b700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7a0803ffa0 0x7f7a080424b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.920+0000 7f7a2827b700 1 --2- 172.21.15.84:0/2720942807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a08003a20 0x7f7a08003e90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.920+0000 7f7a2827b700 1 -- 172.21.15.84:0/2720942807 shutdown_connections 2020-01-16T05:45:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.920+0000 7f7a2827b700 1 -- 172.21.15.84:0/2720942807 wait complete. 2020-01-16T05:45:54.948 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:54.920+0000 7f7a2827b700 1 -- 172.21.15.84:0/2720942807 >> 172.21.15.84:0/2720942807 conn(0x7f7a200a86a0 msgr2=0x7f7a200a58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:54.948 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:45:54.948 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:54.948 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:54.948 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:45:56.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~89s 2020-01-16T05:45:56.950 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:57.061 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f644cfb1700 1 Processor -- start 2020-01-16T05:45:57.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f644cfb1700 1 -- start start 2020-01-16T05:45:57.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f644cfb1700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64480a9b30 0x7f64480abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:57.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f644cfb1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f64480a4250 0x7f6448066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:57.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f644cfb1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6448066dd0 con 0x7f644807ff10 2020-01-16T05:45:57.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f644cfb1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64480a4830 con 0x7f64480a4250 2020-01-16T05:45:57.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f644cfb1700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644807f9d0 con 0x7f64480a9b30 2020-01-16T05:45:57.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f644e213700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f64480a4250 0x7f6448066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:57.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f64477fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f644807ff10 0x7f64480a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52578/0 (socket says 172.21.15.84:52578) 2020-01-16T05:45:57.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f64477fe700 1 -- 172.21.15.84:0/4101635108 learned_addr learned my addr 172.21.15.84:0/4101635108 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:57.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f6447fff700 1 --2- 172.21.15.84:0/4101635108 >> v2:172.21.15.142:3300/0 conn(0x7f64480a9b30 0x7f64480abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:57.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f644e213700 1 -- 172.21.15.84:0/4101635108 >> v2:172.21.15.142:3300/0 conn(0x7f64480a9b30 msgr2=0x7f64480abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:45:57.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f644e213700 1 --2- 172.21.15.84:0/4101635108 >> v2:172.21.15.142:3300/0 conn(0x7f64480a9b30 0x7f64480abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:57.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f644e213700 1 -- 172.21.15.84:0/4101635108 >> v1:172.21.15.84:6789/0 conn(0x7f644807ff10 legacy=0x7f64480a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:57.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f644e213700 1 -- 172.21.15.84:0/4101635108 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6448150ce0 con 0x7f64480a4250 2020-01-16T05:45:57.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f6446ffd700 1 -- 172.21.15.84:0/4101635108 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014979657 0 0) 0x7f6448066dd0 con 0x7f644807ff10 2020-01-16T05:45:57.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f644e213700 1 --2- 172.21.15.84:0/4101635108 >> v2:172.21.15.84:3300/0 conn(0x7f64480a4250 0x7f6448066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f64480a49f0 tx=0x7f6440010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:57.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f644e213700 1 --2- 172.21.15.84:0/4101635108 >> v2:172.21.15.84:3300/0 conn(0x7f64480a4250 0x7f6448066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f64480a49f0 tx=0x7f6440010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:57.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f644e213700 1 --2- 172.21.15.84:0/4101635108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64480a4250 0x7f6448066880 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7f64480a49f0 tx=0x7f6440010170).ready entity=mon.0 client_cookie=b950f5967f15cc48 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:57.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f644e213700 1 --2- 172.21.15.84:0/4101635108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64480a4250 0x7f6448066880 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f64480a49f0 tx=0x7f6440010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:57.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.056+0000 7f6446ffd700 1 -- 172.21.15.84:0/4101635108 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f644000a160 con 0x7f64480a4250 2020-01-16T05:45:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f644e213700 1 --2- 172.21.15.84:0/4101635108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64480a4250 0x7f6448066880 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f64480a49f0 tx=0x7f6440010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f6446ffd700 1 -- 172.21.15.84:0/4101635108 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6440011ab0 con 0x7f64480a4250 2020-01-16T05:45:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f644e213700 1 --2- 172.21.15.84:0/4101635108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64480a4250 0x7f6448066880 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f64480a49f0 tx=0x7f6440010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f644cfb1700 1 -- 172.21.15.84:0/4101635108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64480a4250 msgr2=0x7f6448066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f6446ffd700 1 -- 172.21.15.84:0/4101635108 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f644000a740 con 0x7f64480a4250 2020-01-16T05:45:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f644cfb1700 1 --2- 172.21.15.84:0/4101635108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64480a4250 0x7f6448066880 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7f64480a49f0 tx=0x7f6440010170).stop 2020-01-16T05:45:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f644cfb1700 1 -- 172.21.15.84:0/4101635108 shutdown_connections 2020-01-16T05:45:57.066 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f644cfb1700 1 --2- 172.21.15.84:0/4101635108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64480a4250 0x7f6448066880 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:57.066 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f644cfb1700 1 --2- 172.21.15.84:0/4101635108 >> v2:172.21.15.142:3300/0 conn(0x7f64480a9b30 0x7f64480abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:45:57.066 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f644cfb1700 1 -- 172.21.15.84:0/4101635108 shutdown_connections 2020-01-16T05:45:57.066 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f644cfb1700 1 -- 172.21.15.84:0/4101635108 wait complete. 2020-01-16T05:45:57.066 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f644cfb1700 1 -- 172.21.15.84:0/4101635108 >> 172.21.15.84:0/4101635108 conn(0x7f64480acfc0 msgr2=0x7f64480a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:57.070 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f644cfb1700 1 Processor -- start 2020-01-16T05:45:57.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f644cfb1700 1 -- start start 2020-01-16T05:45:57.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f644cfb1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6448135380 0x7f644809f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:57.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f644cfb1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6448140320 con 0x7f644809f340 2020-01-16T05:45:57.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f644cfb1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6448141560 con 0x7f6448065920 2020-01-16T05:45:57.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f644cfb1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644807ca00 con 0x7f6448135380 2020-01-16T05:45:57.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f64477fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f644809f340 0x7f6448134b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52584/0 (socket says 172.21.15.84:52584) 2020-01-16T05:45:57.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f64477fe700 1 -- 172.21.15.84:0/2088900465 learned_addr learned my addr 172.21.15.84:0/2088900465 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:57.072 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.060+0000 7f644e213700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6448135380 0x7f644809f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:57.072 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500313027 0 0) 0x7f6448140320 con 0x7f644809f340 2020-01-16T05:45:57.072 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6428003230 con 0x7f644809f340 2020-01-16T05:45:57.072 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118880483 0 0) 0x7f6448141560 con 0x7f6448065920 2020-01-16T05:45:57.072 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6448140320 con 0x7f6448065920 2020-01-16T05:45:57.072 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2475787158 0 0) 0x7f6428003230 con 0x7f644809f340 2020-01-16T05:45:57.072 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6448141560 con 0x7f644809f340 2020-01-16T05:45:57.073 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f6438001980 con 0x7f644809f340 2020-01-16T05:45:57.073 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6448135380 msgr2=0x7f644809f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:57.073 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6448135380 0x7f644809f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:57.073 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 >> v1:172.21.15.142:6789/0 conn(0x7f6448065920 legacy=0x7f644807b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:57.073 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 >> v1:172.21.15.84:6789/0 conn(0x7f644809f340 legacy=0x7f6448134b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:57.073 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6428003c30 0x7f64280045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:57.073 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6428004af0 0x7f6428004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:57.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64280097e0 0x7f642800bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:57.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644807ca00 con 0x7f6428003c30 2020-01-16T05:45:57.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6428004230 con 0x7f6428004af0 2020-01-16T05:45:57.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642800c170 con 0x7f64280097e0 2020-01-16T05:45:57.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6447fff700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6428003c30 0x7f64280045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:57.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f64477fe700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6428004af0 0x7f6428004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:57.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f644e213700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64280097e0 0x7f642800bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:57.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6447fff700 1 -- 172.21.15.84:0/2088900465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64280097e0 msgr2=0x7f642800bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:57.075 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6447fff700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64280097e0 0x7f642800bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:57.075 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6447fff700 1 -- 172.21.15.84:0/2088900465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6428004af0 msgr2=0x7f6428004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:57.075 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6447fff700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6428004af0 0x7f6428004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:57.075 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6447fff700 1 -- 172.21.15.84:0/2088900465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64480ab090 con 0x7f6428003c30 2020-01-16T05:45:57.075 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f644e213700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64280097e0 0x7f642800bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-01-16T05:45:57.075 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6447fff700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6428003c30 0x7f64280045a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f643c007840 tx=0x7f643c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:57.075 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f644cfb1700 1 -- 172.21.15.84:0/2088900465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644809f770 con 0x7f6428003c30 2020-01-16T05:45:57.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6447fff700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6428003c30 0x7f64280045a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f643c007840 tx=0x7f643c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:57.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f644cfb1700 1 -- 172.21.15.84:0/2088900465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6448135380 con 0x7f6428003c30 2020-01-16T05:45:57.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6447fff700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6428003c30 0x7f64280045a0 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7f643c007840 tx=0x7f643c010ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:57.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6447fff700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6428003c30 0x7f64280045a0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f643c007840 tx=0x7f643c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:57.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f643c012720 con 0x7f6428003c30 2020-01-16T05:45:57.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6447fff700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6428003c30 0x7f64280045a0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f643c007840 tx=0x7f643c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:57.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6447fff700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6428003c30 0x7f64280045a0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f643c007840 tx=0x7f643c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:57.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c008b80 con 0x7f6428003c30 2020-01-16T05:45:57.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f643c012d00 con 0x7f6428003c30 2020-01-16T05:45:57.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6447fff700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6428003c30 0x7f64280045a0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f643c007840 tx=0x7f643c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:57.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f644cfb1700 1 -- 172.21.15.84:0/2088900465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6420003360 con 0x7f6428003c30 2020-01-16T05:45:57.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f643c0056c0 con 0x7f6428003c30 2020-01-16T05:45:57.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6447fff700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6428003c30 0x7f64280045a0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f643c007840 tx=0x7f643c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:57.077 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6428045380 0x7f6428047890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:57.078 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f643c04cb60 con 0x7f6428003c30 2020-01-16T05:45:57.078 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f64477fe700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6428045380 0x7f6428047890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:57.078 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.064+0000 7f64477fe700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6428045380 0x7f6428047890 crc :-1 s=READY pgs=126 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:57.078 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.072+0000 7f6447fff700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6428003c30 0x7f64280045a0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f643c007840 tx=0x7f643c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:57.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.072+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f643c033180 con 0x7f6428003c30 2020-01-16T05:45:57.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.220+0000 7f644cfb1700 1 -- 172.21.15.84:0/2088900465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6420003790 con 0x7f6428003c30 2020-01-16T05:45:57.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.220+0000 7f6447fff700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6428003c30 0x7f64280045a0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f643c007840 tx=0x7f643c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:57.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.220+0000 7f6444ff9700 1 -- 172.21.15.84:0/2088900465 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f643c0333e0 con 0x7f6428003c30 2020-01-16T05:45:57.221 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:57.221 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:57.223 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.220+0000 7f644cfb1700 1 -- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6428045380 msgr2=0x7f6428047890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:57.223 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.220+0000 7f644cfb1700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6428045380 0x7f6428047890 crc :-1 s=READY pgs=126 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:57.223 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.220+0000 7f644cfb1700 1 -- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6428003c30 msgr2=0x7f64280045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:57.223 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.220+0000 7f644e213700 1 -- 172.21.15.84:0/2088900465 reap_dead start 2020-01-16T05:45:57.223 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.220+0000 7f644cfb1700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6428003c30 0x7f64280045a0 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7f643c007840 tx=0x7f643c010ce0).stop 2020-01-16T05:45:57.223 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.220+0000 7f644cfb1700 1 -- 172.21.15.84:0/2088900465 shutdown_connections 2020-01-16T05:45:57.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.220+0000 7f644cfb1700 1 --2- 172.21.15.84:0/2088900465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6428003c30 0x7f64280045a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:57.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.220+0000 7f644cfb1700 1 -- 172.21.15.84:0/2088900465 shutdown_connections 2020-01-16T05:45:57.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.220+0000 7f644cfb1700 1 -- 172.21.15.84:0/2088900465 wait complete. 2020-01-16T05:45:57.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:57.220+0000 7f644cfb1700 1 -- 172.21.15.84:0/2088900465 >> 172.21.15.84:0/2088900465 conn(0x7f64480a90b0 msgr2=0x7f64480a3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:57.224 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:45:57.233 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:45:57.715 INFO:tasks.workunit.client.0.smithi084.stderr:Note: checking out '07713629e135b47dc5ec2a85f60649826e17a6cd'. 2020-01-16T05:45:57.715 INFO:tasks.workunit.client.0.smithi084.stderr: 2020-01-16T05:45:57.715 INFO:tasks.workunit.client.0.smithi084.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-01-16T05:45:57.715 INFO:tasks.workunit.client.0.smithi084.stderr:changes and commit them, and you can discard any commits you make in this 2020-01-16T05:45:57.716 INFO:tasks.workunit.client.0.smithi084.stderr:state without impacting any branches by performing another checkout. 2020-01-16T05:45:57.716 INFO:tasks.workunit.client.0.smithi084.stderr: 2020-01-16T05:45:57.716 INFO:tasks.workunit.client.0.smithi084.stderr:If you want to create a new branch to retain commits you create, you may 2020-01-16T05:45:57.716 INFO:tasks.workunit.client.0.smithi084.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-01-16T05:45:57.716 INFO:tasks.workunit.client.0.smithi084.stderr: 2020-01-16T05:45:57.716 INFO:tasks.workunit.client.0.smithi084.stderr: git checkout -b 2020-01-16T05:45:57.716 INFO:tasks.workunit.client.0.smithi084.stderr: 2020-01-16T05:45:57.717 INFO:tasks.workunit.client.0.smithi084.stderr:HEAD is now at 07713629e1 Merge PR #30969 into wip-pdonnell-testing-20200116.003219 2020-01-16T05:45:57.720 INFO:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-01-16T05:45:57.727 INFO:tasks.workunit.client.0.smithi084.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-01-16T05:45:57.730 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-01-16T05:45:57.730 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-01-16T05:45:58.460 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-01-16T05:45:58.566 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-01-16T05:45:58.626 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-01-16T05:45:58.628 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-01-16T05:45:58.628 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-01-16T05:45:58.682 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-01-16T05:45:58.740 DEBUG:teuthology.orchestra.remote:smithi084:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2020-01-16T05:45:58.751 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2020-01-16T05:45:58.751 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2020-01-16T05:45:58.751 INFO:teuthology.orchestra.run.smithi084:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=07713629e135b47dc5ec2a85f60649826e17a6cd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2020-01-16T05:45:59.234 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:45:59.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.344+0000 7fd6a7a8e700 1 Processor -- start 2020-01-16T05:45:59.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.344+0000 7fd6a7a8e700 1 -- start start 2020-01-16T05:45:59.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.344+0000 7fd6a7a8e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd6a00a2f60 0x7fd6a005b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:45:59.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.344+0000 7fd6a7a8e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a007cd60 con 0x7fd6a008fd80 2020-01-16T05:45:59.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.344+0000 7fd6a7a8e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a00a9420 con 0x7fd6a00a8ff0 2020-01-16T05:45:59.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.344+0000 7fd6a7a8e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a00a3390 con 0x7fd6a00a2f60 2020-01-16T05:45:59.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.344+0000 7fd6a682c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd6a008fd80 0x7fd6a01503f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52600/0 (socket says 172.21.15.84:52600) 2020-01-16T05:45:59.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.344+0000 7fd6a682c700 1 -- 172.21.15.84:0/128159198 learned_addr learned my addr 172.21.15.84:0/128159198 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:45:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.344+0000 7fd6a602b700 1 --2- 172.21.15.84:0/128159198 >> v2:172.21.15.142:3300/0 conn(0x7fd6a00a2f60 0x7fd6a005b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a5029700 1 -- 172.21.15.84:0/128159198 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912025315 0 0) 0x7fd6a007cd60 con 0x7fd6a008fd80 2020-01-16T05:45:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a5029700 1 -- 172.21.15.84:0/128159198 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd688003230 con 0x7fd6a008fd80 2020-01-16T05:45:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a5029700 1 -- 172.21.15.84:0/128159198 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2861805616 0 0) 0x7fd688003230 con 0x7fd6a008fd80 2020-01-16T05:45:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a602b700 1 -- 172.21.15.84:0/128159198 >> v1:172.21.15.142:6789/0 conn(0x7fd6a00a8ff0 legacy=0x7fd6a007c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:59.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a602b700 1 -- 172.21.15.84:0/128159198 >> v1:172.21.15.84:6789/0 conn(0x7fd6a008fd80 legacy=0x7fd6a01503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:59.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a602b700 1 -- 172.21.15.84:0/128159198 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a008f570 con 0x7fd6a00a2f60 2020-01-16T05:45:59.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a602b700 1 --2- 172.21.15.84:0/128159198 >> v2:172.21.15.142:3300/0 conn(0x7fd6a00a2f60 0x7fd6a005b0f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd690001950 tx=0x7fd690001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:59.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a602b700 1 --2- 172.21.15.84:0/128159198 >> v2:172.21.15.142:3300/0 conn(0x7fd6a00a2f60 0x7fd6a005b0f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd690001950 tx=0x7fd690001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:59.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a602b700 1 --2- 172.21.15.84:0/128159198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6a00a2f60 0x7fd6a005b0f0 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7fd690001950 tx=0x7fd690001990).ready entity=mon.1 client_cookie=109e028d28fb3674 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:59.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a602b700 1 --2- 172.21.15.84:0/128159198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6a00a2f60 0x7fd6a005b0f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fd690001950 tx=0x7fd690001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:59.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a5029700 1 -- 172.21.15.84:0/128159198 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd690001750 con 0x7fd6a00a2f60 2020-01-16T05:45:59.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a602b700 1 --2- 172.21.15.84:0/128159198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6a00a2f60 0x7fd6a005b0f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fd690001950 tx=0x7fd690001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:59.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a602b700 1 --2- 172.21.15.84:0/128159198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6a00a2f60 0x7fd6a005b0f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fd690001950 tx=0x7fd690001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:59.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a5029700 1 -- 172.21.15.84:0/128159198 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd690001560 con 0x7fd6a00a2f60 2020-01-16T05:45:59.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a5029700 1 -- 172.21.15.84:0/128159198 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd698010de0 con 0x7fd6a00a2f60 2020-01-16T05:45:59.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a7a8e700 1 -- 172.21.15.84:0/128159198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6a00a2f60 msgr2=0x7fd6a005b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:59.357 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a7a8e700 1 --2- 172.21.15.84:0/128159198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6a00a2f60 0x7fd6a005b0f0 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7fd690001950 tx=0x7fd690001990).stop 2020-01-16T05:45:59.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a7a8e700 1 -- 172.21.15.84:0/128159198 shutdown_connections 2020-01-16T05:45:59.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a7a8e700 1 --2- 172.21.15.84:0/128159198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6a00a2f60 0x7fd6a005b0f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:59.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a7a8e700 1 -- 172.21.15.84:0/128159198 shutdown_connections 2020-01-16T05:45:59.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a7a8e700 1 -- 172.21.15.84:0/128159198 wait complete. 2020-01-16T05:45:59.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.348+0000 7fd6a7a8e700 1 -- 172.21.15.84:0/128159198 >> 172.21.15.84:0/128159198 conn(0x7fd6a00abc10 msgr2=0x7fd6a005a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:59.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a7a8e700 1 Processor -- start 2020-01-16T05:45:59.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a7a8e700 1 -- start start 2020-01-16T05:45:59.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a7a8e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a007cfb0 0x7fd6a01335c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:59.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a7a8e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd6a007bae0 0x7fd6a007bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:59.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a7a8e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a0099720 con 0x7fd6a01499b0 2020-01-16T05:45:59.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a7a8e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a007d3e0 con 0x7fd6a007bae0 2020-01-16T05:45:59.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a7a8e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a0132de0 con 0x7fd6a007cfb0 2020-01-16T05:45:59.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a582a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a007cfb0 0x7fd6a01335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:59.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a682c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd6a007bae0 0x7fd6a007bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:59.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a582a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a007cfb0 0x7fd6a01335c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:47650/0 (socket says 172.21.15.84:47650) 2020-01-16T05:45:59.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a582a700 1 -- 172.21.15.84:0/1161775425 learned_addr learned my addr 172.21.15.84:0/1161775425 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:45:59.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd69effd700 1 -- 172.21.15.84:0/1161775425 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279908021 0 0) 0x7fd6a0099720 con 0x7fd6a01499b0 2020-01-16T05:45:59.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a582a700 1 -- 172.21.15.84:0/1161775425 >> v2:172.21.15.142:3300/0 conn(0x7fd6a007bae0 msgr2=0x7fd6a007bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:59.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a582a700 1 --2- 172.21.15.84:0/1161775425 >> v2:172.21.15.142:3300/0 conn(0x7fd6a007bae0 0x7fd6a007bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:59.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a582a700 1 -- 172.21.15.84:0/1161775425 >> v1:172.21.15.142:6789/0 conn(0x7fd6a01499b0 legacy=0x7fd6a007eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:59.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a582a700 1 -- 172.21.15.84:0/1161775425 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a0133b10 con 0x7fd6a007cfb0 2020-01-16T05:45:59.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a582a700 1 --2- 172.21.15.84:0/1161775425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a007cfb0 0x7fd6a01335c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd694000b80 tx=0x7fd694010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:59.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a582a700 1 --2- 172.21.15.84:0/1161775425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a007cfb0 0x7fd6a01335c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd694000b80 tx=0x7fd694010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:59.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a582a700 1 --2- 172.21.15.84:0/1161775425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a007cfb0 0x7fd6a01335c0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fd694000b80 tx=0x7fd694010b20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:59.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a582a700 1 --2- 172.21.15.84:0/1161775425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a007cfb0 0x7fd6a01335c0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fd694000b80 tx=0x7fd694010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:59.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd69effd700 1 -- 172.21.15.84:0/1161775425 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd69400ca10 con 0x7fd6a007cfb0 2020-01-16T05:45:59.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a582a700 1 --2- 172.21.15.84:0/1161775425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a007cfb0 0x7fd6a01335c0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fd694000b80 tx=0x7fd694010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:59.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd6a582a700 1 --2- 172.21.15.84:0/1161775425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a007cfb0 0x7fd6a01335c0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fd694000b80 tx=0x7fd694010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:59.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.352+0000 7fd69effd700 1 -- 172.21.15.84:0/1161775425 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69400c630 con 0x7fd6a007cfb0 2020-01-16T05:45:59.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.356+0000 7fd6a7a8e700 1 -- 172.21.15.84:0/1161775425 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a013a0b0 con 0x7fd6a007cfb0 2020-01-16T05:45:59.364 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.356+0000 7fd69effd700 1 -- 172.21.15.84:0/1161775425 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6940121e0 con 0x7fd6a007cfb0 2020-01-16T05:45:59.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.356+0000 7fd6a7a8e700 1 -- 172.21.15.84:0/1161775425 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a013a660 con 0x7fd6a007cfb0 2020-01-16T05:45:59.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.356+0000 7fd6a582a700 1 --2- 172.21.15.84:0/1161775425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a007cfb0 0x7fd6a01335c0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fd694000b80 tx=0x7fd694010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:59.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.356+0000 7fd6a7a8e700 1 -- 172.21.15.84:0/1161775425 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a005e1c0 con 0x7fd6a007cfb0 2020-01-16T05:45:59.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.356+0000 7fd69effd700 1 -- 172.21.15.84:0/1161775425 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fd6940064e0 con 0x7fd6a007cfb0 2020-01-16T05:45:59.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.356+0000 7fd6a582a700 1 --2- 172.21.15.84:0/1161775425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a007cfb0 0x7fd6a01335c0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fd694000b80 tx=0x7fd694010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:59.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.356+0000 7fd69effd700 1 --2- 172.21.15.84:0/1161775425 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd68003c1e0 0x7fd68003e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:45:59.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.356+0000 7fd69effd700 1 -- 172.21.15.84:0/1161775425 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fd69404c710 con 0x7fd6a007cfb0 2020-01-16T05:45:59.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.356+0000 7fd6a602b700 1 --2- 172.21.15.84:0/1161775425 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd68003c1e0 0x7fd68003e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:45:59.367 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.356+0000 7fd6a602b700 1 --2- 172.21.15.84:0/1161775425 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd68003c1e0 0x7fd68003e6f0 crc :-1 s=READY pgs=127 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:45:59.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.368+0000 7fd6a582a700 1 --2- 172.21.15.84:0/1161775425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a007cfb0 0x7fd6a01335c0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fd694000b80 tx=0x7fd694010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:59.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.368+0000 7fd69effd700 1 -- 172.21.15.84:0/1161775425 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fd694032d30 con 0x7fd6a007cfb0 2020-01-16T05:45:59.508 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.508+0000 7fd6a7a8e700 1 -- 172.21.15.84:0/1161775425 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6a008f350 con 0x7fd6a007cfb0 2020-01-16T05:45:59.509 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.508+0000 7fd6a582a700 1 --2- 172.21.15.84:0/1161775425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a007cfb0 0x7fd6a01335c0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fd694000b80 tx=0x7fd694010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:45:59.510 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.508+0000 7fd69effd700 1 -- 172.21.15.84:0/1161775425 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fd694032f90 con 0x7fd6a007cfb0 2020-01-16T05:45:59.510 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:45:59.510 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:45:59.512 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.512+0000 7fd6a7a8e700 1 -- 172.21.15.84:0/1161775425 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd68003c1e0 msgr2=0x7fd68003e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:59.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.512+0000 7fd6a7a8e700 1 --2- 172.21.15.84:0/1161775425 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd68003c1e0 0x7fd68003e6f0 crc :-1 s=READY pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:59.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.512+0000 7fd6a7a8e700 1 -- 172.21.15.84:0/1161775425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a007cfb0 msgr2=0x7fd6a01335c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:45:59.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.512+0000 7fd6a7a8e700 1 --2- 172.21.15.84:0/1161775425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a007cfb0 0x7fd6a01335c0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fd694000b80 tx=0x7fd694010b20).stop 2020-01-16T05:45:59.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.512+0000 7fd6a7a8e700 1 -- 172.21.15.84:0/1161775425 shutdown_connections 2020-01-16T05:45:59.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.512+0000 7fd6a7a8e700 1 --2- 172.21.15.84:0/1161775425 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd68003c1e0 0x7fd68003e6f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:59.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.512+0000 7fd6a7a8e700 1 --2- 172.21.15.84:0/1161775425 >> v2:172.21.15.142:3300/0 conn(0x7fd6a007bae0 0x7fd6a007bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:59.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.512+0000 7fd6a7a8e700 1 --2- 172.21.15.84:0/1161775425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a007cfb0 0x7fd6a01335c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:45:59.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.512+0000 7fd6a7a8e700 1 -- 172.21.15.84:0/1161775425 shutdown_connections 2020-01-16T05:45:59.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.512+0000 7fd6a7a8e700 1 -- 172.21.15.84:0/1161775425 wait complete. 2020-01-16T05:45:59.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:45:59.512+0000 7fd6a7a8e700 1 -- 172.21.15.84:0/1161775425 >> 172.21.15.84:0/1161775425 conn(0x7fd6a00a75b0 msgr2=0x7fd6a008fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:45:59.515 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:45:59.529 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:01.530 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:01.651 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.644+0000 7f9bbbfff700 1 Processor -- start 2020-01-16T05:46:01.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.644+0000 7f9bbbfff700 1 -- start start 2020-01-16T05:46:01.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbbfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc07ff10 0x7f9bbc0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:01.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbbfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9bbc0a4250 0x7f9bbc066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:01.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbbfff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bbc066dd0 con 0x7f9bbc0a9b30 2020-01-16T05:46:01.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbbfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc0a4830 con 0x7f9bbc0a4250 2020-01-16T05:46:01.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbbfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc07f9d0 con 0x7f9bbc07ff10 2020-01-16T05:46:01.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbaffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc07ff10 0x7f9bbc0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:01.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bc1874700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9bbc0a4250 0x7f9bbc066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:01.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbaffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc07ff10 0x7f9bbc0abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:47658/0 (socket says 172.21.15.84:47658) 2020-01-16T05:46:01.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbaffd700 1 -- 172.21.15.84:0/2872472317 learned_addr learned my addr 172.21.15.84:0/2872472317 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:01.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbb7fe700 1 --1- 172.21.15.84:0/2872472317 >> v1:172.21.15.142:6789/0 conn(0x7f9bbc0a9b30 0x7f9bbc0a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:50838/0 (socket says 172.21.15.84:50838) 2020-01-16T05:46:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbaffd700 1 -- 172.21.15.84:0/2872472317 >> v2:172.21.15.142:3300/0 conn(0x7f9bbc0a4250 msgr2=0x7f9bbc066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbaffd700 1 --2- 172.21.15.84:0/2872472317 >> v2:172.21.15.142:3300/0 conn(0x7f9bbc0a4250 0x7f9bbc066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbaffd700 1 -- 172.21.15.84:0/2872472317 >> v1:172.21.15.142:6789/0 conn(0x7f9bbc0a9b30 legacy=0x7f9bbc0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbaffd700 1 -- 172.21.15.84:0/2872472317 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc150ce0 con 0x7f9bbc07ff10 2020-01-16T05:46:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbaffd700 1 --2- 172.21.15.84:0/2872472317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc07ff10 0x7f9bbc0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9bb0008910 tx=0x7f9bb000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbaffd700 1 --2- 172.21.15.84:0/2872472317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc07ff10 0x7f9bbc0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9bb0008910 tx=0x7f9bb000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbaffd700 1 --2- 172.21.15.84:0/2872472317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc07ff10 0x7f9bbc0abdd0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f9bb0008910 tx=0x7f9bb000feb0).ready entity=mon.2 client_cookie=6660008038035641 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbaffd700 1 --2- 172.21.15.84:0/2872472317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc07ff10 0x7f9bbc0abdd0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f9bb0008910 tx=0x7f9bb000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbaffd700 1 --2- 172.21.15.84:0/2872472317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc07ff10 0x7f9bbc0abdd0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f9bb0008910 tx=0x7f9bb000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bba7fc700 1 -- 172.21.15.84:0/2872472317 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bb0011720 con 0x7f9bbc07ff10 2020-01-16T05:46:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbaffd700 1 --2- 172.21.15.84:0/2872472317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc07ff10 0x7f9bbc0abdd0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f9bb0008910 tx=0x7f9bb000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bba7fc700 1 -- 172.21.15.84:0/2872472317 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb0008d30 con 0x7f9bbc07ff10 2020-01-16T05:46:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bba7fc700 1 -- 172.21.15.84:0/2872472317 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bb0011d00 con 0x7f9bbc07ff10 2020-01-16T05:46:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbbfff700 1 -- 172.21.15.84:0/2872472317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc07ff10 msgr2=0x7f9bbc0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbbfff700 1 --2- 172.21.15.84:0/2872472317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc07ff10 0x7f9bbc0abdd0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f9bb0008910 tx=0x7f9bb000feb0).stop 2020-01-16T05:46:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbbfff700 1 -- 172.21.15.84:0/2872472317 shutdown_connections 2020-01-16T05:46:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbbfff700 1 --2- 172.21.15.84:0/2872472317 >> v2:172.21.15.142:3300/0 conn(0x7f9bbc0a4250 0x7f9bbc066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbbfff700 1 --2- 172.21.15.84:0/2872472317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc07ff10 0x7f9bbc0abdd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbbfff700 1 -- 172.21.15.84:0/2872472317 shutdown_connections 2020-01-16T05:46:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbbfff700 1 -- 172.21.15.84:0/2872472317 wait complete. 2020-01-16T05:46:01.657 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.648+0000 7f9bbbfff700 1 -- 172.21.15.84:0/2872472317 >> 172.21.15.84:0/2872472317 conn(0x7f9bbc0acfc0 msgr2=0x7f9bbc0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:01.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbbfff700 1 Processor -- start 2020-01-16T05:46:01.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbbfff700 1 -- start start 2020-01-16T05:46:01.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbbfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc123660 0x7f9bbc07cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:01.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbbfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9bbc07d110 0x7f9bbc124020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:01.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbbfff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bbc091d60 con 0x7f9bbc090af0 2020-01-16T05:46:01.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbbfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc091630 con 0x7f9bbc07d110 2020-01-16T05:46:01.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbbfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc0a05e0 con 0x7f9bbc123660 2020-01-16T05:46:01.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbb7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc123660 0x7f9bbc07cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:01.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbaffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9bbc07d110 0x7f9bbc124020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:01.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bc1874700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9bbc090af0 0x7f9bbc07e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:50848/0 (socket says 172.21.15.84:50848) 2020-01-16T05:46:01.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bc1874700 1 -- 172.21.15.84:0/3877256672 learned_addr learned my addr 172.21.15.84:0/3877256672 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:01.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9ba3fff700 1 -- 172.21.15.84:0/3877256672 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282258187 0 0) 0x7f9bbc091d60 con 0x7f9bbc090af0 2020-01-16T05:46:01.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9ba3fff700 1 -- 172.21.15.84:0/3877256672 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b9c003230 con 0x7f9bbc090af0 2020-01-16T05:46:01.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbaffd700 1 -- 172.21.15.84:0/3877256672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc123660 msgr2=0x7f9bbc07cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:01.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbaffd700 1 --2- 172.21.15.84:0/3877256672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc123660 0x7f9bbc07cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:01.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbaffd700 1 -- 172.21.15.84:0/3877256672 >> v1:172.21.15.142:6789/0 conn(0x7f9bbc090af0 legacy=0x7f9bbc07e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:01.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbaffd700 1 -- 172.21.15.84:0/3877256672 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc09fce0 con 0x7f9bbc07d110 2020-01-16T05:46:01.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbaffd700 1 --2- 172.21.15.84:0/3877256672 >> v2:172.21.15.142:3300/0 conn(0x7f9bbc07d110 0x7f9bbc124020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9bb0008910 tx=0x7f9bb00117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:01.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbaffd700 1 --2- 172.21.15.84:0/3877256672 >> v2:172.21.15.142:3300/0 conn(0x7f9bbc07d110 0x7f9bbc124020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9bb0008910 tx=0x7f9bb00117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:01.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbaffd700 1 --2- 172.21.15.84:0/3877256672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bbc07d110 0x7f9bbc124020 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f9bb0008910 tx=0x7f9bb00117e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:01.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbaffd700 1 --2- 172.21.15.84:0/3877256672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bbc07d110 0x7f9bbc124020 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f9bb0008910 tx=0x7f9bb00117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:01.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9ba3fff700 1 -- 172.21.15.84:0/3877256672 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bb000f700 con 0x7f9bbc07d110 2020-01-16T05:46:01.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbaffd700 1 --2- 172.21.15.84:0/3877256672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bbc07d110 0x7f9bbc124020 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f9bb0008910 tx=0x7f9bb00117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:01.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbaffd700 1 --2- 172.21.15.84:0/3877256672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bbc07d110 0x7f9bbc124020 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f9bb0008910 tx=0x7f9bb00117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:01.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9ba3fff700 1 -- 172.21.15.84:0/3877256672 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb0011920 con 0x7f9bbc07d110 2020-01-16T05:46:01.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9ba3fff700 1 -- 172.21.15.84:0/3877256672 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bb0007530 con 0x7f9bbc07d110 2020-01-16T05:46:01.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbbfff700 1 -- 172.21.15.84:0/3877256672 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc090540 con 0x7f9bbc07d110 2020-01-16T05:46:01.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.652+0000 7f9bbbfff700 1 -- 172.21.15.84:0/3877256672 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc0a0dc0 con 0x7f9bbc07d110 2020-01-16T05:46:01.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.656+0000 7f9bbaffd700 1 --2- 172.21.15.84:0/3877256672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bbc07d110 0x7f9bbc124020 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f9bb0008910 tx=0x7f9bb00117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:01.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.656+0000 7f9bbbfff700 1 -- 172.21.15.84:0/3877256672 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bbc05e1c0 con 0x7f9bbc07d110 2020-01-16T05:46:01.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.656+0000 7f9ba3fff700 1 -- 172.21.15.84:0/3877256672 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f9bb00056c0 con 0x7f9bbc07d110 2020-01-16T05:46:01.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.656+0000 7f9bbaffd700 1 --2- 172.21.15.84:0/3877256672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bbc07d110 0x7f9bbc124020 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f9bb0008910 tx=0x7f9bb00117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:01.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.656+0000 7f9ba3fff700 1 --2- 172.21.15.84:0/3877256672 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9b9c03c820 0x7f9b9c03ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:01.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.656+0000 7f9ba3fff700 1 -- 172.21.15.84:0/3877256672 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f9bb004cdb0 con 0x7f9bbc07d110 2020-01-16T05:46:01.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.656+0000 7f9bbb7fe700 1 --2- 172.21.15.84:0/3877256672 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9b9c03c820 0x7f9b9c03ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:01.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.656+0000 7f9bbb7fe700 1 --2- 172.21.15.84:0/3877256672 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9b9c03c820 0x7f9b9c03ed30 crc :-1 s=READY pgs=128 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:01.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.664+0000 7f9bbaffd700 1 --2- 172.21.15.84:0/3877256672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bbc07d110 0x7f9bbc124020 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f9bb0008910 tx=0x7f9bb00117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.664+0000 7f9ba3fff700 1 -- 172.21.15.84:0/3877256672 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f9bbc090540 con 0x7f9bbc07d110 2020-01-16T05:46:01.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.816+0000 7f9bbbfff700 1 -- 172.21.15.84:0/3877256672 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bbc0a03c0 con 0x7f9bbc07d110 2020-01-16T05:46:01.818 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.816+0000 7f9bbaffd700 1 --2- 172.21.15.84:0/3877256672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bbc07d110 0x7f9bbc124020 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f9bb0008910 tx=0x7f9bb00117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:01.818 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.816+0000 7f9ba3fff700 1 -- 172.21.15.84:0/3877256672 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f9bbc09fce0 con 0x7f9bbc07d110 2020-01-16T05:46:01.818 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:01.818 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:01.820 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.816+0000 7f9bbbfff700 1 -- 172.21.15.84:0/3877256672 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9b9c03c820 msgr2=0x7f9b9c03ed30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:01.820 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.816+0000 7f9bbbfff700 1 --2- 172.21.15.84:0/3877256672 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9b9c03c820 0x7f9b9c03ed30 crc :-1 s=READY pgs=128 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:01.820 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.816+0000 7f9bbbfff700 1 -- 172.21.15.84:0/3877256672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bbc07d110 msgr2=0x7f9bbc124020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:01.820 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.816+0000 7f9bbbfff700 1 --2- 172.21.15.84:0/3877256672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bbc07d110 0x7f9bbc124020 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f9bb0008910 tx=0x7f9bb00117e0).stop 2020-01-16T05:46:01.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.816+0000 7f9bbbfff700 1 -- 172.21.15.84:0/3877256672 shutdown_connections 2020-01-16T05:46:01.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.816+0000 7f9bbbfff700 1 --2- 172.21.15.84:0/3877256672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc123660 0x7f9bbc07cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:01.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.816+0000 7f9bbbfff700 1 --2- 172.21.15.84:0/3877256672 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9b9c03c820 0x7f9b9c03ed30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:01.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.816+0000 7f9bbbfff700 1 --2- 172.21.15.84:0/3877256672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bbc07d110 0x7f9bbc124020 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:01.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.816+0000 7f9bbbfff700 1 -- 172.21.15.84:0/3877256672 shutdown_connections 2020-01-16T05:46:01.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.816+0000 7f9bbbfff700 1 -- 172.21.15.84:0/3877256672 wait complete. 2020-01-16T05:46:01.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:01.820+0000 7f9bbbfff700 1 -- 172.21.15.84:0/3877256672 >> 172.21.15.84:0/3877256672 conn(0x7f9bbc0a4b80 msgr2=0x7f9bbc024ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:01.822 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:01.832 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:46:02.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~96s 2020-01-16T05:46:03.836 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:03.960 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e98ae700 1 Processor -- start 2020-01-16T05:46:03.961 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e98ae700 1 -- start start 2020-01-16T05:46:03.961 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e98ae700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f50e40a9b30 0x7f50e40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:03.961 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e98ae700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e40a4250 0x7f50e4066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:03.961 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e98ae700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e4066dd0 con 0x7f50e407ff10 2020-01-16T05:46:03.961 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e98ae700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e40a4830 con 0x7f50e40a9b30 2020-01-16T05:46:03.961 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e98ae700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e407f9d0 con 0x7f50e40a4250 2020-01-16T05:46:03.961 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e90ad700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f50e40a9b30 0x7f50e40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:03.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e90ad700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f50e40a9b30 0x7f50e40abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35428/0 (socket says 172.21.15.84:35428) 2020-01-16T05:46:03.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e90ad700 1 -- 172.21.15.84:0/4131454371 learned_addr learned my addr 172.21.15.84:0/4131454371 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:03.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e88ac700 1 --1- 172.21.15.84:0/4131454371 >> v1:172.21.15.84:6789/0 conn(0x7f50e407ff10 0x7f50e40a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52630/0 (socket says 172.21.15.84:52630) 2020-01-16T05:46:03.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50eab10700 1 --2- 172.21.15.84:0/4131454371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e40a4250 0x7f50e4066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:03.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e90ad700 1 -- 172.21.15.84:0/4131454371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e40a4250 msgr2=0x7f50e4066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:03.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e90ad700 1 --2- 172.21.15.84:0/4131454371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e40a4250 0x7f50e4066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:03.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e90ad700 1 -- 172.21.15.84:0/4131454371 >> v1:172.21.15.84:6789/0 conn(0x7f50e407ff10 legacy=0x7f50e40a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:03.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e90ad700 1 -- 172.21.15.84:0/4131454371 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e4150ce0 con 0x7f50e40a9b30 2020-01-16T05:46:03.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50eab10700 1 --2- 172.21.15.84:0/4131454371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e40a4250 0x7f50e4066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-01-16T05:46:03.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e90ad700 1 --2- 172.21.15.84:0/4131454371 >> v2:172.21.15.84:3300/0 conn(0x7f50e40a9b30 0x7f50e40abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f50e40a49f0 tx=0x7f50dc010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:03.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e90ad700 1 --2- 172.21.15.84:0/4131454371 >> v2:172.21.15.84:3300/0 conn(0x7f50e40a9b30 0x7f50e40abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f50e40a49f0 tx=0x7f50dc010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:03.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e90ad700 1 --2- 172.21.15.84:0/4131454371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50e40a9b30 0x7f50e40abdd0 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7f50e40a49f0 tx=0x7f50dc010230).ready entity=mon.0 client_cookie=dd44922f8ca44555 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:03.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e90ad700 1 --2- 172.21.15.84:0/4131454371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50e40a9b30 0x7f50e40abdd0 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f50e40a49f0 tx=0x7f50dc010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:03.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50dbfff700 1 -- 172.21.15.84:0/4131454371 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50dc00a160 con 0x7f50e40a9b30 2020-01-16T05:46:03.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e90ad700 1 --2- 172.21.15.84:0/4131454371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50e40a9b30 0x7f50e40abdd0 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f50e40a49f0 tx=0x7f50dc010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:03.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50dbfff700 1 -- 172.21.15.84:0/4131454371 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc011bb0 con 0x7f50e40a9b30 2020-01-16T05:46:03.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e90ad700 1 --2- 172.21.15.84:0/4131454371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50e40a9b30 0x7f50e40abdd0 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f50e40a49f0 tx=0x7f50dc010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:03.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50dbfff700 1 -- 172.21.15.84:0/4131454371 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50dc00a740 con 0x7f50e40a9b30 2020-01-16T05:46:03.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e98ae700 1 -- 172.21.15.84:0/4131454371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50e40a9b30 msgr2=0x7f50e40abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:03.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e98ae700 1 --2- 172.21.15.84:0/4131454371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50e40a9b30 0x7f50e40abdd0 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7f50e40a49f0 tx=0x7f50dc010230).stop 2020-01-16T05:46:03.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e98ae700 1 -- 172.21.15.84:0/4131454371 shutdown_connections 2020-01-16T05:46:03.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e98ae700 1 --2- 172.21.15.84:0/4131454371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e40a4250 0x7f50e4066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:03.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e98ae700 1 --2- 172.21.15.84:0/4131454371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50e40a9b30 0x7f50e40abdd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:03.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e98ae700 1 -- 172.21.15.84:0/4131454371 shutdown_connections 2020-01-16T05:46:03.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e98ae700 1 -- 172.21.15.84:0/4131454371 wait complete. 2020-01-16T05:46:03.966 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.956+0000 7f50e98ae700 1 -- 172.21.15.84:0/4131454371 >> 172.21.15.84:0/4131454371 conn(0x7f50e40acfc0 msgr2=0x7f50e40a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:03.968 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.960+0000 7f50e98ae700 1 Processor -- start 2020-01-16T05:46:03.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.960+0000 7f50e98ae700 1 -- start start 2020-01-16T05:46:03.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.960+0000 7f50e98ae700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e405bef0 0x7f50e407a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:03.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e98ae700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f50e41355a0 0x7f50e409f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:03.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e98ae700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e4079740 con 0x7f50e409eea0 2020-01-16T05:46:03.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e98ae700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e4079970 con 0x7f50e41355a0 2020-01-16T05:46:03.970 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e98ae700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e407ae40 con 0x7f50e405bef0 2020-01-16T05:46:03.970 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e90ad700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e405bef0 0x7f50e407a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:03.970 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e90ad700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e405bef0 0x7f50e407a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:47678/0 (socket says 172.21.15.84:47678) 2020-01-16T05:46:03.970 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e90ad700 1 -- 172.21.15.84:0/238611324 learned_addr learned my addr 172.21.15.84:0/238611324 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:03.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50eab10700 1 --2- 172.21.15.84:0/238611324 >> v2:172.21.15.142:3300/0 conn(0x7f50e41355a0 0x7f50e409f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:03.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e90ad700 1 -- 172.21.15.84:0/238611324 >> v2:172.21.15.142:3300/0 conn(0x7f50e41355a0 msgr2=0x7f50e409f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:03.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e90ad700 1 --2- 172.21.15.84:0/238611324 >> v2:172.21.15.142:3300/0 conn(0x7f50e41355a0 0x7f50e409f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:03.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e90ad700 1 -- 172.21.15.84:0/238611324 >> v1:172.21.15.142:6789/0 conn(0x7f50e409eea0 legacy=0x7f50e4134da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:03.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e90ad700 1 -- 172.21.15.84:0/238611324 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e413d080 con 0x7f50e405bef0 2020-01-16T05:46:03.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e90ad700 1 --2- 172.21.15.84:0/238611324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e405bef0 0x7f50e407a810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f50e40a49f0 tx=0x7f50dc00ad10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:03.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e90ad700 1 --2- 172.21.15.84:0/238611324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e405bef0 0x7f50e407a810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f50e40a49f0 tx=0x7f50dc00ad10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:03.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e90ad700 1 --2- 172.21.15.84:0/238611324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e405bef0 0x7f50e407a810 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f50e40a49f0 tx=0x7f50dc00ad10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:03.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e90ad700 1 --2- 172.21.15.84:0/238611324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e405bef0 0x7f50e407a810 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f50e40a49f0 tx=0x7f50dc00ad10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:03.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50d9ffb700 1 -- 172.21.15.84:0/238611324 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50dc005c30 con 0x7f50e405bef0 2020-01-16T05:46:03.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e90ad700 1 --2- 172.21.15.84:0/238611324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e405bef0 0x7f50e407a810 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f50e40a49f0 tx=0x7f50dc00ad10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:03.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50d9ffb700 1 -- 172.21.15.84:0/238611324 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc00a360 con 0x7f50e405bef0 2020-01-16T05:46:03.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e90ad700 1 --2- 172.21.15.84:0/238611324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e405bef0 0x7f50e407a810 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f50e40a49f0 tx=0x7f50dc00ad10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:03.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50d9ffb700 1 -- 172.21.15.84:0/238611324 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50dc00f950 con 0x7f50e405bef0 2020-01-16T05:46:03.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e98ae700 1 -- 172.21.15.84:0/238611324 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e413c070 con 0x7f50e405bef0 2020-01-16T05:46:03.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e98ae700 1 -- 172.21.15.84:0/238611324 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e413c400 con 0x7f50e405bef0 2020-01-16T05:46:03.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e90ad700 1 --2- 172.21.15.84:0/238611324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e405bef0 0x7f50e407a810 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f50e40a49f0 tx=0x7f50dc00ad10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:03.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e98ae700 1 -- 172.21.15.84:0/238611324 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e405e1c0 con 0x7f50e405bef0 2020-01-16T05:46:03.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50d9ffb700 1 -- 172.21.15.84:0/238611324 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f50dc007150 con 0x7f50e405bef0 2020-01-16T05:46:03.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50e90ad700 1 --2- 172.21.15.84:0/238611324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e405bef0 0x7f50e407a810 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f50e40a49f0 tx=0x7f50dc00ad10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:03.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50d9ffb700 1 --2- 172.21.15.84:0/238611324 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f50c403c210 0x7f50c403e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:03.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.964+0000 7f50d9ffb700 1 -- 172.21.15.84:0/238611324 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f50dc04d8b0 con 0x7f50e405bef0 2020-01-16T05:46:03.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.968+0000 7f50e88ac700 1 --2- 172.21.15.84:0/238611324 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f50c403c210 0x7f50c403e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:03.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.968+0000 7f50e88ac700 1 --2- 172.21.15.84:0/238611324 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f50c403c210 0x7f50c403e720 crc :-1 s=READY pgs=129 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:03.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.976+0000 7f50e90ad700 1 --2- 172.21.15.84:0/238611324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e405bef0 0x7f50e407a810 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f50e40a49f0 tx=0x7f50dc00ad10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:03.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:03.976+0000 7f50d9ffb700 1 -- 172.21.15.84:0/238611324 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f50dc033eb0 con 0x7f50e405bef0 2020-01-16T05:46:04.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:04.128+0000 7f50e98ae700 1 -- 172.21.15.84:0/238611324 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50e40662e0 con 0x7f50e405bef0 2020-01-16T05:46:04.131 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:04.128+0000 7f50e90ad700 1 --2- 172.21.15.84:0/238611324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e405bef0 0x7f50e407a810 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f50e40a49f0 tx=0x7f50dc00ad10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:04.131 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:04.128+0000 7f50d9ffb700 1 -- 172.21.15.84:0/238611324 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f50dc034110 con 0x7f50e405bef0 2020-01-16T05:46:04.132 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:04.132 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:04.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:04.132+0000 7f50e98ae700 1 -- 172.21.15.84:0/238611324 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f50c403c210 msgr2=0x7f50c403e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:04.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:04.132+0000 7f50e98ae700 1 --2- 172.21.15.84:0/238611324 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f50c403c210 0x7f50c403e720 crc :-1 s=READY pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:04.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:04.132+0000 7f50e98ae700 1 -- 172.21.15.84:0/238611324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e405bef0 msgr2=0x7f50e407a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:04.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:04.132+0000 7f50e98ae700 1 --2- 172.21.15.84:0/238611324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e405bef0 0x7f50e407a810 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f50e40a49f0 tx=0x7f50dc00ad10).stop 2020-01-16T05:46:04.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:04.132+0000 7f50e98ae700 1 -- 172.21.15.84:0/238611324 shutdown_connections 2020-01-16T05:46:04.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:04.132+0000 7f50e98ae700 1 --2- 172.21.15.84:0/238611324 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f50c403c210 0x7f50c403e720 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:04.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:04.132+0000 7f50e98ae700 1 --2- 172.21.15.84:0/238611324 >> v2:172.21.15.142:3300/0 conn(0x7f50e41355a0 0x7f50e409f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:04.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:04.132+0000 7f50e98ae700 1 --2- 172.21.15.84:0/238611324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50e405bef0 0x7f50e407a810 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:04.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:04.132+0000 7f50e98ae700 1 -- 172.21.15.84:0/238611324 shutdown_connections 2020-01-16T05:46:04.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:04.132+0000 7f50e98ae700 1 -- 172.21.15.84:0/238611324 wait complete. 2020-01-16T05:46:04.135 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:04.132+0000 7f50e98ae700 1 -- 172.21.15.84:0/238611324 >> 172.21.15.84:0/238611324 conn(0x7f50e40acfc0 msgr2=0x7f50e40246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:04.135 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:04.145 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:06.146 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:06.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13d1e06700 1 Processor -- start 2020-01-16T05:46:06.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13d1e06700 1 -- start start 2020-01-16T05:46:06.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13d1e06700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13cc0a2f60 0x7f13cc05b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:06.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13d1e06700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13cc07cd60 con 0x7f13cc08fd80 2020-01-16T05:46:06.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13d1e06700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13cc0a9420 con 0x7f13cc0a8ff0 2020-01-16T05:46:06.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13d1e06700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc0a3390 con 0x7f13cc0a2f60 2020-01-16T05:46:06.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13d0ba4700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f13cc08fd80 0x7f13cc1503f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52646/0 (socket says 172.21.15.84:52646) 2020-01-16T05:46:06.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13d0ba4700 1 -- 172.21.15.84:0/3594754571 learned_addr learned my addr 172.21.15.84:0/3594754571 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:06.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13cbfff700 1 --2- 172.21.15.84:0/3594754571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13cc0a2f60 0x7f13cc05b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:06.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13caffd700 1 -- 172.21.15.84:0/3594754571 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565462077 0 0) 0x7f13cc07cd60 con 0x7f13cc08fd80 2020-01-16T05:46:06.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13caffd700 1 -- 172.21.15.84:0/3594754571 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13b8003230 con 0x7f13cc08fd80 2020-01-16T05:46:06.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13caffd700 1 -- 172.21.15.84:0/3594754571 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703559917 0 0) 0x7f13cc0a9420 con 0x7f13cc0a8ff0 2020-01-16T05:46:06.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13caffd700 1 -- 172.21.15.84:0/3594754571 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13cc07cd60 con 0x7f13cc0a8ff0 2020-01-16T05:46:06.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13cbfff700 1 -- 172.21.15.84:0/3594754571 >> v1:172.21.15.142:6789/0 conn(0x7f13cc0a8ff0 legacy=0x7f13cc07c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:06.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13cbfff700 1 -- 172.21.15.84:0/3594754571 >> v1:172.21.15.84:6789/0 conn(0x7f13cc08fd80 legacy=0x7f13cc1503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:06.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13cbfff700 1 -- 172.21.15.84:0/3594754571 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc08f570 con 0x7f13cc0a2f60 2020-01-16T05:46:06.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13cbfff700 1 --2- 172.21.15.84:0/3594754571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13cc0a2f60 0x7f13cc05b0f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f13c40032b0 tx=0x7f13c40100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:06.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13cbfff700 1 --2- 172.21.15.84:0/3594754571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13cc0a2f60 0x7f13cc05b0f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f13c40032b0 tx=0x7f13c40100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:06.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13cbfff700 1 --2- 172.21.15.84:0/3594754571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13cc0a2f60 0x7f13cc05b0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f13c40032b0 tx=0x7f13c40100f0).ready entity=mon.2 client_cookie=7f763801d6d70191 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:06.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13cbfff700 1 --2- 172.21.15.84:0/3594754571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13cc0a2f60 0x7f13cc05b0f0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f13c40032b0 tx=0x7f13c40100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:06.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13cbfff700 1 --2- 172.21.15.84:0/3594754571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13cc0a2f60 0x7f13cc05b0f0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f13c40032b0 tx=0x7f13c40100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:06.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13caffd700 1 -- 172.21.15.84:0/3594754571 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13c400a160 con 0x7f13cc0a2f60 2020-01-16T05:46:06.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13cbfff700 1 --2- 172.21.15.84:0/3594754571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13cc0a2f60 0x7f13cc05b0f0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f13c40032b0 tx=0x7f13c40100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:06.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13caffd700 1 -- 172.21.15.84:0/3594754571 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c4011ba0 con 0x7f13cc0a2f60 2020-01-16T05:46:06.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13caffd700 1 -- 172.21.15.84:0/3594754571 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13c400a740 con 0x7f13cc0a2f60 2020-01-16T05:46:06.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13d1e06700 1 -- 172.21.15.84:0/3594754571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13cc0a2f60 msgr2=0x7f13cc05b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:06.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13d1e06700 1 --2- 172.21.15.84:0/3594754571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13cc0a2f60 0x7f13cc05b0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f13c40032b0 tx=0x7f13c40100f0).stop 2020-01-16T05:46:06.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13d1e06700 1 -- 172.21.15.84:0/3594754571 shutdown_connections 2020-01-16T05:46:06.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13d1e06700 1 --2- 172.21.15.84:0/3594754571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13cc0a2f60 0x7f13cc05b0f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:06.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13d1e06700 1 -- 172.21.15.84:0/3594754571 shutdown_connections 2020-01-16T05:46:06.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13d1e06700 1 -- 172.21.15.84:0/3594754571 wait complete. 2020-01-16T05:46:06.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.264+0000 7f13d1e06700 1 -- 172.21.15.84:0/3594754571 >> 172.21.15.84:0/3594754571 conn(0x7f13cc0abc10 msgr2=0x7f13cc05a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:06.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13d1e06700 1 Processor -- start 2020-01-16T05:46:06.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13d1e06700 1 -- start start 2020-01-16T05:46:06.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13d1e06700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f13cc07ec10 0x7f13cc07d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:06.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13d1e06700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13cc0a3550 0x7f13cc0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13d1e06700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13cc0a20b0 con 0x7f13cc09ddc0 2020-01-16T05:46:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13d1e06700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13cc0a48b0 con 0x7f13cc07ec10 2020-01-16T05:46:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13d1e06700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc07f040 con 0x7f13cc0a3550 2020-01-16T05:46:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13cbfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f13cc09ddc0 0x7f13cc0a4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52648/0 (socket says 172.21.15.84:52648) 2020-01-16T05:46:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13cbfff700 1 -- 172.21.15.84:0/3362331214 learned_addr learned my addr 172.21.15.84:0/3362331214 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13cb7fe700 1 --2- 172.21.15.84:0/3362331214 >> v2:172.21.15.142:3300/0 conn(0x7f13cc07ec10 0x7f13cc07d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13d0ba4700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13cc0a3550 0x7f13cc0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:06.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13c8ff9700 1 -- 172.21.15.84:0/3362331214 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808362432 0 0) 0x7f13cc0a20b0 con 0x7f13cc09ddc0 2020-01-16T05:46:06.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13c8ff9700 1 -- 172.21.15.84:0/3362331214 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13b0003230 con 0x7f13cc09ddc0 2020-01-16T05:46:06.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13c8ff9700 1 -- 172.21.15.84:0/3362331214 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 409915485 0 0) 0x7f13b0003230 con 0x7f13cc09ddc0 2020-01-16T05:46:06.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13c8ff9700 1 -- 172.21.15.84:0/3362331214 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f13cc0a20b0 con 0x7f13cc09ddc0 2020-01-16T05:46:06.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13c8ff9700 1 -- 172.21.15.84:0/3362331214 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f13c400a160 con 0x7f13cc09ddc0 2020-01-16T05:46:06.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13c8ff9700 1 -- 172.21.15.84:0/3362331214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13cc0a3550 msgr2=0x7f13cc0a3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:06.280 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13c8ff9700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13cc0a3550 0x7f13cc0a3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:06.281 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13c8ff9700 1 -- 172.21.15.84:0/3362331214 >> v2:172.21.15.142:3300/0 conn(0x7f13cc07ec10 msgr2=0x7f13cc07d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:06.281 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13c8ff9700 1 --2- 172.21.15.84:0/3362331214 >> v2:172.21.15.142:3300/0 conn(0x7f13cc07ec10 0x7f13cc07d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:06.281 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13c8ff9700 1 -- 172.21.15.84:0/3362331214 >> v1:172.21.15.84:6789/0 conn(0x7f13cc09ddc0 legacy=0x7f13cc0a4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:06.281 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13c8ff9700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13b0003a20 0x7f13b0003e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:06.281 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13c8ff9700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13b00045a0 0x7f13b00049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:06.281 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13c8ff9700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b0004f20 0x7f13b000b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:06.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13c8ff9700 1 -- 172.21.15.84:0/3362331214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc0a48b0 con 0x7f13b0004f20 2020-01-16T05:46:06.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13c8ff9700 1 -- 172.21.15.84:0/3362331214 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc07f040 con 0x7f13b00045a0 2020-01-16T05:46:06.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13c8ff9700 1 -- 172.21.15.84:0/3362331214 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b000bdc0 con 0x7f13b0003a20 2020-01-16T05:46:06.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13d0ba4700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b0004f20 0x7f13b000b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:06.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13cb7fe700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13b00045a0 0x7f13b00049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:06.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13cbfff700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13b0003a20 0x7f13b0003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:06.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13d0ba4700 1 -- 172.21.15.84:0/3362331214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13b0003a20 msgr2=0x7f13b0003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:06.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13d0ba4700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13b0003a20 0x7f13b0003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:06.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13d0ba4700 1 -- 172.21.15.84:0/3362331214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13b00045a0 msgr2=0x7f13b00049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:06.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13d0ba4700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13b00045a0 0x7f13b00049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:06.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13d0ba4700 1 -- 172.21.15.84:0/3362331214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc07dd60 con 0x7f13b0004f20 2020-01-16T05:46:06.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13d1e06700 1 -- 172.21.15.84:0/3362331214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13cc0a5310 con 0x7f13b0004f20 2020-01-16T05:46:06.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.268+0000 7f13d0ba4700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b0004f20 0x7f13b000b7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f13bc004520 tx=0x7f13bc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:06.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.272+0000 7f13d1e06700 1 -- 172.21.15.84:0/3362331214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13cc095580 con 0x7f13b0004f20 2020-01-16T05:46:06.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.272+0000 7f13d0ba4700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b0004f20 0x7f13b000b7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f13bc004520 tx=0x7f13bc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:06.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.272+0000 7f13d0ba4700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b0004f20 0x7f13b000b7f0 secure :-1 s=READY pgs=329 cs=0 l=1 rx=0x7f13bc004520 tx=0x7f13bc010b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:06.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.272+0000 7f13d0ba4700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b0004f20 0x7f13b000b7f0 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7f13bc004520 tx=0x7f13bc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:06.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.272+0000 7f13d0ba4700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b0004f20 0x7f13b000b7f0 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7f13bc004520 tx=0x7f13bc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:06.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.272+0000 7f13d0ba4700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b0004f20 0x7f13b000b7f0 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7f13bc004520 tx=0x7f13bc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:06.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.272+0000 7f13d0ba4700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b0004f20 0x7f13b000b7f0 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7f13bc004520 tx=0x7f13bc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:06.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.272+0000 7f13c8ff9700 1 -- 172.21.15.84:0/3362331214 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13bc00c9c0 con 0x7f13b0004f20 2020-01-16T05:46:06.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.272+0000 7f13c8ff9700 1 -- 172.21.15.84:0/3362331214 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc00c5e0 con 0x7f13b0004f20 2020-01-16T05:46:06.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.272+0000 7f13c8ff9700 1 -- 172.21.15.84:0/3362331214 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13bc0045b0 con 0x7f13b0004f20 2020-01-16T05:46:06.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.272+0000 7f13d1e06700 1 -- 172.21.15.84:0/3362331214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13cc05e1c0 con 0x7f13b0004f20 2020-01-16T05:46:06.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.272+0000 7f13c8ff9700 1 -- 172.21.15.84:0/3362331214 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f13bc004830 con 0x7f13b0004f20 2020-01-16T05:46:06.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.272+0000 7f13d0ba4700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b0004f20 0x7f13b000b7f0 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7f13bc004520 tx=0x7f13bc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:06.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.272+0000 7f13c8ff9700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f13b0045060 0x7f13b0047570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:06.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.272+0000 7f13c8ff9700 1 -- 172.21.15.84:0/3362331214 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f13bc04c6d0 con 0x7f13b0004f20 2020-01-16T05:46:06.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.272+0000 7f13cbfff700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f13b0045060 0x7f13b0047570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:06.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.272+0000 7f13cbfff700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f13b0045060 0x7f13b0047570 crc :-1 s=READY pgs=130 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:06.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.280+0000 7f13d0ba4700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b0004f20 0x7f13b000b7f0 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7f13bc004520 tx=0x7f13bc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:06.287 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.280+0000 7f13c8ff9700 1 -- 172.21.15.84:0/3362331214 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f13bc0347a0 con 0x7f13b0004f20 2020-01-16T05:46:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.432+0000 7f13d1e06700 1 -- 172.21.15.84:0/3362331214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13cc08f350 con 0x7f13b0004f20 2020-01-16T05:46:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.432+0000 7f13d0ba4700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b0004f20 0x7f13b000b7f0 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7f13bc004520 tx=0x7f13bc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.432+0000 7f13c8ff9700 1 -- 172.21.15.84:0/3362331214 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f13bc033cc0 con 0x7f13b0004f20 2020-01-16T05:46:06.436 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:06.436 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:06.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.436+0000 7f13d1e06700 1 -- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f13b0045060 msgr2=0x7f13b0047570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:06.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.436+0000 7f13d1e06700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f13b0045060 0x7f13b0047570 crc :-1 s=READY pgs=130 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:06.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.436+0000 7f13d0ba4700 1 -- 172.21.15.84:0/3362331214 reap_dead start 2020-01-16T05:46:06.438 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.436+0000 7f13d1e06700 1 -- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b0004f20 msgr2=0x7f13b000b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:06.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.436+0000 7f13d1e06700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b0004f20 0x7f13b000b7f0 secure :-1 s=READY pgs=329 cs=0 l=1 rx=0x7f13bc004520 tx=0x7f13bc010b60).stop 2020-01-16T05:46:06.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.436+0000 7f13d1e06700 1 -- 172.21.15.84:0/3362331214 shutdown_connections 2020-01-16T05:46:06.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.436+0000 7f13d1e06700 1 --2- 172.21.15.84:0/3362331214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b0004f20 0x7f13b000b7f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:06.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.436+0000 7f13d1e06700 1 -- 172.21.15.84:0/3362331214 shutdown_connections 2020-01-16T05:46:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.436+0000 7f13d1e06700 1 -- 172.21.15.84:0/3362331214 wait complete. 2020-01-16T05:46:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:06.436+0000 7f13d1e06700 1 -- 172.21.15.84:0/3362331214 >> 172.21.15.84:0/3362331214 conn(0x7f13cc0a86a0 msgr2=0x7f13cc0a6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:06.448 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:08.449 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:08.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f02848d2700 1 Processor -- start 2020-01-16T05:46:08.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f02848d2700 1 -- start start 2020-01-16T05:46:08.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f02848d2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f02800a4250 0x7f02800abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:08.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f02848d2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0280066880 con 0x7f028007ff10 2020-01-16T05:46:08.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f02848d2700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0280066ab0 con 0x7f02800a9b30 2020-01-16T05:46:08.577 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f02848d2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02800a4830 con 0x7f02800a4250 2020-01-16T05:46:08.577 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f027f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f028007ff10 0x7f028014dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52668/0 (socket says 172.21.15.84:52668) 2020-01-16T05:46:08.577 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f027f7fe700 1 -- 172.21.15.84:0/1199139163 learned_addr learned my addr 172.21.15.84:0/1199139163 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:08.577 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f0285b34700 1 --2- 172.21.15.84:0/1199139163 >> v2:172.21.15.84:3300/0 conn(0x7f02800a4250 0x7f02800abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:08.577 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f0285b34700 1 -- 172.21.15.84:0/1199139163 >> v1:172.21.15.142:6789/0 conn(0x7f02800a9b30 legacy=0x7f02800a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:08.577 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f027effd700 1 -- 172.21.15.84:0/1199139163 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2145472594 0 0) 0x7f0280066ab0 con 0x7f02800a9b30 2020-01-16T05:46:08.578 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f0285b34700 1 -- 172.21.15.84:0/1199139163 >> v1:172.21.15.84:6789/0 conn(0x7f028007ff10 legacy=0x7f028014dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:08.578 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f0285b34700 1 -- 172.21.15.84:0/1199139163 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0280066ce0 con 0x7f02800a4250 2020-01-16T05:46:08.578 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f0285b34700 1 --2- 172.21.15.84:0/1199139163 >> v2:172.21.15.84:3300/0 conn(0x7f02800a4250 0x7f02800abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0278008c90 tx=0x7f0274001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:08.578 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f0285b34700 1 --2- 172.21.15.84:0/1199139163 >> v2:172.21.15.84:3300/0 conn(0x7f02800a4250 0x7f02800abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0278008c90 tx=0x7f0274001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:08.578 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f0285b34700 1 --2- 172.21.15.84:0/1199139163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02800a4250 0x7f02800abdd0 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7f0278008c90 tx=0x7f0274001150).ready entity=mon.0 client_cookie=f35912b46c55916d server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:08.578 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f0285b34700 1 --2- 172.21.15.84:0/1199139163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02800a4250 0x7f02800abdd0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f0278008c90 tx=0x7f0274001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:08.578 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f027effd700 1 -- 172.21.15.84:0/1199139163 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0278010dd0 con 0x7f02800a4250 2020-01-16T05:46:08.579 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f0285b34700 1 --2- 172.21.15.84:0/1199139163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02800a4250 0x7f02800abdd0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f0278008c90 tx=0x7f0274001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:08.579 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f0285b34700 1 --2- 172.21.15.84:0/1199139163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02800a4250 0x7f02800abdd0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f0278008c90 tx=0x7f0274001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:08.579 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f027effd700 1 -- 172.21.15.84:0/1199139163 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02780109f0 con 0x7f02800a4250 2020-01-16T05:46:08.579 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f027effd700 1 -- 172.21.15.84:0/1199139163 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02780114a0 con 0x7f02800a4250 2020-01-16T05:46:08.579 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f02848d2700 1 -- 172.21.15.84:0/1199139163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02800a4250 msgr2=0x7f02800abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:08.579 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f02848d2700 1 --2- 172.21.15.84:0/1199139163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02800a4250 0x7f02800abdd0 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7f0278008c90 tx=0x7f0274001150).stop 2020-01-16T05:46:08.579 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f02848d2700 1 -- 172.21.15.84:0/1199139163 shutdown_connections 2020-01-16T05:46:08.579 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f02848d2700 1 --2- 172.21.15.84:0/1199139163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02800a4250 0x7f02800abdd0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:08.580 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f02848d2700 1 -- 172.21.15.84:0/1199139163 shutdown_connections 2020-01-16T05:46:08.580 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f02848d2700 1 -- 172.21.15.84:0/1199139163 wait complete. 2020-01-16T05:46:08.580 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.572+0000 7f02848d2700 1 -- 172.21.15.84:0/1199139163 >> 172.21.15.84:0/1199139163 conn(0x7f02800acfc0 msgr2=0x7f02800a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f02848d2700 1 Processor -- start 2020-01-16T05:46:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f02848d2700 1 -- start start 2020-01-16T05:46:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f02848d2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0280127390 0x7f0280090ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f02848d2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f028007de80 0x7f028013f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f02848d2700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0280090260 con 0x7f028008f540 2020-01-16T05:46:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f02848d2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02800905a0 con 0x7f0280127390 2020-01-16T05:46:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f02848d2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0280090840 con 0x7f028007de80 2020-01-16T05:46:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f027ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0280127390 0x7f0280090ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f027ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0280127390 0x7f0280090ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35476/0 (socket says 172.21.15.84:35476) 2020-01-16T05:46:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f027ffff700 1 -- 172.21.15.84:0/3179166358 learned_addr learned my addr 172.21.15.84:0/3179166358 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f0285b34700 1 --2- 172.21.15.84:0/3179166358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f028007de80 0x7f028013f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:08.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f027ffff700 1 -- 172.21.15.84:0/3179166358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f028007de80 msgr2=0x7f028013f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:08.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f027ffff700 1 --2- 172.21.15.84:0/3179166358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f028007de80 0x7f028013f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:08.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f027ffff700 1 -- 172.21.15.84:0/3179166358 >> v1:172.21.15.142:6789/0 conn(0x7f028008f540 legacy=0x7f0280138020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:08.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f027ffff700 1 -- 172.21.15.84:0/3179166358 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0280066220 con 0x7f0280127390 2020-01-16T05:46:08.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f027ffff700 1 --2- 172.21.15.84:0/3179166358 >> v2:172.21.15.84:3300/0 conn(0x7f0280127390 0x7f0280090ae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0270001460 tx=0x7f0270010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:08.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f027ffff700 1 --2- 172.21.15.84:0/3179166358 >> v2:172.21.15.84:3300/0 conn(0x7f0280127390 0x7f0280090ae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0270001460 tx=0x7f0270010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:08.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f027ffff700 1 --2- 172.21.15.84:0/3179166358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0280127390 0x7f0280090ae0 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f0270001460 tx=0x7f0270010b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:08.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f027ffff700 1 --2- 172.21.15.84:0/3179166358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0280127390 0x7f0280090ae0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f0270001460 tx=0x7f0270010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:08.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f027ffff700 1 --2- 172.21.15.84:0/3179166358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0280127390 0x7f0280090ae0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f0270001460 tx=0x7f0270010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:08.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f027cff9700 1 -- 172.21.15.84:0/3179166358 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f027000cc00 con 0x7f0280127390 2020-01-16T05:46:08.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f027ffff700 1 --2- 172.21.15.84:0/3179166358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0280127390 0x7f0280090ae0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f0270001460 tx=0x7f0270010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:08.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f027cff9700 1 -- 172.21.15.84:0/3179166358 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027000c820 con 0x7f0280127390 2020-01-16T05:46:08.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f02848d2700 1 -- 172.21.15.84:0/3179166358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028008f970 con 0x7f0280127390 2020-01-16T05:46:08.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f027cff9700 1 -- 172.21.15.84:0/3179166358 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f027000ce00 con 0x7f0280127390 2020-01-16T05:46:08.587 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f02848d2700 1 -- 172.21.15.84:0/3179166358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028013f960 con 0x7f0280127390 2020-01-16T05:46:08.587 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.576+0000 7f027ffff700 1 --2- 172.21.15.84:0/3179166358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0280127390 0x7f0280090ae0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f0270001460 tx=0x7f0270010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:08.587 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.580+0000 7f027cff9700 1 -- 172.21.15.84:0/3179166358 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f02700064e0 con 0x7f0280127390 2020-01-16T05:46:08.587 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.580+0000 7f027ffff700 1 --2- 172.21.15.84:0/3179166358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0280127390 0x7f0280090ae0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f0270001460 tx=0x7f0270010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:08.587 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.580+0000 7f02848d2700 1 -- 172.21.15.84:0/3179166358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028005e1c0 con 0x7f0280127390 2020-01-16T05:46:08.587 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.580+0000 7f027cff9700 1 --2- 172.21.15.84:0/3179166358 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f026003c250 0x7f026003e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:08.587 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.580+0000 7f027cff9700 1 -- 172.21.15.84:0/3179166358 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f027004c6c0 con 0x7f0280127390 2020-01-16T05:46:08.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.580+0000 7f027f7fe700 1 --2- 172.21.15.84:0/3179166358 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f026003c250 0x7f026003e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:08.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.580+0000 7f027f7fe700 1 --2- 172.21.15.84:0/3179166358 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f026003c250 0x7f026003e760 crc :-1 s=READY pgs=131 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:08.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.584+0000 7f027ffff700 1 --2- 172.21.15.84:0/3179166358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0280127390 0x7f0280090ae0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f0270001460 tx=0x7f0270010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:08.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.584+0000 7f027cff9700 1 -- 172.21.15.84:0/3179166358 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f0270032ce0 con 0x7f0280127390 2020-01-16T05:46:08.740 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.740+0000 7f02848d2700 1 -- 172.21.15.84:0/3179166358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f028005cbc0 con 0x7f0280127390 2020-01-16T05:46:08.740 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.740+0000 7f027ffff700 1 --2- 172.21.15.84:0/3179166358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0280127390 0x7f0280090ae0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f0270001460 tx=0x7f0270010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:08.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.740+0000 7f027cff9700 1 -- 172.21.15.84:0/3179166358 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f0270032f40 con 0x7f0280127390 2020-01-16T05:46:08.741 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:08.741 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:08.743 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.740+0000 7f02848d2700 1 -- 172.21.15.84:0/3179166358 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f026003c250 msgr2=0x7f026003e760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:08.743 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.740+0000 7f02848d2700 1 --2- 172.21.15.84:0/3179166358 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f026003c250 0x7f026003e760 crc :-1 s=READY pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:08.743 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.740+0000 7f02848d2700 1 -- 172.21.15.84:0/3179166358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0280127390 msgr2=0x7f0280090ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:08.743 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.740+0000 7f02848d2700 1 --2- 172.21.15.84:0/3179166358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0280127390 0x7f0280090ae0 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f0270001460 tx=0x7f0270010b20).stop 2020-01-16T05:46:08.743 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.740+0000 7f02848d2700 1 -- 172.21.15.84:0/3179166358 shutdown_connections 2020-01-16T05:46:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.740+0000 7f02848d2700 1 --2- 172.21.15.84:0/3179166358 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f026003c250 0x7f026003e760 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.740+0000 7f02848d2700 1 --2- 172.21.15.84:0/3179166358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f028007de80 0x7f028013f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.740+0000 7f02848d2700 1 --2- 172.21.15.84:0/3179166358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0280127390 0x7f0280090ae0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.740+0000 7f02848d2700 1 -- 172.21.15.84:0/3179166358 shutdown_connections 2020-01-16T05:46:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.740+0000 7f02848d2700 1 -- 172.21.15.84:0/3179166358 wait complete. 2020-01-16T05:46:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:08.740+0000 7f02848d2700 1 -- 172.21.15.84:0/3179166358 >> 172.21.15.84:0/3179166358 conn(0x7f02800a4d70 msgr2=0x7f02800246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:08.754 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:09.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~102s 2020-01-16T05:46:10.755 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:10.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed2022700 1 Processor -- start 2020-01-16T05:46:10.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed2022700 1 -- start start 2020-01-16T05:46:10.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed2022700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5ecc07ff10 0x7f5ecc0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:10.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed2022700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ecc0a4250 0x7f5ecc066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:10.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed2022700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ecc066dd0 con 0x7f5ecc0a9b30 2020-01-16T05:46:10.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed2022700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc0a4830 con 0x7f5ecc07ff10 2020-01-16T05:46:10.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed2022700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc07f9d0 con 0x7f5ecc0a4250 2020-01-16T05:46:10.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed1020700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5ecc07ff10 0x7f5ecc0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:10.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed1020700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5ecc07ff10 0x7f5ecc0abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35484/0 (socket says 172.21.15.84:35484) 2020-01-16T05:46:10.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed1020700 1 -- 172.21.15.84:0/963387995 learned_addr learned my addr 172.21.15.84:0/963387995 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:10.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed3284700 1 --2- 172.21.15.84:0/963387995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ecc0a4250 0x7f5ecc066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:10.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed1020700 1 -- 172.21.15.84:0/963387995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ecc0a4250 msgr2=0x7f5ecc066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:10.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed1020700 1 --2- 172.21.15.84:0/963387995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ecc0a4250 0x7f5ecc066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:10.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed081f700 1 -- 172.21.15.84:0/963387995 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928504122 0 0) 0x7f5ecc066dd0 con 0x7f5ecc0a9b30 2020-01-16T05:46:10.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed1020700 1 -- 172.21.15.84:0/963387995 >> v1:172.21.15.142:6789/0 conn(0x7f5ecc0a9b30 legacy=0x7f5ecc0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed1020700 1 -- 172.21.15.84:0/963387995 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc150ce0 con 0x7f5ecc07ff10 2020-01-16T05:46:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed1020700 1 --2- 172.21.15.84:0/963387995 >> v2:172.21.15.84:3300/0 conn(0x7f5ecc07ff10 0x7f5ecc0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5ecc0a49f0 tx=0x7f5ec000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed1020700 1 --2- 172.21.15.84:0/963387995 >> v2:172.21.15.84:3300/0 conn(0x7f5ecc07ff10 0x7f5ecc0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5ecc0a49f0 tx=0x7f5ec000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed1020700 1 --2- 172.21.15.84:0/963387995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ecc07ff10 0x7f5ecc0abdd0 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7f5ecc0a49f0 tx=0x7f5ec000feb0).ready entity=mon.0 client_cookie=7dc71e4f40133abe server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed1020700 1 --2- 172.21.15.84:0/963387995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ecc07ff10 0x7f5ecc0abdd0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f5ecc0a49f0 tx=0x7f5ec000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed1020700 1 --2- 172.21.15.84:0/963387995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ecc07ff10 0x7f5ecc0abdd0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f5ecc0a49f0 tx=0x7f5ec000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:10.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed081f700 1 -- 172.21.15.84:0/963387995 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ec0011720 con 0x7f5ecc07ff10 2020-01-16T05:46:10.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.872+0000 7f5ed1020700 1 --2- 172.21.15.84:0/963387995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ecc07ff10 0x7f5ecc0abdd0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f5ecc0a49f0 tx=0x7f5ec000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:10.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.876+0000 7f5ed081f700 1 -- 172.21.15.84:0/963387995 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec0008d30 con 0x7f5ecc07ff10 2020-01-16T05:46:10.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.876+0000 7f5ed081f700 1 -- 172.21.15.84:0/963387995 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ec0011d00 con 0x7f5ecc07ff10 2020-01-16T05:46:10.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.876+0000 7f5ed2022700 1 -- 172.21.15.84:0/963387995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ecc07ff10 msgr2=0x7f5ecc0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:10.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.876+0000 7f5ed2022700 1 --2- 172.21.15.84:0/963387995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ecc07ff10 0x7f5ecc0abdd0 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7f5ecc0a49f0 tx=0x7f5ec000feb0).stop 2020-01-16T05:46:10.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.876+0000 7f5ed2022700 1 -- 172.21.15.84:0/963387995 shutdown_connections 2020-01-16T05:46:10.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.876+0000 7f5ed2022700 1 --2- 172.21.15.84:0/963387995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ecc0a4250 0x7f5ecc066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:10.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.876+0000 7f5ed2022700 1 --2- 172.21.15.84:0/963387995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ecc07ff10 0x7f5ecc0abdd0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:10.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.876+0000 7f5ed2022700 1 -- 172.21.15.84:0/963387995 shutdown_connections 2020-01-16T05:46:10.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.876+0000 7f5ed2022700 1 -- 172.21.15.84:0/963387995 wait complete. 2020-01-16T05:46:10.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.876+0000 7f5ed2022700 1 -- 172.21.15.84:0/963387995 >> 172.21.15.84:0/963387995 conn(0x7f5ecc0acfc0 msgr2=0x7f5ecc0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:10.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.876+0000 7f5ed2022700 1 Processor -- start 2020-01-16T05:46:10.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.876+0000 7f5ed2022700 1 -- start start 2020-01-16T05:46:10.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed2022700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5ecc0a89c0 0x7f5ecc13e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:10.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed2022700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ecc1256b0 con 0x7f5ecc024f30 2020-01-16T05:46:10.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed2022700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ecc125940 con 0x7f5ecc122d80 2020-01-16T05:46:10.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed2022700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc0ab090 con 0x7f5ecc0a89c0 2020-01-16T05:46:10.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed1821700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5ecc024f30 0x7f5ecc07c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52690/0 (socket says 172.21.15.84:52690) 2020-01-16T05:46:10.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed1821700 1 -- 172.21.15.84:0/3988507552 learned_addr learned my addr 172.21.15.84:0/3988507552 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:10.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed3284700 1 --2- 172.21.15.84:0/3988507552 >> v2:172.21.15.142:3300/0 conn(0x7f5ecc0a89c0 0x7f5ecc13e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:10.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5eca7fc700 1 -- 172.21.15.84:0/3988507552 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861088584 0 0) 0x7f5ecc1256b0 con 0x7f5ecc024f30 2020-01-16T05:46:10.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5eca7fc700 1 -- 172.21.15.84:0/3988507552 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eac003230 con 0x7f5ecc024f30 2020-01-16T05:46:10.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed3284700 1 -- 172.21.15.84:0/3988507552 >> v1:172.21.15.142:6789/0 conn(0x7f5ecc122d80 legacy=0x7f5ecc13b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:10.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed3284700 1 -- 172.21.15.84:0/3988507552 >> v1:172.21.15.84:6789/0 conn(0x7f5ecc024f30 legacy=0x7f5ecc07c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:10.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5eca7fc700 1 -- 172.21.15.84:0/3988507552 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4003133463 0 0) 0x7f5eac003230 con 0x7f5ecc024f30 2020-01-16T05:46:10.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed3284700 1 -- 172.21.15.84:0/3988507552 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc0a8df0 con 0x7f5ecc0a89c0 2020-01-16T05:46:10.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed3284700 1 --2- 172.21.15.84:0/3988507552 >> v2:172.21.15.142:3300/0 conn(0x7f5ecc0a89c0 0x7f5ecc13e960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5ebc001fa0 tx=0x7f5ebc001fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:10.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed3284700 1 --2- 172.21.15.84:0/3988507552 >> v2:172.21.15.142:3300/0 conn(0x7f5ecc0a89c0 0x7f5ecc13e960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5ebc001fa0 tx=0x7f5ebc001fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:10.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed3284700 1 --2- 172.21.15.84:0/3988507552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ecc0a89c0 0x7f5ecc13e960 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7f5ebc001fa0 tx=0x7f5ebc001fe0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:10.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed3284700 1 --2- 172.21.15.84:0/3988507552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ecc0a89c0 0x7f5ecc13e960 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f5ebc001fa0 tx=0x7f5ebc001fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:10.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5eca7fc700 1 -- 172.21.15.84:0/3988507552 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ebc001da0 con 0x7f5ecc0a89c0 2020-01-16T05:46:10.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed3284700 1 --2- 172.21.15.84:0/3988507552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ecc0a89c0 0x7f5ecc13e960 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f5ebc001fa0 tx=0x7f5ebc001fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:10.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5eca7fc700 1 -- 172.21.15.84:0/3988507552 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc001bb0 con 0x7f5ecc0a89c0 2020-01-16T05:46:10.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed2022700 1 -- 172.21.15.84:0/3988507552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ecc125280 con 0x7f5ecc0a89c0 2020-01-16T05:46:10.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed3284700 1 --2- 172.21.15.84:0/3988507552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ecc0a89c0 0x7f5ecc13e960 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f5ebc001fa0 tx=0x7f5ebc001fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:10.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5eca7fc700 1 -- 172.21.15.84:0/3988507552 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ec4007350 con 0x7f5ecc0a89c0 2020-01-16T05:46:10.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed2022700 1 -- 172.21.15.84:0/3988507552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ecc13eeb0 con 0x7f5ecc0a89c0 2020-01-16T05:46:10.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed3284700 1 --2- 172.21.15.84:0/3988507552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ecc0a89c0 0x7f5ecc13e960 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f5ebc001fa0 tx=0x7f5ebc001fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:10.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5ed2022700 1 -- 172.21.15.84:0/3988507552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ecc05e1c0 con 0x7f5ecc0a89c0 2020-01-16T05:46:10.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.880+0000 7f5eca7fc700 1 -- 172.21.15.84:0/3988507552 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f5ec40091b0 con 0x7f5ecc0a89c0 2020-01-16T05:46:10.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.884+0000 7f5ed3284700 1 --2- 172.21.15.84:0/3988507552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ecc0a89c0 0x7f5ecc13e960 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f5ebc001fa0 tx=0x7f5ebc001fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:10.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.884+0000 7f5eca7fc700 1 --2- 172.21.15.84:0/3988507552 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5eac03c780 0x7f5eac03ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:10.891 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.884+0000 7f5eca7fc700 1 -- 172.21.15.84:0/3988507552 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f5ec404c320 con 0x7f5ecc0a89c0 2020-01-16T05:46:10.892 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.884+0000 7f5ed1821700 1 --2- 172.21.15.84:0/3988507552 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5eac03c780 0x7f5eac03ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:10.892 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.884+0000 7f5ed1821700 1 --2- 172.21.15.84:0/3988507552 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5eac03c780 0x7f5eac03ec90 crc :-1 s=READY pgs=132 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:10.893 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.892+0000 7f5ed3284700 1 --2- 172.21.15.84:0/3988507552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ecc0a89c0 0x7f5ecc13e960 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f5ebc001fa0 tx=0x7f5ebc001fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:10.893 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:10.892+0000 7f5eca7fc700 1 -- 172.21.15.84:0/3988507552 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f5ec4032920 con 0x7f5ecc0a89c0 2020-01-16T05:46:11.043 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:11.040+0000 7f5ed2022700 1 -- 172.21.15.84:0/3988507552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ecc09fce0 con 0x7f5ecc0a89c0 2020-01-16T05:46:11.044 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:11.044+0000 7f5ed3284700 1 --2- 172.21.15.84:0/3988507552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ecc0a89c0 0x7f5ecc13e960 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f5ebc001fa0 tx=0x7f5ebc001fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:11.045 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:11.044+0000 7f5eca7fc700 1 -- 172.21.15.84:0/3988507552 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f5ec4032b80 con 0x7f5ecc0a89c0 2020-01-16T05:46:11.045 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:11.045 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:11.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:11.044+0000 7f5ed2022700 1 -- 172.21.15.84:0/3988507552 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5eac03c780 msgr2=0x7f5eac03ec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:11.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:11.044+0000 7f5ed2022700 1 --2- 172.21.15.84:0/3988507552 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5eac03c780 0x7f5eac03ec90 crc :-1 s=READY pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:11.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:11.044+0000 7f5ed2022700 1 -- 172.21.15.84:0/3988507552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ecc0a89c0 msgr2=0x7f5ecc13e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:11.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:11.044+0000 7f5ed2022700 1 --2- 172.21.15.84:0/3988507552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ecc0a89c0 0x7f5ecc13e960 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7f5ebc001fa0 tx=0x7f5ebc001fe0).stop 2020-01-16T05:46:11.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:11.044+0000 7f5ed2022700 1 -- 172.21.15.84:0/3988507552 shutdown_connections 2020-01-16T05:46:11.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:11.044+0000 7f5ed2022700 1 --2- 172.21.15.84:0/3988507552 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5eac03c780 0x7f5eac03ec90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:11.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:11.044+0000 7f5ed2022700 1 --2- 172.21.15.84:0/3988507552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ecc0a89c0 0x7f5ecc13e960 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:11.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:11.044+0000 7f5ed2022700 1 -- 172.21.15.84:0/3988507552 shutdown_connections 2020-01-16T05:46:11.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:11.044+0000 7f5ed2022700 1 -- 172.21.15.84:0/3988507552 wait complete. 2020-01-16T05:46:11.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:11.044+0000 7f5ed2022700 1 -- 172.21.15.84:0/3988507552 >> 172.21.15.84:0/3988507552 conn(0x7f5ecc0a4070 msgr2=0x7f5ecc07ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:11.048 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:11.059 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:13.060 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:13.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb385d03700 1 Processor -- start 2020-01-16T05:46:13.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb385d03700 1 -- start start 2020-01-16T05:46:13.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb385d03700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb38007ff10 0x7fb3800abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:13.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb385d03700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3800a4250 0x7fb380066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:13.188 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb385d03700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb380066dd0 con 0x7fb3800a9b30 2020-01-16T05:46:13.188 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb385d03700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3800a4830 con 0x7fb38007ff10 2020-01-16T05:46:13.188 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb385d03700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38007f9d0 con 0x7fb3800a4250 2020-01-16T05:46:13.188 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb386f65700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3800a4250 0x7fb380066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:13.188 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb384d01700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb38007ff10 0x7fb3800abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:13.188 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb386f65700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3800a4250 0x7fb380066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:47740/0 (socket says 172.21.15.84:47740) 2020-01-16T05:46:13.188 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb386f65700 1 -- 172.21.15.84:0/810707059 learned_addr learned my addr 172.21.15.84:0/810707059 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:13.189 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb386f65700 1 -- 172.21.15.84:0/810707059 >> v2:172.21.15.142:3300/0 conn(0x7fb38007ff10 msgr2=0x7fb3800abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:13.189 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb386f65700 1 --2- 172.21.15.84:0/810707059 >> v2:172.21.15.142:3300/0 conn(0x7fb38007ff10 0x7fb3800abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:13.189 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb386f65700 1 -- 172.21.15.84:0/810707059 >> v1:172.21.15.142:6789/0 conn(0x7fb3800a9b30 legacy=0x7fb3800a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:13.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb386f65700 1 -- 172.21.15.84:0/810707059 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb380150ce0 con 0x7fb3800a4250 2020-01-16T05:46:13.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb386f65700 1 --2- 172.21.15.84:0/810707059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3800a4250 0x7fb380066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb378008c90 tx=0x7fb378010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:13.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb386f65700 1 --2- 172.21.15.84:0/810707059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3800a4250 0x7fb380066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb378008c90 tx=0x7fb378010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:13.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb386f65700 1 --2- 172.21.15.84:0/810707059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3800a4250 0x7fb380066880 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7fb378008c90 tx=0x7fb378010230).ready entity=mon.2 client_cookie=4e0504db9ef11093 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:13.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb386f65700 1 --2- 172.21.15.84:0/810707059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3800a4250 0x7fb380066880 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fb378008c90 tx=0x7fb378010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:13.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb386f65700 1 --2- 172.21.15.84:0/810707059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3800a4250 0x7fb380066880 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fb378008c90 tx=0x7fb378010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:13.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb373fff700 1 -- 172.21.15.84:0/810707059 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb37800a160 con 0x7fb3800a4250 2020-01-16T05:46:13.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb386f65700 1 --2- 172.21.15.84:0/810707059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3800a4250 0x7fb380066880 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fb378008c90 tx=0x7fb378010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:13.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.180+0000 7fb373fff700 1 -- 172.21.15.84:0/810707059 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb378011bb0 con 0x7fb3800a4250 2020-01-16T05:46:13.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.184+0000 7fb373fff700 1 -- 172.21.15.84:0/810707059 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb37800a740 con 0x7fb3800a4250 2020-01-16T05:46:13.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.184+0000 7fb385d03700 1 -- 172.21.15.84:0/810707059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3800a4250 msgr2=0x7fb380066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:13.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.184+0000 7fb385d03700 1 --2- 172.21.15.84:0/810707059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3800a4250 0x7fb380066880 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7fb378008c90 tx=0x7fb378010230).stop 2020-01-16T05:46:13.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.184+0000 7fb385d03700 1 -- 172.21.15.84:0/810707059 shutdown_connections 2020-01-16T05:46:13.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.184+0000 7fb385d03700 1 --2- 172.21.15.84:0/810707059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3800a4250 0x7fb380066880 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:13.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.184+0000 7fb385d03700 1 --2- 172.21.15.84:0/810707059 >> v2:172.21.15.142:3300/0 conn(0x7fb38007ff10 0x7fb3800abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:13.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.184+0000 7fb385d03700 1 -- 172.21.15.84:0/810707059 shutdown_connections 2020-01-16T05:46:13.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.184+0000 7fb385d03700 1 -- 172.21.15.84:0/810707059 wait complete. 2020-01-16T05:46:13.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.184+0000 7fb385d03700 1 -- 172.21.15.84:0/810707059 >> 172.21.15.84:0/810707059 conn(0x7fb3800acfc0 msgr2=0x7fb3800a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:13.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.184+0000 7fb385d03700 1 Processor -- start 2020-01-16T05:46:13.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.184+0000 7fb385d03700 1 -- start start 2020-01-16T05:46:13.195 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb385d03700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb380090170 0x7fb38007cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:13.195 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb385d03700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb380024bf0 0x7fb380137bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:13.195 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb385d03700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb380090e50 con 0x7fb380138140 2020-01-16T05:46:13.195 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb385d03700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb380090670 con 0x7fb380024bf0 2020-01-16T05:46:13.195 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb385d03700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb380090910 con 0x7fb380090170 2020-01-16T05:46:13.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb384d01700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb380024bf0 0x7fb380137bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:13.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb384d01700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb380024bf0 0x7fb380137bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35502/0 (socket says 172.21.15.84:35502) 2020-01-16T05:46:13.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb384d01700 1 -- 172.21.15.84:0/2694376547 learned_addr learned my addr 172.21.15.84:0/2694376547 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:13.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb385502700 1 --2- 172.21.15.84:0/2694376547 >> v2:172.21.15.142:3300/0 conn(0x7fb380090170 0x7fb38007cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:13.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb384d01700 1 -- 172.21.15.84:0/2694376547 >> v2:172.21.15.142:3300/0 conn(0x7fb380090170 msgr2=0x7fb38007cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:13.196 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb384d01700 1 --2- 172.21.15.84:0/2694376547 >> v2:172.21.15.142:3300/0 conn(0x7fb380090170 0x7fb38007cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb384d01700 1 -- 172.21.15.84:0/2694376547 >> v1:172.21.15.142:6789/0 conn(0x7fb380138140 legacy=0x7fb3800654d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb384d01700 1 -- 172.21.15.84:0/2694376547 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3800ab090 con 0x7fb380024bf0 2020-01-16T05:46:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb384d01700 1 --2- 172.21.15.84:0/2694376547 >> v2:172.21.15.84:3300/0 conn(0x7fb380024bf0 0x7fb380137bf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb374003070 tx=0x7fb374010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb384d01700 1 --2- 172.21.15.84:0/2694376547 >> v2:172.21.15.84:3300/0 conn(0x7fb380024bf0 0x7fb380137bf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb374003070 tx=0x7fb374010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb384d01700 1 --2- 172.21.15.84:0/2694376547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb380024bf0 0x7fb380137bf0 secure :-1 s=READY pgs=335 cs=0 l=1 rx=0x7fb374003070 tx=0x7fb374010dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb384d01700 1 --2- 172.21.15.84:0/2694376547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb380024bf0 0x7fb380137bf0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fb374003070 tx=0x7fb374010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb371ffb700 1 -- 172.21.15.84:0/2694376547 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb374007160 con 0x7fb380024bf0 2020-01-16T05:46:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb384d01700 1 --2- 172.21.15.84:0/2694376547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb380024bf0 0x7fb380137bf0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fb374003070 tx=0x7fb374010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:13.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb384d01700 1 --2- 172.21.15.84:0/2694376547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb380024bf0 0x7fb380137bf0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fb374003070 tx=0x7fb374010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:13.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb371ffb700 1 -- 172.21.15.84:0/2694376547 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb374005ab0 con 0x7fb380024bf0 2020-01-16T05:46:13.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb371ffb700 1 -- 172.21.15.84:0/2694376547 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb374012630 con 0x7fb380024bf0 2020-01-16T05:46:13.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb385d03700 1 -- 172.21.15.84:0/2694376547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb380128010 con 0x7fb380024bf0 2020-01-16T05:46:13.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb385d03700 1 -- 172.21.15.84:0/2694376547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb380127b90 con 0x7fb380024bf0 2020-01-16T05:46:13.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb384d01700 1 --2- 172.21.15.84:0/2694376547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb380024bf0 0x7fb380137bf0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fb374003070 tx=0x7fb374010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:13.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb384d01700 1 --2- 172.21.15.84:0/2694376547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb380024bf0 0x7fb380137bf0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fb374003070 tx=0x7fb374010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:13.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb371ffb700 1 -- 172.21.15.84:0/2694376547 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fb374012940 con 0x7fb380024bf0 2020-01-16T05:46:13.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb385d03700 1 -- 172.21.15.84:0/2694376547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb38005e1c0 con 0x7fb380024bf0 2020-01-16T05:46:13.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb371ffb700 1 --2- 172.21.15.84:0/2694376547 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb36003c3f0 0x7fb36003e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:13.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb371ffb700 1 -- 172.21.15.84:0/2694376547 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fb37404cdb0 con 0x7fb380024bf0 2020-01-16T05:46:13.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.188+0000 7fb385502700 1 --2- 172.21.15.84:0/2694376547 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb36003c3f0 0x7fb36003e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:13.200 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.192+0000 7fb385502700 1 --2- 172.21.15.84:0/2694376547 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb36003c3f0 0x7fb36003e900 crc :-1 s=READY pgs=133 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:13.200 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.196+0000 7fb384d01700 1 --2- 172.21.15.84:0/2694376547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb380024bf0 0x7fb380137bf0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fb374003070 tx=0x7fb374010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:13.201 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.196+0000 7fb371ffb700 1 -- 172.21.15.84:0/2694376547 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fb3740333d0 con 0x7fb380024bf0 2020-01-16T05:46:13.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.348+0000 7fb385d03700 1 -- 172.21.15.84:0/2694376547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb38009fce0 con 0x7fb380024bf0 2020-01-16T05:46:13.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.348+0000 7fb384d01700 1 --2- 172.21.15.84:0/2694376547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb380024bf0 0x7fb380137bf0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fb374003070 tx=0x7fb374010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:13.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.348+0000 7fb371ffb700 1 -- 172.21.15.84:0/2694376547 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fb374033630 con 0x7fb380024bf0 2020-01-16T05:46:13.349 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:13.350 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:13.351 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.348+0000 7fb385d03700 1 -- 172.21.15.84:0/2694376547 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb36003c3f0 msgr2=0x7fb36003e900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:13.351 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.348+0000 7fb385d03700 1 --2- 172.21.15.84:0/2694376547 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb36003c3f0 0x7fb36003e900 crc :-1 s=READY pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:13.351 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.348+0000 7fb385d03700 1 -- 172.21.15.84:0/2694376547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb380024bf0 msgr2=0x7fb380137bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:13.351 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.348+0000 7fb385d03700 1 --2- 172.21.15.84:0/2694376547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb380024bf0 0x7fb380137bf0 secure :-1 s=READY pgs=335 cs=0 l=1 rx=0x7fb374003070 tx=0x7fb374010dc0).stop 2020-01-16T05:46:13.351 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.348+0000 7fb385d03700 1 -- 172.21.15.84:0/2694376547 shutdown_connections 2020-01-16T05:46:13.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.348+0000 7fb385d03700 1 --2- 172.21.15.84:0/2694376547 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb36003c3f0 0x7fb36003e900 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:13.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.348+0000 7fb385d03700 1 --2- 172.21.15.84:0/2694376547 >> v2:172.21.15.142:3300/0 conn(0x7fb380090170 0x7fb38007cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:13.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.348+0000 7fb385d03700 1 --2- 172.21.15.84:0/2694376547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb380024bf0 0x7fb380137bf0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:13.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.348+0000 7fb385d03700 1 -- 172.21.15.84:0/2694376547 shutdown_connections 2020-01-16T05:46:13.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.348+0000 7fb385d03700 1 -- 172.21.15.84:0/2694376547 wait complete. 2020-01-16T05:46:13.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:13.348+0000 7fb385d03700 1 -- 172.21.15.84:0/2694376547 >> 172.21.15.84:0/2694376547 conn(0x7fb3800ab6b0 msgr2=0x7fb3800a3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:13.353 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:13.366 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:46:14.166 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:46:14.168 INFO:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:46:15.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~108s 2020-01-16T05:46:15.367 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:15.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.484+0000 7f7c8ffff700 1 Processor -- start 2020-01-16T05:46:15.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.484+0000 7f7c8ffff700 1 -- start start 2020-01-16T05:46:15.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.484+0000 7f7c8ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7c9007ff10 0x7f7c900abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:15.499 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8ffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c90066880 con 0x7f7c900a9b30 2020-01-16T05:46:15.499 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8ffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c90066ab0 con 0x7f7c900a4250 2020-01-16T05:46:15.499 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c900a4830 con 0x7f7c9007ff10 2020-01-16T05:46:15.500 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7c900a9b30 0x7f7c900a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52710/0 (socket says 172.21.15.84:52710) 2020-01-16T05:46:15.500 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8f7fe700 1 -- 172.21.15.84:0/980528728 learned_addr learned my addr 172.21.15.84:0/980528728 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:15.500 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8effd700 1 --2- 172.21.15.84:0/980528728 >> v2:172.21.15.142:3300/0 conn(0x7f7c9007ff10 0x7f7c900abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:15.500 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8e7fc700 1 -- 172.21.15.84:0/980528728 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491654841 0 0) 0x7f7c90066880 con 0x7f7c900a9b30 2020-01-16T05:46:15.500 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8e7fc700 1 -- 172.21.15.84:0/980528728 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c7c003230 con 0x7f7c900a9b30 2020-01-16T05:46:15.500 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8e7fc700 1 -- 172.21.15.84:0/980528728 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2289799283 0 0) 0x7f7c7c003230 con 0x7f7c900a9b30 2020-01-16T05:46:15.501 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8e7fc700 1 -- 172.21.15.84:0/980528728 >> v2:172.21.15.142:3300/0 conn(0x7f7c9007ff10 msgr2=0x7f7c900abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:15.501 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8e7fc700 1 --2- 172.21.15.84:0/980528728 >> v2:172.21.15.142:3300/0 conn(0x7f7c9007ff10 0x7f7c900abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:15.501 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8e7fc700 1 -- 172.21.15.84:0/980528728 >> v1:172.21.15.142:6789/0 conn(0x7f7c900a4250 legacy=0x7f7c9014fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:15.501 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8e7fc700 1 -- 172.21.15.84:0/980528728 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c90066ce0 con 0x7f7c900a9b30 2020-01-16T05:46:15.501 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8e7fc700 1 -- 172.21.15.84:0/980528728 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f7c88001ad0 con 0x7f7c900a9b30 2020-01-16T05:46:15.501 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8e7fc700 1 -- 172.21.15.84:0/980528728 >> v1:172.21.15.84:6789/0 conn(0x7f7c900a9b30 legacy=0x7f7c900a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:15.502 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8e7fc700 1 --2- 172.21.15.84:0/980528728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c7c003860 0x7f7c7c003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:15.502 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8e7fc700 1 --2- 172.21.15.84:0/980528728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c7c0045a0 0x7f7c7c0049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:15.502 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8e7fc700 1 --2- 172.21.15.84:0/980528728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c7c004f20 0x7f7c7c00b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:15.502 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8e7fc700 1 -- 172.21.15.84:0/980528728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900a4830 con 0x7f7c7c004f20 2020-01-16T05:46:15.502 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c95670700 1 --2- 172.21.15.84:0/980528728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c7c004f20 0x7f7c7c00b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:15.502 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8e7fc700 1 -- 172.21.15.84:0/980528728 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c04fd80 con 0x7f7c7c0045a0 2020-01-16T05:46:15.502 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8e7fc700 1 -- 172.21.15.84:0/980528728 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c04ffc0 con 0x7f7c7c003860 2020-01-16T05:46:15.503 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8f7fe700 1 --2- 172.21.15.84:0/980528728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c7c003860 0x7f7c7c003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:15.503 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8effd700 1 --2- 172.21.15.84:0/980528728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c7c0045a0 0x7f7c7c0049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:15.503 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c95670700 1 -- 172.21.15.84:0/980528728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c7c003860 msgr2=0x7f7c7c003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:15.503 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c95670700 1 --2- 172.21.15.84:0/980528728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c7c003860 0x7f7c7c003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:15.503 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c95670700 1 -- 172.21.15.84:0/980528728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c7c0045a0 msgr2=0x7f7c7c0049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:15.503 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c95670700 1 --2- 172.21.15.84:0/980528728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c7c0045a0 0x7f7c7c0049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:15.503 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c95670700 1 -- 172.21.15.84:0/980528728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c0502c0 con 0x7f7c7c004f20 2020-01-16T05:46:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c95670700 1 --2- 172.21.15.84:0/980528728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c7c004f20 0x7f7c7c00b7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c80000fe0 tx=0x7f7c8000fed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c95670700 1 -- 172.21.15.84:0/980528728 reap_dead start 2020-01-16T05:46:15.507 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c95670700 1 --2- 172.21.15.84:0/980528728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c7c004f20 0x7f7c7c00b7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c80000fe0 tx=0x7f7c8000fed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:15.507 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c95670700 1 --2- 172.21.15.84:0/980528728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c7c004f20 0x7f7c7c00b7f0 secure :-1 s=READY pgs=337 cs=0 l=1 rx=0x7f7c80000fe0 tx=0x7f7c8000fed0).ready entity=mon.0 client_cookie=e5de5c26bb72148d server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:15.507 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c95670700 1 --2- 172.21.15.84:0/980528728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c7c004f20 0x7f7c7c00b7f0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7f7c80000fe0 tx=0x7f7c8000fed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:15.508 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8e7fc700 1 -- 172.21.15.84:0/980528728 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c80003540 con 0x7f7c7c004f20 2020-01-16T05:46:15.508 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c95670700 1 --2- 172.21.15.84:0/980528728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c7c004f20 0x7f7c7c00b7f0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7f7c80000fe0 tx=0x7f7c8000fed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:15.508 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c95670700 1 --2- 172.21.15.84:0/980528728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c7c004f20 0x7f7c7c00b7f0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7f7c80000fe0 tx=0x7f7c8000fed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:15.508 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8e7fc700 1 -- 172.21.15.84:0/980528728 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c80003160 con 0x7f7c7c004f20 2020-01-16T05:46:15.509 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8e7fc700 1 -- 172.21.15.84:0/980528728 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c80003b20 con 0x7f7c7c004f20 2020-01-16T05:46:15.509 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8ffff700 1 -- 172.21.15.84:0/980528728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c7c004f20 msgr2=0x7f7c7c00b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:15.509 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8ffff700 1 --2- 172.21.15.84:0/980528728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c7c004f20 0x7f7c7c00b7f0 secure :-1 s=READY pgs=337 cs=0 l=1 rx=0x7f7c80000fe0 tx=0x7f7c8000fed0).stop 2020-01-16T05:46:15.509 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8ffff700 1 -- 172.21.15.84:0/980528728 shutdown_connections 2020-01-16T05:46:15.510 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8ffff700 1 --2- 172.21.15.84:0/980528728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c7c004f20 0x7f7c7c00b7f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:15.511 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8ffff700 1 -- 172.21.15.84:0/980528728 shutdown_connections 2020-01-16T05:46:15.511 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8ffff700 1 -- 172.21.15.84:0/980528728 wait complete. 2020-01-16T05:46:15.511 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.488+0000 7f7c8ffff700 1 -- 172.21.15.84:0/980528728 >> 172.21.15.84:0/980528728 conn(0x7f7c900acfc0 msgr2=0x7f7c900a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:15.511 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c8ffff700 1 Processor -- start 2020-01-16T05:46:15.512 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c8ffff700 1 -- start start 2020-01-16T05:46:15.512 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c8ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c9009ee30 0x7f7c9009f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:15.512 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c8ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7c9009f7b0 0x7f7c9013d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:15.512 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c8ffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9009fbe0 con 0x7f7c900a2410 2020-01-16T05:46:15.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c8ffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9007cf80 con 0x7f7c9009f7b0 2020-01-16T05:46:15.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c8ffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900a1ed0 con 0x7f7c9009ee30 2020-01-16T05:46:15.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c95670700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7c9009f7b0 0x7f7c9013d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:15.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c95670700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7c9009f7b0 0x7f7c9013d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35526/0 (socket says 172.21.15.84:35526) 2020-01-16T05:46:15.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c95670700 1 -- 172.21.15.84:0/4049881169 learned_addr learned my addr 172.21.15.84:0/4049881169 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:15.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c8effd700 1 --2- 172.21.15.84:0/4049881169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c9009ee30 0x7f7c9009f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:15.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c95670700 1 -- 172.21.15.84:0/4049881169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c9009ee30 msgr2=0x7f7c9009f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:15.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c95670700 1 --2- 172.21.15.84:0/4049881169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c9009ee30 0x7f7c9009f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:15.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c95670700 1 -- 172.21.15.84:0/4049881169 >> v1:172.21.15.142:6789/0 conn(0x7f7c900a2410 legacy=0x7f7c9007c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:15.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c95670700 1 -- 172.21.15.84:0/4049881169 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c900a1bc0 con 0x7f7c9009f7b0 2020-01-16T05:46:15.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c95670700 1 --2- 172.21.15.84:0/4049881169 >> v2:172.21.15.84:3300/0 conn(0x7f7c9009f7b0 0x7f7c9013d130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c80000fe0 tx=0x7f7c80003be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:15.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c95670700 1 --2- 172.21.15.84:0/4049881169 >> v2:172.21.15.84:3300/0 conn(0x7f7c9009f7b0 0x7f7c9013d130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c80000fe0 tx=0x7f7c80003be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:15.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c95670700 1 --2- 172.21.15.84:0/4049881169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c9009f7b0 0x7f7c9013d130 secure :-1 s=READY pgs=338 cs=0 l=1 rx=0x7f7c80000fe0 tx=0x7f7c80003be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:15.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c95670700 1 --2- 172.21.15.84:0/4049881169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c9009f7b0 0x7f7c9013d130 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f7c80000fe0 tx=0x7f7c80003be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:15.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c87fff700 1 -- 172.21.15.84:0/4049881169 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c80010820 con 0x7f7c9009f7b0 2020-01-16T05:46:15.519 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c95670700 1 --2- 172.21.15.84:0/4049881169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c9009f7b0 0x7f7c9013d130 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f7c80000fe0 tx=0x7f7c80003be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:15.520 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c95670700 1 --2- 172.21.15.84:0/4049881169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c9009f7b0 0x7f7c9013d130 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f7c80000fe0 tx=0x7f7c80003be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:15.520 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c87fff700 1 -- 172.21.15.84:0/4049881169 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c80003740 con 0x7f7c9009f7b0 2020-01-16T05:46:15.520 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c8ffff700 1 -- 172.21.15.84:0/4049881169 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9007d290 con 0x7f7c9009f7b0 2020-01-16T05:46:15.521 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c87fff700 1 -- 172.21.15.84:0/4049881169 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c80010e00 con 0x7f7c9009f7b0 2020-01-16T05:46:15.521 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.492+0000 7f7c8ffff700 1 -- 172.21.15.84:0/4049881169 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c900a0260 con 0x7f7c9009f7b0 2020-01-16T05:46:15.521 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.496+0000 7f7c95670700 1 --2- 172.21.15.84:0/4049881169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c9009f7b0 0x7f7c9013d130 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f7c80000fe0 tx=0x7f7c80003be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:15.521 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.496+0000 7f7c8ffff700 1 -- 172.21.15.84:0/4049881169 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9005e1c0 con 0x7f7c9009f7b0 2020-01-16T05:46:15.522 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.496+0000 7f7c87fff700 1 -- 172.21.15.84:0/4049881169 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f7c8000a180 con 0x7f7c9009f7b0 2020-01-16T05:46:15.522 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.496+0000 7f7c95670700 1 --2- 172.21.15.84:0/4049881169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c9009f7b0 0x7f7c9013d130 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f7c80000fe0 tx=0x7f7c80003be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:15.522 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.496+0000 7f7c87fff700 1 --2- 172.21.15.84:0/4049881169 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7c7403c2a0 0x7f7c7403e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:15.522 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.496+0000 7f7c87fff700 1 -- 172.21.15.84:0/4049881169 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f7c8004c690 con 0x7f7c9009f7b0 2020-01-16T05:46:15.523 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.496+0000 7f7c8f7fe700 1 --2- 172.21.15.84:0/4049881169 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7c7403c2a0 0x7f7c7403e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:15.523 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.496+0000 7f7c8f7fe700 1 --2- 172.21.15.84:0/4049881169 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7c7403c2a0 0x7f7c7403e7b0 crc :-1 s=READY pgs=134 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:15.523 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.500+0000 7f7c95670700 1 --2- 172.21.15.84:0/4049881169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c9009f7b0 0x7f7c9013d130 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f7c80000fe0 tx=0x7f7c80003be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:15.523 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.500+0000 7f7c87fff700 1 -- 172.21.15.84:0/4049881169 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f7c80032f10 con 0x7f7c9009f7b0 2020-01-16T05:46:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.656+0000 7f7c8ffff700 1 -- 172.21.15.84:0/4049881169 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c9005cbc0 con 0x7f7c9009f7b0 2020-01-16T05:46:15.657 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.656+0000 7f7c95670700 1 --2- 172.21.15.84:0/4049881169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c9009f7b0 0x7f7c9013d130 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f7c80000fe0 tx=0x7f7c80003be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:15.657 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.656+0000 7f7c87fff700 1 -- 172.21.15.84:0/4049881169 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f7c800308c0 con 0x7f7c9009f7b0 2020-01-16T05:46:15.657 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:15.657 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.656+0000 7f7c8ffff700 1 -- 172.21.15.84:0/4049881169 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7c7403c2a0 msgr2=0x7f7c7403e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.656+0000 7f7c8ffff700 1 --2- 172.21.15.84:0/4049881169 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7c7403c2a0 0x7f7c7403e7b0 crc :-1 s=READY pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.656+0000 7f7c8ffff700 1 -- 172.21.15.84:0/4049881169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c9009f7b0 msgr2=0x7f7c9013d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.656+0000 7f7c8ffff700 1 --2- 172.21.15.84:0/4049881169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c9009f7b0 0x7f7c9013d130 secure :-1 s=READY pgs=338 cs=0 l=1 rx=0x7f7c80000fe0 tx=0x7f7c80003be0).stop 2020-01-16T05:46:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.656+0000 7f7c8ffff700 1 -- 172.21.15.84:0/4049881169 shutdown_connections 2020-01-16T05:46:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.656+0000 7f7c8ffff700 1 --2- 172.21.15.84:0/4049881169 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7c7403c2a0 0x7f7c7403e7b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.656+0000 7f7c8ffff700 1 --2- 172.21.15.84:0/4049881169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c9009f7b0 0x7f7c9013d130 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.656+0000 7f7c8ffff700 1 --2- 172.21.15.84:0/4049881169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c9009ee30 0x7f7c9009f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.656+0000 7f7c8ffff700 1 -- 172.21.15.84:0/4049881169 shutdown_connections 2020-01-16T05:46:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.656+0000 7f7c8ffff700 1 -- 172.21.15.84:0/4049881169 wait complete. 2020-01-16T05:46:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:15.656+0000 7f7c8ffff700 1 -- 172.21.15.84:0/4049881169 >> 172.21.15.84:0/4049881169 conn(0x7f7c90092150 msgr2=0x7f7c900a8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:15.670 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:17.671 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:17.796 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.788+0000 7f199861a700 1 Processor -- start 2020-01-16T05:46:17.796 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.788+0000 7f199861a700 1 -- start start 2020-01-16T05:46:17.796 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f199861a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f199005b0f0 0x7f19900a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:17.796 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f199861a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f199008fd80 0x7f19901503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:17.796 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f199861a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199007cd60 con 0x7f19900a2f60 2020-01-16T05:46:17.796 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f199861a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19900a3390 con 0x7f199005b0f0 2020-01-16T05:46:17.797 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f199861a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19900905b0 con 0x7f199008fd80 2020-01-16T05:46:17.797 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f19963b6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f199005b0f0 0x7f19900a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:17.797 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f19963b6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f199005b0f0 0x7f19900a8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35532/0 (socket says 172.21.15.84:35532) 2020-01-16T05:46:17.797 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f19963b6700 1 -- 172.21.15.84:0/343962473 learned_addr learned my addr 172.21.15.84:0/343962473 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:17.797 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f19973b8700 1 --2- 172.21.15.84:0/343962473 >> v2:172.21.15.142:3300/0 conn(0x7f199008fd80 0x7f19901503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:17.797 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f19963b6700 1 -- 172.21.15.84:0/343962473 >> v2:172.21.15.142:3300/0 conn(0x7f199008fd80 msgr2=0x7f19901503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:17.797 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f19963b6700 1 --2- 172.21.15.84:0/343962473 >> v2:172.21.15.142:3300/0 conn(0x7f199008fd80 0x7f19901503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:17.798 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f19963b6700 1 -- 172.21.15.84:0/343962473 >> v1:172.21.15.142:6789/0 conn(0x7f19900a2f60 legacy=0x7f199007c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:17.798 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f19963b6700 1 -- 172.21.15.84:0/343962473 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199005b520 con 0x7f199005b0f0 2020-01-16T05:46:17.798 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f19963b6700 1 --2- 172.21.15.84:0/343962473 >> v2:172.21.15.84:3300/0 conn(0x7f199005b0f0 0x7f19900a8ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f19900a2530 tx=0x7f198000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:17.798 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f19963b6700 1 --2- 172.21.15.84:0/343962473 >> v2:172.21.15.84:3300/0 conn(0x7f199005b0f0 0x7f19900a8ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f19900a2530 tx=0x7f198000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:17.798 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f19963b6700 1 --2- 172.21.15.84:0/343962473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f199005b0f0 0x7f19900a8ff0 secure :-1 s=READY pgs=339 cs=0 l=1 rx=0x7f19900a2530 tx=0x7f198000feb0).ready entity=mon.0 client_cookie=fc0b22900deb824b server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:17.798 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f19963b6700 1 --2- 172.21.15.84:0/343962473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f199005b0f0 0x7f19900a8ff0 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7f19900a2530 tx=0x7f198000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:17.799 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f19963b6700 1 --2- 172.21.15.84:0/343962473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f199005b0f0 0x7f19900a8ff0 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7f19900a2530 tx=0x7f198000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:17.799 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f19963b6700 1 --2- 172.21.15.84:0/343962473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f199005b0f0 0x7f19900a8ff0 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7f19900a2530 tx=0x7f198000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:17.799 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f1995bb5700 1 -- 172.21.15.84:0/343962473 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19800116e0 con 0x7f199005b0f0 2020-01-16T05:46:17.799 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f1995bb5700 1 -- 172.21.15.84:0/343962473 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1980008d30 con 0x7f199005b0f0 2020-01-16T05:46:17.799 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f1995bb5700 1 -- 172.21.15.84:0/343962473 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1980011cc0 con 0x7f199005b0f0 2020-01-16T05:46:17.799 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f199861a700 1 -- 172.21.15.84:0/343962473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f199005b0f0 msgr2=0x7f19900a8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:17.800 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f199861a700 1 --2- 172.21.15.84:0/343962473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f199005b0f0 0x7f19900a8ff0 secure :-1 s=READY pgs=339 cs=0 l=1 rx=0x7f19900a2530 tx=0x7f198000feb0).stop 2020-01-16T05:46:17.800 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f199861a700 1 -- 172.21.15.84:0/343962473 shutdown_connections 2020-01-16T05:46:17.800 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f199861a700 1 --2- 172.21.15.84:0/343962473 >> v2:172.21.15.142:3300/0 conn(0x7f199008fd80 0x7f19901503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:17.800 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f199861a700 1 --2- 172.21.15.84:0/343962473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f199005b0f0 0x7f19900a8ff0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:17.800 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f199861a700 1 -- 172.21.15.84:0/343962473 shutdown_connections 2020-01-16T05:46:17.800 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f199861a700 1 -- 172.21.15.84:0/343962473 wait complete. 2020-01-16T05:46:17.801 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.792+0000 7f199861a700 1 -- 172.21.15.84:0/343962473 >> 172.21.15.84:0/343962473 conn(0x7f19900abc10 msgr2=0x7f199005a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:17.805 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f199861a700 1 Processor -- start 2020-01-16T05:46:17.805 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f199861a700 1 -- start start 2020-01-16T05:46:17.805 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f199861a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f199009b300 0x7f199007f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:17.805 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f199861a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f199009b8e0 0x7f199009bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:17.805 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f199861a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199007f610 con 0x7f1990149c20 2020-01-16T05:46:17.805 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f199861a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199012ef40 con 0x7f199009b8e0 2020-01-16T05:46:17.806 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f199861a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199012f1e0 con 0x7f199009b300 2020-01-16T05:46:17.806 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f1996bb7700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1990149c20 0x7f199012e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52736/0 (socket says 172.21.15.84:52736) 2020-01-16T05:46:17.806 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f1996bb7700 1 -- 172.21.15.84:0/1408085501 learned_addr learned my addr 172.21.15.84:0/1408085501 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:17.806 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19963b6700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f199009b300 0x7f199007f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:17.806 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19973b8700 1 --2- 172.21.15.84:0/1408085501 >> v2:172.21.15.142:3300/0 conn(0x7f199009b8e0 0x7f199009bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:17.806 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19877fe700 1 -- 172.21.15.84:0/1408085501 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781869157 0 0) 0x7f199007f610 con 0x7f1990149c20 2020-01-16T05:46:17.806 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19877fe700 1 -- 172.21.15.84:0/1408085501 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1978003230 con 0x7f1990149c20 2020-01-16T05:46:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19877fe700 1 -- 172.21.15.84:0/1408085501 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3336171767 0 0) 0x7f1978003230 con 0x7f1990149c20 2020-01-16T05:46:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19877fe700 1 -- 172.21.15.84:0/1408085501 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f199007f610 con 0x7f1990149c20 2020-01-16T05:46:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19877fe700 1 -- 172.21.15.84:0/1408085501 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f198c001a60 con 0x7f1990149c20 2020-01-16T05:46:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19877fe700 1 -- 172.21.15.84:0/1408085501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f199009b300 msgr2=0x7f199007f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19877fe700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f199009b300 0x7f199007f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19877fe700 1 -- 172.21.15.84:0/1408085501 >> v2:172.21.15.142:3300/0 conn(0x7f199009b8e0 msgr2=0x7f199009bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19877fe700 1 --2- 172.21.15.84:0/1408085501 >> v2:172.21.15.142:3300/0 conn(0x7f199009b8e0 0x7f199009bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:17.808 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19877fe700 1 -- 172.21.15.84:0/1408085501 >> v1:172.21.15.84:6789/0 conn(0x7f1990149c20 legacy=0x7f199012e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:17.808 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19877fe700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1978003a20 0x7f1978003e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:17.808 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19877fe700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19780045a0 0x7f19780049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:17.808 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19877fe700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1978004fc0 0x7f197800b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:17.808 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19877fe700 1 -- 172.21.15.84:0/1408085501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199012ef40 con 0x7f1978004fc0 2020-01-16T05:46:17.808 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19877fe700 1 -- 172.21.15.84:0/1408085501 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199012f1e0 con 0x7f1978003a20 2020-01-16T05:46:17.808 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19877fe700 1 -- 172.21.15.84:0/1408085501 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197800bdf0 con 0x7f19780045a0 2020-01-16T05:46:17.809 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19973b8700 1 --2- 172.21.15.84:0/1408085501 >> v2:172.21.15.142:3300/0 conn(0x7f199009b8e0 0x7f199009bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:46:17.809 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19963b6700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f199009b300 0x7f199007f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:46:17.809 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19973b8700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1978004fc0 0x7f197800b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:17.809 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f1996bb7700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1978003a20 0x7f1978003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:17.809 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.796+0000 7f19963b6700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19780045a0 0x7f19780049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:17.809 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19973b8700 1 -- 172.21.15.84:0/1408085501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19780045a0 msgr2=0x7f19780049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:17.809 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19973b8700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19780045a0 0x7f19780049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:17.810 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19973b8700 1 -- 172.21.15.84:0/1408085501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1978003a20 msgr2=0x7f1978003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:17.810 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19973b8700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1978003a20 0x7f1978003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:17.810 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19973b8700 1 -- 172.21.15.84:0/1408085501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199012f480 con 0x7f1978004fc0 2020-01-16T05:46:17.810 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f199861a700 1 -- 172.21.15.84:0/1408085501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199007f0c0 con 0x7f1978004fc0 2020-01-16T05:46:17.810 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19973b8700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1978004fc0 0x7f197800b7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f19880032b0 tx=0x7f1988011610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:17.810 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f199861a700 1 -- 172.21.15.84:0/1408085501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199009b300 con 0x7f1978004fc0 2020-01-16T05:46:17.810 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19973b8700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1978004fc0 0x7f197800b7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f19880032b0 tx=0x7f1988011610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:17.811 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19973b8700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1978004fc0 0x7f197800b7f0 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7f19880032b0 tx=0x7f1988011610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:17.811 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19973b8700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1978004fc0 0x7f197800b7f0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f19880032b0 tx=0x7f1988011610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:17.811 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19877fe700 1 -- 172.21.15.84:0/1408085501 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1988007350 con 0x7f1978004fc0 2020-01-16T05:46:17.811 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19973b8700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1978004fc0 0x7f197800b7f0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f19880032b0 tx=0x7f1988011610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:17.811 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19973b8700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1978004fc0 0x7f197800b7f0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f19880032b0 tx=0x7f1988011610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:17.811 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19877fe700 1 -- 172.21.15.84:0/1408085501 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198800b250 con 0x7f1978004fc0 2020-01-16T05:46:17.811 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19877fe700 1 -- 172.21.15.84:0/1408085501 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1988008430 con 0x7f1978004fc0 2020-01-16T05:46:17.811 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19973b8700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1978004fc0 0x7f197800b7f0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f19880032b0 tx=0x7f1988011610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:17.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f199861a700 1 -- 172.21.15.84:0/1408085501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c003360 con 0x7f1978004fc0 2020-01-16T05:46:17.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19877fe700 1 -- 172.21.15.84:0/1408085501 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f1988008630 con 0x7f1978004fc0 2020-01-16T05:46:17.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19973b8700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1978004fc0 0x7f197800b7f0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f19880032b0 tx=0x7f1988011610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:17.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19877fe700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1978047320 0x7f1978049830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:17.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f19877fe700 1 -- 172.21.15.84:0/1408085501 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f198804d3d0 con 0x7f1978004fc0 2020-01-16T05:46:17.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f1996bb7700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1978047320 0x7f1978049830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:17.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.800+0000 7f1996bb7700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1978047320 0x7f1978049830 crc :-1 s=READY pgs=135 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:17.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.808+0000 7f19973b8700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1978004fc0 0x7f197800b7f0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f19880032b0 tx=0x7f1988011610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:17.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.808+0000 7f19877fe700 1 -- 172.21.15.84:0/1408085501 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f19880339f0 con 0x7f1978004fc0 2020-01-16T05:46:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.960+0000 7f199861a700 1 -- 172.21.15.84:0/1408085501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f196c003790 con 0x7f1978004fc0 2020-01-16T05:46:17.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.960+0000 7f19973b8700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1978004fc0 0x7f197800b7f0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f19880032b0 tx=0x7f1988011610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:17.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.960+0000 7f19877fe700 1 -- 172.21.15.84:0/1408085501 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f1988033c50 con 0x7f1978004fc0 2020-01-16T05:46:17.963 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:17.963 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.964+0000 7f199861a700 1 -- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1978047320 msgr2=0x7f1978049830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.964+0000 7f199861a700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1978047320 0x7f1978049830 crc :-1 s=READY pgs=135 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.964+0000 7f199861a700 1 -- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1978004fc0 msgr2=0x7f197800b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.964+0000 7f19973b8700 1 -- 172.21.15.84:0/1408085501 reap_dead start 2020-01-16T05:46:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.964+0000 7f199861a700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1978004fc0 0x7f197800b7f0 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7f19880032b0 tx=0x7f1988011610).stop 2020-01-16T05:46:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.964+0000 7f199861a700 1 -- 172.21.15.84:0/1408085501 shutdown_connections 2020-01-16T05:46:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.964+0000 7f199861a700 1 --2- 172.21.15.84:0/1408085501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1978004fc0 0x7f197800b7f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.964+0000 7f199861a700 1 -- 172.21.15.84:0/1408085501 shutdown_connections 2020-01-16T05:46:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.964+0000 7f199861a700 1 -- 172.21.15.84:0/1408085501 wait complete. 2020-01-16T05:46:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:17.964+0000 7f199861a700 1 -- 172.21.15.84:0/1408085501 >> 172.21.15.84:0/1408085501 conn(0x7f19900a86a0 msgr2=0x7f19900a6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:17.976 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:19.982 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:20.113 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa644aa9700 1 Processor -- start 2020-01-16T05:46:20.114 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa644aa9700 1 -- start start 2020-01-16T05:46:20.114 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa644aa9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa64007ff10 0x7fa6400abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:20.114 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa644aa9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa6400a4250 0x7fa640066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:20.114 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa644aa9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa640066dd0 con 0x7fa6400a9b30 2020-01-16T05:46:20.114 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa644aa9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6400a4830 con 0x7fa6400a4250 2020-01-16T05:46:20.114 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa644aa9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64007f9d0 con 0x7fa64007ff10 2020-01-16T05:46:20.114 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa645d0b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa6400a4250 0x7fa640066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:20.115 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa645d0b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa6400a4250 0x7fa640066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35554/0 (socket says 172.21.15.84:35554) 2020-01-16T05:46:20.115 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa645d0b700 1 -- 172.21.15.84:0/3147760522 learned_addr learned my addr 172.21.15.84:0/3147760522 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:20.115 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa63f7fe700 1 --2- 172.21.15.84:0/3147760522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa64007ff10 0x7fa6400abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:20.115 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa645d0b700 1 -- 172.21.15.84:0/3147760522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa64007ff10 msgr2=0x7fa6400abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:20.115 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa645d0b700 1 --2- 172.21.15.84:0/3147760522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa64007ff10 0x7fa6400abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:20.115 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa645d0b700 1 -- 172.21.15.84:0/3147760522 >> v1:172.21.15.142:6789/0 conn(0x7fa6400a9b30 legacy=0x7fa6400a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:20.115 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa645d0b700 1 -- 172.21.15.84:0/3147760522 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa640150ce0 con 0x7fa6400a4250 2020-01-16T05:46:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa645d0b700 1 --2- 172.21.15.84:0/3147760522 >> v2:172.21.15.84:3300/0 conn(0x7fa6400a4250 0x7fa640066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa638008c90 tx=0x7fa638010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa645d0b700 1 --2- 172.21.15.84:0/3147760522 >> v2:172.21.15.84:3300/0 conn(0x7fa6400a4250 0x7fa640066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa638008c90 tx=0x7fa638010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa645d0b700 1 --2- 172.21.15.84:0/3147760522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6400a4250 0x7fa640066880 secure :-1 s=READY pgs=342 cs=0 l=1 rx=0x7fa638008c90 tx=0x7fa638010230).ready entity=mon.0 client_cookie=df7553c3a1caf85c server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa645d0b700 1 --2- 172.21.15.84:0/3147760522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6400a4250 0x7fa640066880 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7fa638008c90 tx=0x7fa638010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa63effd700 1 -- 172.21.15.84:0/3147760522 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa63800a160 con 0x7fa6400a4250 2020-01-16T05:46:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa645d0b700 1 --2- 172.21.15.84:0/3147760522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6400a4250 0x7fa640066880 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7fa638008c90 tx=0x7fa638010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa645d0b700 1 --2- 172.21.15.84:0/3147760522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6400a4250 0x7fa640066880 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7fa638008c90 tx=0x7fa638010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa63effd700 1 -- 172.21.15.84:0/3147760522 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa638011bb0 con 0x7fa6400a4250 2020-01-16T05:46:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa63effd700 1 -- 172.21.15.84:0/3147760522 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa63800a740 con 0x7fa6400a4250 2020-01-16T05:46:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa644aa9700 1 -- 172.21.15.84:0/3147760522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6400a4250 msgr2=0x7fa640066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.100+0000 7fa644aa9700 1 --2- 172.21.15.84:0/3147760522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6400a4250 0x7fa640066880 secure :-1 s=READY pgs=342 cs=0 l=1 rx=0x7fa638008c90 tx=0x7fa638010230).stop 2020-01-16T05:46:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.104+0000 7fa644aa9700 1 -- 172.21.15.84:0/3147760522 shutdown_connections 2020-01-16T05:46:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.104+0000 7fa644aa9700 1 --2- 172.21.15.84:0/3147760522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6400a4250 0x7fa640066880 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.104+0000 7fa644aa9700 1 --2- 172.21.15.84:0/3147760522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa64007ff10 0x7fa6400abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.104+0000 7fa644aa9700 1 -- 172.21.15.84:0/3147760522 shutdown_connections 2020-01-16T05:46:20.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.104+0000 7fa644aa9700 1 -- 172.21.15.84:0/3147760522 wait complete. 2020-01-16T05:46:20.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.104+0000 7fa644aa9700 1 -- 172.21.15.84:0/3147760522 >> 172.21.15.84:0/3147760522 conn(0x7fa6400acfc0 msgr2=0x7fa6400a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:20.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.104+0000 7fa644aa9700 1 Processor -- start 2020-01-16T05:46:20.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.104+0000 7fa644aa9700 1 -- start start 2020-01-16T05:46:20.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.104+0000 7fa644aa9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa6400a8b80 0x7fa6400a6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:20.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.104+0000 7fa644aa9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6400a8fb0 con 0x7fa64007f390 2020-01-16T05:46:20.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.104+0000 7fa644aa9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6400a5960 con 0x7fa640024ee0 2020-01-16T05:46:20.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.104+0000 7fa644aa9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6400a6130 con 0x7fa6400a8b80 2020-01-16T05:46:20.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa64007f390 0x7fa6400246e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52756/0 (socket says 172.21.15.84:52756) 2020-01-16T05:46:20.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63ffff700 1 -- 172.21.15.84:0/754522923 learned_addr learned my addr 172.21.15.84:0/754522923 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:20.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63f7fe700 1 --2- 172.21.15.84:0/754522923 >> v2:172.21.15.142:3300/0 conn(0x7fa6400a8b80 0x7fa6400a6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:20.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63cff9700 1 -- 172.21.15.84:0/754522923 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849936558 0 0) 0x7fa6400a8fb0 con 0x7fa64007f390 2020-01-16T05:46:20.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63cff9700 1 -- 172.21.15.84:0/754522923 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa624003230 con 0x7fa64007f390 2020-01-16T05:46:20.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63cff9700 1 -- 172.21.15.84:0/754522923 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3855586695 0 0) 0x7fa624003230 con 0x7fa64007f390 2020-01-16T05:46:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63cff9700 1 -- 172.21.15.84:0/754522923 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa6400a8fb0 con 0x7fa64007f390 2020-01-16T05:46:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63cff9700 1 -- 172.21.15.84:0/754522923 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7fa628001a60 con 0x7fa64007f390 2020-01-16T05:46:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63f7fe700 1 -- 172.21.15.84:0/754522923 >> v1:172.21.15.142:6789/0 conn(0x7fa640024ee0 legacy=0x7fa64013f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63f7fe700 1 -- 172.21.15.84:0/754522923 >> v1:172.21.15.84:6789/0 conn(0x7fa64007f390 legacy=0x7fa6400246e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63f7fe700 1 -- 172.21.15.84:0/754522923 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6400a36b0 con 0x7fa6400a8b80 2020-01-16T05:46:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63f7fe700 1 --2- 172.21.15.84:0/754522923 >> v2:172.21.15.142:3300/0 conn(0x7fa6400a8b80 0x7fa6400a6c60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa638008870 tx=0x7fa6280017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63f7fe700 1 --2- 172.21.15.84:0/754522923 >> v2:172.21.15.142:3300/0 conn(0x7fa6400a8b80 0x7fa6400a6c60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa638008870 tx=0x7fa6280017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63f7fe700 1 --2- 172.21.15.84:0/754522923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6400a8b80 0x7fa6400a6c60 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7fa638008870 tx=0x7fa6280017b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63f7fe700 1 --2- 172.21.15.84:0/754522923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6400a8b80 0x7fa6400a6c60 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7fa638008870 tx=0x7fa6280017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63cff9700 1 -- 172.21.15.84:0/754522923 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa630007530 con 0x7fa6400a8b80 2020-01-16T05:46:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63f7fe700 1 --2- 172.21.15.84:0/754522923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6400a8b80 0x7fa6400a6c60 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7fa638008870 tx=0x7fa6280017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63f7fe700 1 --2- 172.21.15.84:0/754522923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6400a8b80 0x7fa6400a6c60 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7fa638008870 tx=0x7fa6280017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63cff9700 1 -- 172.21.15.84:0/754522923 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa630007150 con 0x7fa6400a8b80 2020-01-16T05:46:20.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63cff9700 1 -- 172.21.15.84:0/754522923 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa630005ae0 con 0x7fa6400a8b80 2020-01-16T05:46:20.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa644aa9700 1 -- 172.21.15.84:0/754522923 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6400a8480 con 0x7fa6400a8b80 2020-01-16T05:46:20.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa644aa9700 1 -- 172.21.15.84:0/754522923 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa640025310 con 0x7fa6400a8b80 2020-01-16T05:46:20.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63f7fe700 1 --2- 172.21.15.84:0/754522923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6400a8b80 0x7fa6400a6c60 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7fa638008870 tx=0x7fa6280017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:20.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa644aa9700 1 -- 172.21.15.84:0/754522923 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64005e1c0 con 0x7fa6400a8b80 2020-01-16T05:46:20.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63cff9700 1 -- 172.21.15.84:0/754522923 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fa630012450 con 0x7fa6400a8b80 2020-01-16T05:46:20.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.108+0000 7fa63f7fe700 1 --2- 172.21.15.84:0/754522923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6400a8b80 0x7fa6400a6c60 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7fa638008870 tx=0x7fa6280017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:20.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.112+0000 7fa63cff9700 1 --2- 172.21.15.84:0/754522923 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa62403cc00 0x7fa62403f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:20.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.112+0000 7fa63cff9700 1 -- 172.21.15.84:0/754522923 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fa63004c9f0 con 0x7fa6400a8b80 2020-01-16T05:46:20.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.112+0000 7fa63ffff700 1 --2- 172.21.15.84:0/754522923 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa62403cc00 0x7fa62403f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:20.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.112+0000 7fa63ffff700 1 --2- 172.21.15.84:0/754522923 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa62403cc00 0x7fa62403f110 crc :-1 s=READY pgs=136 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:20.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.120+0000 7fa63f7fe700 1 --2- 172.21.15.84:0/754522923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6400a8b80 0x7fa6400a6c60 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7fa638008870 tx=0x7fa6280017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:20.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.120+0000 7fa63cff9700 1 -- 172.21.15.84:0/754522923 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fa6400a36b0 con 0x7fa6400a8b80 2020-01-16T05:46:20.275 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.272+0000 7fa644aa9700 1 -- 172.21.15.84:0/754522923 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6400a34a0 con 0x7fa6400a8b80 2020-01-16T05:46:20.276 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.276+0000 7fa63f7fe700 1 --2- 172.21.15.84:0/754522923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6400a8b80 0x7fa6400a6c60 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7fa638008870 tx=0x7fa6280017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:20.276 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.276+0000 7fa63cff9700 1 -- 172.21.15.84:0/754522923 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fa63000d0c0 con 0x7fa6400a8b80 2020-01-16T05:46:20.277 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:20.277 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:20.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.276+0000 7fa644aa9700 1 -- 172.21.15.84:0/754522923 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa62403cc00 msgr2=0x7fa62403f110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:20.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.276+0000 7fa644aa9700 1 --2- 172.21.15.84:0/754522923 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa62403cc00 0x7fa62403f110 crc :-1 s=READY pgs=136 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:20.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.276+0000 7fa644aa9700 1 -- 172.21.15.84:0/754522923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6400a8b80 msgr2=0x7fa6400a6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:20.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.276+0000 7fa644aa9700 1 --2- 172.21.15.84:0/754522923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6400a8b80 0x7fa6400a6c60 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7fa638008870 tx=0x7fa6280017b0).stop 2020-01-16T05:46:20.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.276+0000 7fa644aa9700 1 -- 172.21.15.84:0/754522923 shutdown_connections 2020-01-16T05:46:20.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.276+0000 7fa644aa9700 1 --2- 172.21.15.84:0/754522923 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa62403cc00 0x7fa62403f110 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:20.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.276+0000 7fa644aa9700 1 --2- 172.21.15.84:0/754522923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6400a8b80 0x7fa6400a6c60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:20.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.276+0000 7fa644aa9700 1 -- 172.21.15.84:0/754522923 shutdown_connections 2020-01-16T05:46:20.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.276+0000 7fa644aa9700 1 -- 172.21.15.84:0/754522923 wait complete. 2020-01-16T05:46:20.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:20.276+0000 7fa644aa9700 1 -- 172.21.15.84:0/754522923 >> 172.21.15.84:0/754522923 conn(0x7fa6400a9b30 msgr2=0x7fa640127280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:20.280 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:20.289 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:21.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~114s 2020-01-16T05:46:22.297 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:22.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.416+0000 7fd660f27700 1 Processor -- start 2020-01-16T05:46:22.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.416+0000 7fd660f27700 1 -- start start 2020-01-16T05:46:22.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.416+0000 7fd660f27700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd65c07ff10 0x7fd65c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:22.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.416+0000 7fd660f27700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd65c0a4250 0x7fd65c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:22.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.416+0000 7fd660f27700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65c066dd0 con 0x7fd65c0a9b30 2020-01-16T05:46:22.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.416+0000 7fd660f27700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd65c0a4830 con 0x7fd65c07ff10 2020-01-16T05:46:22.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.416+0000 7fd660f27700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c07f9d0 con 0x7fd65c0a4250 2020-01-16T05:46:22.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.416+0000 7fd65b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd65c07ff10 0x7fd65c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:22.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.416+0000 7fd65b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd65c07ff10 0x7fd65c0abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.84:45550/0 (socket says 172.21.15.84:45550) 2020-01-16T05:46:22.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.416+0000 7fd65bfff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd65c0a9b30 0x7fd65c0a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:50990/0 (socket says 172.21.15.84:50990) 2020-01-16T05:46:22.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.416+0000 7fd65b7fe700 1 -- 172.21.15.84:0/4209529732 learned_addr learned my addr 172.21.15.84:0/4209529732 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:22.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.416+0000 7fd662189700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd65c0a4250 0x7fd65c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:22.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd65b7fe700 1 -- 172.21.15.84:0/4209529732 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd65c0a4250 msgr2=0x7fd65c066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:22.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd65b7fe700 1 --2- 172.21.15.84:0/4209529732 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd65c0a4250 0x7fd65c066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:22.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd65b7fe700 1 -- 172.21.15.84:0/4209529732 >> v1:172.21.15.142:6789/0 conn(0x7fd65c0a9b30 legacy=0x7fd65c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:22.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd65affd700 1 -- 172.21.15.84:0/4209529732 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51237101 0 0) 0x7fd65c066dd0 con 0x7fd65c0a9b30 2020-01-16T05:46:22.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd65b7fe700 1 -- 172.21.15.84:0/4209529732 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c150ce0 con 0x7fd65c07ff10 2020-01-16T05:46:22.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd662189700 1 --2- 172.21.15.84:0/4209529732 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd65c0a4250 0x7fd65c066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:46:22.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd65b7fe700 1 --2- 172.21.15.84:0/4209529732 >> v2:172.21.15.142:3300/0 conn(0x7fd65c07ff10 0x7fd65c0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd65c0a49f0 tx=0x7fd64400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:22.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd65b7fe700 1 --2- 172.21.15.84:0/4209529732 >> v2:172.21.15.142:3300/0 conn(0x7fd65c07ff10 0x7fd65c0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd65c0a49f0 tx=0x7fd64400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:22.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd65b7fe700 1 --2- 172.21.15.84:0/4209529732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd65c07ff10 0x7fd65c0abdd0 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7fd65c0a49f0 tx=0x7fd64400feb0).ready entity=mon.1 client_cookie=1107964dce1bafab server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:22.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd65b7fe700 1 --2- 172.21.15.84:0/4209529732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd65c07ff10 0x7fd65c0abdd0 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7fd65c0a49f0 tx=0x7fd64400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:22.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd65affd700 1 -- 172.21.15.84:0/4209529732 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd644011720 con 0x7fd65c07ff10 2020-01-16T05:46:22.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd65b7fe700 1 --2- 172.21.15.84:0/4209529732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd65c07ff10 0x7fd65c0abdd0 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7fd65c0a49f0 tx=0x7fd64400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:22.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd65b7fe700 1 --2- 172.21.15.84:0/4209529732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd65c07ff10 0x7fd65c0abdd0 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7fd65c0a49f0 tx=0x7fd64400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:22.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd65affd700 1 -- 172.21.15.84:0/4209529732 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd644008d30 con 0x7fd65c07ff10 2020-01-16T05:46:22.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd65affd700 1 -- 172.21.15.84:0/4209529732 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd644011d00 con 0x7fd65c07ff10 2020-01-16T05:46:22.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd660f27700 1 -- 172.21.15.84:0/4209529732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd65c07ff10 msgr2=0x7fd65c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:22.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd660f27700 1 --2- 172.21.15.84:0/4209529732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd65c07ff10 0x7fd65c0abdd0 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7fd65c0a49f0 tx=0x7fd64400feb0).stop 2020-01-16T05:46:22.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd660f27700 1 -- 172.21.15.84:0/4209529732 shutdown_connections 2020-01-16T05:46:22.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd660f27700 1 --2- 172.21.15.84:0/4209529732 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd65c0a4250 0x7fd65c066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd660f27700 1 --2- 172.21.15.84:0/4209529732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd65c07ff10 0x7fd65c0abdd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd660f27700 1 -- 172.21.15.84:0/4209529732 shutdown_connections 2020-01-16T05:46:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd660f27700 1 -- 172.21.15.84:0/4209529732 wait complete. 2020-01-16T05:46:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.420+0000 7fd660f27700 1 -- 172.21.15.84:0/4209529732 >> 172.21.15.84:0/4209529732 conn(0x7fd65c0acfc0 msgr2=0x7fd65c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd660f27700 1 Processor -- start 2020-01-16T05:46:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd660f27700 1 -- start start 2020-01-16T05:46:22.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd660f27700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd65c0a5650 0x7fd65c1401e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:22.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd660f27700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65c126db0 con 0x7fd65c0a5dc0 2020-01-16T05:46:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd660f27700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65c066180 con 0x7fd65c07c3c0 2020-01-16T05:46:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd660f27700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd65c0a3650 con 0x7fd65c0a5650 2020-01-16T05:46:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd662189700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd65c0a5650 0x7fd65c1401e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd65bfff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd65c07c3c0 0x7fd65c125c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:50996/0 (socket says 172.21.15.84:50996) 2020-01-16T05:46:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd65bfff700 1 -- 172.21.15.84:0/2942413402 learned_addr learned my addr 172.21.15.84:0/2942413402 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd662189700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd65c0a5650 0x7fd65c1401e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35572/0 (socket says 172.21.15.84:35572) 2020-01-16T05:46:22.449 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd662189700 1 -- 172.21.15.84:0/2942413402 >> v1:172.21.15.142:6789/0 conn(0x7fd65c07c3c0 legacy=0x7fd65c125c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:22.449 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd662189700 1 -- 172.21.15.84:0/2942413402 >> v1:172.21.15.84:6789/0 conn(0x7fd65c0a5dc0 legacy=0x7fd65c09f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:22.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd662189700 1 -- 172.21.15.84:0/2942413402 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c0ab090 con 0x7fd65c0a5650 2020-01-16T05:46:22.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd658ff9700 1 -- 172.21.15.84:0/2942413402 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112806786 0 0) 0x7fd65c066180 con 0x7fd65c07c3c0 2020-01-16T05:46:22.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd662189700 1 --2- 172.21.15.84:0/2942413402 >> v2:172.21.15.84:3300/0 conn(0x7fd65c0a5650 0x7fd65c1401e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6540032b0 tx=0x7fd6540110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:22.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd662189700 1 --2- 172.21.15.84:0/2942413402 >> v2:172.21.15.84:3300/0 conn(0x7fd65c0a5650 0x7fd65c1401e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6540032b0 tx=0x7fd6540110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:22.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd662189700 1 --2- 172.21.15.84:0/2942413402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd65c0a5650 0x7fd65c1401e0 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7fd6540032b0 tx=0x7fd6540110f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:22.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd662189700 1 --2- 172.21.15.84:0/2942413402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd65c0a5650 0x7fd65c1401e0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7fd6540032b0 tx=0x7fd6540110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:22.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd658ff9700 1 -- 172.21.15.84:0/2942413402 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd654005a40 con 0x7fd65c0a5650 2020-01-16T05:46:22.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd662189700 1 --2- 172.21.15.84:0/2942413402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd65c0a5650 0x7fd65c1401e0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7fd6540032b0 tx=0x7fd6540110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:22.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd662189700 1 --2- 172.21.15.84:0/2942413402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd65c0a5650 0x7fd65c1401e0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7fd6540032b0 tx=0x7fd6540110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:22.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd658ff9700 1 -- 172.21.15.84:0/2942413402 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd654011ae0 con 0x7fd65c0a5650 2020-01-16T05:46:22.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd660f27700 1 -- 172.21.15.84:0/2942413402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65c0a5a80 con 0x7fd65c0a5650 2020-01-16T05:46:22.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd658ff9700 1 -- 172.21.15.84:0/2942413402 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd65400c940 con 0x7fd65c0a5650 2020-01-16T05:46:22.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd660f27700 1 -- 172.21.15.84:0/2942413402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65c065d40 con 0x7fd65c0a5650 2020-01-16T05:46:22.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd662189700 1 --2- 172.21.15.84:0/2942413402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd65c0a5650 0x7fd65c1401e0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7fd6540032b0 tx=0x7fd6540110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:22.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd658ff9700 1 -- 172.21.15.84:0/2942413402 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fd65400cc50 con 0x7fd65c0a5650 2020-01-16T05:46:22.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.424+0000 7fd662189700 1 --2- 172.21.15.84:0/2942413402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd65c0a5650 0x7fd65c1401e0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7fd6540032b0 tx=0x7fd6540110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:22.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.428+0000 7fd658ff9700 1 --2- 172.21.15.84:0/2942413402 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd64003c190 0x7fd64003e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:22.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.428+0000 7fd658ff9700 1 -- 172.21.15.84:0/2942413402 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fd65404c9c0 con 0x7fd65c0a5650 2020-01-16T05:46:22.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.428+0000 7fd65bfff700 1 --2- 172.21.15.84:0/2942413402 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd64003c190 0x7fd64003e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:22.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.428+0000 7fd660f27700 1 -- 172.21.15.84:0/2942413402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65c05e1c0 con 0x7fd65c0a5650 2020-01-16T05:46:22.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.428+0000 7fd65bfff700 1 --2- 172.21.15.84:0/2942413402 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd64003c190 0x7fd64003e6a0 crc :-1 s=READY pgs=137 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:22.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.432+0000 7fd662189700 1 --2- 172.21.15.84:0/2942413402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd65c0a5650 0x7fd65c1401e0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7fd6540032b0 tx=0x7fd6540110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:22.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.432+0000 7fd658ff9700 1 -- 172.21.15.84:0/2942413402 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fd654032fe0 con 0x7fd65c0a5650 2020-01-16T05:46:22.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.584+0000 7fd660f27700 1 -- 172.21.15.84:0/2942413402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd65c05cbc0 con 0x7fd65c0a5650 2020-01-16T05:46:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.584+0000 7fd662189700 1 --2- 172.21.15.84:0/2942413402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd65c0a5650 0x7fd65c1401e0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7fd6540032b0 tx=0x7fd6540110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.584+0000 7fd658ff9700 1 -- 172.21.15.84:0/2942413402 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fd654033240 con 0x7fd65c0a5650 2020-01-16T05:46:22.586 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:22.586 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.584+0000 7fd660f27700 1 -- 172.21.15.84:0/2942413402 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd64003c190 msgr2=0x7fd64003e6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.584+0000 7fd660f27700 1 --2- 172.21.15.84:0/2942413402 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd64003c190 0x7fd64003e6a0 crc :-1 s=READY pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.584+0000 7fd660f27700 1 -- 172.21.15.84:0/2942413402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd65c0a5650 msgr2=0x7fd65c1401e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.584+0000 7fd660f27700 1 --2- 172.21.15.84:0/2942413402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd65c0a5650 0x7fd65c1401e0 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7fd6540032b0 tx=0x7fd6540110f0).stop 2020-01-16T05:46:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.584+0000 7fd660f27700 1 -- 172.21.15.84:0/2942413402 shutdown_connections 2020-01-16T05:46:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.584+0000 7fd660f27700 1 --2- 172.21.15.84:0/2942413402 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd64003c190 0x7fd64003e6a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.584+0000 7fd660f27700 1 --2- 172.21.15.84:0/2942413402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd65c0a5650 0x7fd65c1401e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.584+0000 7fd660f27700 1 -- 172.21.15.84:0/2942413402 shutdown_connections 2020-01-16T05:46:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.584+0000 7fd660f27700 1 -- 172.21.15.84:0/2942413402 wait complete. 2020-01-16T05:46:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:22.584+0000 7fd660f27700 1 -- 172.21.15.84:0/2942413402 >> 172.21.15.84:0/2942413402 conn(0x7fd65c0a4ad0 msgr2=0x7fd65c07cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:22.589 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:22.600 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:24.601 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:24.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0baff43700 1 Processor -- start 2020-01-16T05:46:24.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0baff43700 1 -- start start 2020-01-16T05:46:24.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0baff43700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba80a2f60 0x7f0ba805b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:24.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0baff43700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0ba80a8ff0 0x7f0ba808fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:24.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0baff43700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba80902d0 con 0x7f0ba807c560 2020-01-16T05:46:24.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0baff43700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba80a3390 con 0x7f0ba80a8ff0 2020-01-16T05:46:24.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0baff43700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba80905b0 con 0x7f0ba80a2f60 2020-01-16T05:46:24.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0badcdf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0ba80a8ff0 0x7f0ba808fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:24.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0bae4e0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba80a2f60 0x7f0ba805b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:24.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0baece1700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0ba807c560 0x7f0ba8149000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:51012/0 (socket says 172.21.15.84:51012) 2020-01-16T05:46:24.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0baece1700 1 -- 172.21.15.84:0/3326459190 learned_addr learned my addr 172.21.15.84:0/3326459190 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:24.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0bad4de700 1 -- 172.21.15.84:0/3326459190 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179004296 0 0) 0x7f0ba0001450 con 0x7f0ba807c560 2020-01-16T05:46:24.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0bad4de700 1 -- 172.21.15.84:0/3326459190 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b90003230 con 0x7f0ba807c560 2020-01-16T05:46:24.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0badcdf700 1 -- 172.21.15.84:0/3326459190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba80a2f60 msgr2=0x7f0ba805b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:24.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0badcdf700 1 --2- 172.21.15.84:0/3326459190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba80a2f60 0x7f0ba805b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:24.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0badcdf700 1 -- 172.21.15.84:0/3326459190 >> v1:172.21.15.142:6789/0 conn(0x7f0ba807c560 legacy=0x7f0ba8149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:24.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0badcdf700 1 -- 172.21.15.84:0/3326459190 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba80a9420 con 0x7f0ba80a8ff0 2020-01-16T05:46:24.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0badcdf700 1 --2- 172.21.15.84:0/3326459190 >> v2:172.21.15.84:3300/0 conn(0x7f0ba80a8ff0 0x7f0ba808fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0ba8090770 tx=0x7f0b9c00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:24.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0badcdf700 1 --2- 172.21.15.84:0/3326459190 >> v2:172.21.15.84:3300/0 conn(0x7f0ba80a8ff0 0x7f0ba808fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0ba8090770 tx=0x7f0b9c00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:24.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0badcdf700 1 --2- 172.21.15.84:0/3326459190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba80a8ff0 0x7f0ba808fd80 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7f0ba8090770 tx=0x7f0b9c00fdf0).ready entity=mon.0 client_cookie=7de37c81cc7a4cf4 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:24.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0badcdf700 1 --2- 172.21.15.84:0/3326459190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba80a8ff0 0x7f0ba808fd80 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f0ba8090770 tx=0x7f0b9c00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:24.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0bad4de700 1 -- 172.21.15.84:0/3326459190 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b9c011660 con 0x7f0ba80a8ff0 2020-01-16T05:46:24.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0badcdf700 1 --2- 172.21.15.84:0/3326459190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba80a8ff0 0x7f0ba808fd80 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f0ba8090770 tx=0x7f0b9c00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:24.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0badcdf700 1 --2- 172.21.15.84:0/3326459190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba80a8ff0 0x7f0ba808fd80 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f0ba8090770 tx=0x7f0b9c00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:24.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0bad4de700 1 -- 172.21.15.84:0/3326459190 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9c008c50 con 0x7f0ba80a8ff0 2020-01-16T05:46:24.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0bad4de700 1 -- 172.21.15.84:0/3326459190 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b9c011c40 con 0x7f0ba80a8ff0 2020-01-16T05:46:24.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0baff43700 1 -- 172.21.15.84:0/3326459190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba80a8ff0 msgr2=0x7f0ba808fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:24.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0baff43700 1 --2- 172.21.15.84:0/3326459190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba80a8ff0 0x7f0ba808fd80 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7f0ba8090770 tx=0x7f0b9c00fdf0).stop 2020-01-16T05:46:24.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0baff43700 1 -- 172.21.15.84:0/3326459190 shutdown_connections 2020-01-16T05:46:24.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0baff43700 1 --2- 172.21.15.84:0/3326459190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba80a2f60 0x7f0ba805b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:24.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0baff43700 1 --2- 172.21.15.84:0/3326459190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba80a8ff0 0x7f0ba808fd80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:24.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0baff43700 1 -- 172.21.15.84:0/3326459190 shutdown_connections 2020-01-16T05:46:24.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0baff43700 1 -- 172.21.15.84:0/3326459190 wait complete. 2020-01-16T05:46:24.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.720+0000 7f0baff43700 1 -- 172.21.15.84:0/3326459190 >> 172.21.15.84:0/3326459190 conn(0x7f0ba80abc10 msgr2=0x7f0ba805a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:24.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0baff43700 1 Processor -- start 2020-01-16T05:46:24.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0baff43700 1 -- start start 2020-01-16T05:46:24.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0baff43700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0ba8123990 0x7f0ba807f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:24.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0baff43700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0ba807faa0 0x7f0ba812f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:24.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0baff43700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba812fd60 0x7f0ba8132dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:24.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0baff43700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba807f280 con 0x7f0ba8123990 2020-01-16T05:46:24.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0baff43700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba809ff40 con 0x7f0ba807faa0 2020-01-16T05:46:24.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0baff43700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba80a01e0 con 0x7f0ba812fd60 2020-01-16T05:46:24.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0bae4e0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0ba8123990 0x7f0ba807f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:24.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0bae4e0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0ba8123990 0x7f0ba807f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35592/0 (socket says 172.21.15.84:35592) 2020-01-16T05:46:24.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0bae4e0700 1 -- 172.21.15.84:0/1729940977 learned_addr learned my addr 172.21.15.84:0/1729940977 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:24.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0badcdf700 1 --2- 172.21.15.84:0/1729940977 >> v2:172.21.15.142:3300/0 conn(0x7f0ba807faa0 0x7f0ba812f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:24.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0baece1700 1 --2- 172.21.15.84:0/1729940977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba812fd60 0x7f0ba8132dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0bae4e0700 1 -- 172.21.15.84:0/1729940977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba812fd60 msgr2=0x7f0ba8132dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0bae4e0700 1 --2- 172.21.15.84:0/1729940977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba812fd60 0x7f0ba8132dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0bae4e0700 1 -- 172.21.15.84:0/1729940977 >> v2:172.21.15.142:3300/0 conn(0x7f0ba807faa0 msgr2=0x7f0ba812f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0bae4e0700 1 --2- 172.21.15.84:0/1729940977 >> v2:172.21.15.142:3300/0 conn(0x7f0ba807faa0 0x7f0ba812f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0bae4e0700 1 -- 172.21.15.84:0/1729940977 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba80a0720 con 0x7f0ba8123990 2020-01-16T05:46:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0badcdf700 1 --2- 172.21.15.84:0/1729940977 >> v2:172.21.15.142:3300/0 conn(0x7f0ba807faa0 0x7f0ba812f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:46:24.740 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0bae4e0700 1 --2- 172.21.15.84:0/1729940977 >> v2:172.21.15.84:3300/0 conn(0x7f0ba8123990 0x7f0ba807f550 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ba807f440 tx=0x7f0b98010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:24.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0bae4e0700 1 --2- 172.21.15.84:0/1729940977 >> v2:172.21.15.84:3300/0 conn(0x7f0ba8123990 0x7f0ba807f550 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ba807f440 tx=0x7f0b98010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:24.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0bae4e0700 1 --2- 172.21.15.84:0/1729940977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba8123990 0x7f0ba807f550 secure :-1 s=READY pgs=347 cs=0 l=1 rx=0x7f0ba807f440 tx=0x7f0b98010d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:24.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0bae4e0700 1 --2- 172.21.15.84:0/1729940977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba8123990 0x7f0ba807f550 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7f0ba807f440 tx=0x7f0b98010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:24.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0ba6ffd700 1 -- 172.21.15.84:0/1729940977 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b980127b0 con 0x7f0ba8123990 2020-01-16T05:46:24.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0bae4e0700 1 --2- 172.21.15.84:0/1729940977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba8123990 0x7f0ba807f550 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7f0ba807f440 tx=0x7f0b98010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:24.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0ba6ffd700 1 -- 172.21.15.84:0/1729940977 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b98007150 con 0x7f0ba8123990 2020-01-16T05:46:24.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0bae4e0700 1 --2- 172.21.15.84:0/1729940977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba8123990 0x7f0ba807f550 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7f0ba807f440 tx=0x7f0b98010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:24.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0baff43700 1 -- 172.21.15.84:0/1729940977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba807c1e0 con 0x7f0ba8123990 2020-01-16T05:46:24.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0ba6ffd700 1 -- 172.21.15.84:0/1729940977 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b98012d90 con 0x7f0ba8123990 2020-01-16T05:46:24.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0baff43700 1 -- 172.21.15.84:0/1729940977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba8123dc0 con 0x7f0ba8123990 2020-01-16T05:46:24.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.724+0000 7f0bae4e0700 1 --2- 172.21.15.84:0/1729940977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba8123990 0x7f0ba807f550 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7f0ba807f440 tx=0x7f0b98010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:24.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.728+0000 7f0baff43700 1 -- 172.21.15.84:0/1729940977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba809fd30 con 0x7f0ba8123990 2020-01-16T05:46:24.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.728+0000 7f0ba6ffd700 1 -- 172.21.15.84:0/1729940977 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f0b9800f0a0 con 0x7f0ba8123990 2020-01-16T05:46:24.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.728+0000 7f0bae4e0700 1 --2- 172.21.15.84:0/1729940977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba8123990 0x7f0ba807f550 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7f0ba807f440 tx=0x7f0b98010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:24.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.728+0000 7f0ba6ffd700 1 --2- 172.21.15.84:0/1729940977 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0b8803c2d0 0x7f0b8803e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:24.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.728+0000 7f0ba6ffd700 1 -- 172.21.15.84:0/1729940977 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f0b9804ccb0 con 0x7f0ba8123990 2020-01-16T05:46:24.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.728+0000 7f0badcdf700 1 --2- 172.21.15.84:0/1729940977 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0b8803c2d0 0x7f0b8803e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:24.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.728+0000 7f0badcdf700 1 --2- 172.21.15.84:0/1729940977 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0b8803c2d0 0x7f0b8803e7e0 crc :-1 s=READY pgs=138 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:24.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.732+0000 7f0bae4e0700 1 --2- 172.21.15.84:0/1729940977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba8123990 0x7f0ba807f550 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7f0ba807f440 tx=0x7f0b98010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:24.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.732+0000 7f0ba6ffd700 1 -- 172.21.15.84:0/1729940977 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f0b9800d0c0 con 0x7f0ba8123990 2020-01-16T05:46:24.900 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.880+0000 7f0baff43700 1 -- 172.21.15.84:0/1729940977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ba805e1c0 con 0x7f0ba8123990 2020-01-16T05:46:24.900 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.880+0000 7f0bae4e0700 1 --2- 172.21.15.84:0/1729940977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba8123990 0x7f0ba807f550 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7f0ba807f440 tx=0x7f0b98010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:24.900 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.880+0000 7f0ba6ffd700 1 -- 172.21.15.84:0/1729940977 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f0b98034ba0 con 0x7f0ba8123990 2020-01-16T05:46:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.884+0000 7f0baff43700 1 -- 172.21.15.84:0/1729940977 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0b8803c2d0 msgr2=0x7f0b8803e7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.884+0000 7f0baff43700 1 --2- 172.21.15.84:0/1729940977 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0b8803c2d0 0x7f0b8803e7e0 crc :-1 s=READY pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.884+0000 7f0baff43700 1 -- 172.21.15.84:0/1729940977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba8123990 msgr2=0x7f0ba807f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.884+0000 7f0baff43700 1 --2- 172.21.15.84:0/1729940977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba8123990 0x7f0ba807f550 secure :-1 s=READY pgs=347 cs=0 l=1 rx=0x7f0ba807f440 tx=0x7f0b98010d80).stop 2020-01-16T05:46:24.902 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.884+0000 7f0baff43700 1 -- 172.21.15.84:0/1729940977 shutdown_connections 2020-01-16T05:46:24.903 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.884+0000 7f0baff43700 1 --2- 172.21.15.84:0/1729940977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ba812fd60 0x7f0ba8132dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:24.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.884+0000 7f0baff43700 1 --2- 172.21.15.84:0/1729940977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba8123990 0x7f0ba807f550 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:24.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.884+0000 7f0baff43700 1 --2- 172.21.15.84:0/1729940977 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0b8803c2d0 0x7f0b8803e7e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:24.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.884+0000 7f0baff43700 1 --2- 172.21.15.84:0/1729940977 >> v2:172.21.15.142:3300/0 conn(0x7f0ba807faa0 0x7f0ba812f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:24.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.884+0000 7f0baff43700 1 -- 172.21.15.84:0/1729940977 shutdown_connections 2020-01-16T05:46:24.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.884+0000 7f0baff43700 1 -- 172.21.15.84:0/1729940977 wait complete. 2020-01-16T05:46:24.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:24.884+0000 7f0baff43700 1 -- 172.21.15.84:0/1729940977 >> 172.21.15.84:0/1729940977 conn(0x7f0ba80a86a0 msgr2=0x7f0ba808f940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:24.905 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:24.906 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:24.906 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:24.927 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:46:26.928 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:27.052 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f414ca700 1 Processor -- start 2020-01-16T05:46:27.052 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f414ca700 1 -- start start 2020-01-16T05:46:27.052 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f414ca700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f3c0a9b30 0x7f1f3c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f414ca700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f3c07ff10 0x7f1f3c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f414ca700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3c066dd0 con 0x7f1f3c0a4250 2020-01-16T05:46:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f414ca700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3c0a4830 con 0x7f1f3c0a9b30 2020-01-16T05:46:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f414ca700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c07f9d0 con 0x7f1f3c07ff10 2020-01-16T05:46:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f40cc9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f3c0a9b30 0x7f1f3c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f40cc9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f3c0a9b30 0x7f1f3c0abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35602/0 (socket says 172.21.15.84:35602) 2020-01-16T05:46:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f40cc9700 1 -- 172.21.15.84:0/1906017257 learned_addr learned my addr 172.21.15.84:0/1906017257 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:27.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f3bfff700 1 -- 172.21.15.84:0/1906017257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f3c07ff10 msgr2=0x7f1f3c066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-01-16T05:46:27.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f3bfff700 1 -- 172.21.15.84:0/1906017257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f3c07ff10 msgr2=0x7f1f3c066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-01-16T05:46:27.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f3bfff700 1 --2- 172.21.15.84:0/1906017257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f3c07ff10 0x7f1f3c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2020-01-16T05:46:27.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f3bfff700 1 --2- 172.21.15.84:0/1906017257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f3c07ff10 0x7f1f3c066880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-16T05:46:27.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f40cc9700 1 -- 172.21.15.84:0/1906017257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f3c07ff10 msgr2=0x7f1f3c066880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-16T05:46:27.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f40cc9700 1 --2- 172.21.15.84:0/1906017257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f3c07ff10 0x7f1f3c066880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:27.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f40cc9700 1 -- 172.21.15.84:0/1906017257 >> v1:172.21.15.142:6789/0 conn(0x7f1f3c0a4250 legacy=0x7f1f3c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:27.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f40cc9700 1 -- 172.21.15.84:0/1906017257 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c150ce0 con 0x7f1f3c0a9b30 2020-01-16T05:46:27.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f40cc9700 1 --2- 172.21.15.84:0/1906017257 >> v2:172.21.15.84:3300/0 conn(0x7f1f3c0a9b30 0x7f1f3c0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1f34008c90 tx=0x7f1f34010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:27.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f40cc9700 1 --2- 172.21.15.84:0/1906017257 >> v2:172.21.15.84:3300/0 conn(0x7f1f3c0a9b30 0x7f1f3c0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1f34008c90 tx=0x7f1f34010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:27.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f40cc9700 1 --2- 172.21.15.84:0/1906017257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f3c0a9b30 0x7f1f3c0abdd0 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f1f34008c90 tx=0x7f1f34010230).ready entity=mon.0 client_cookie=390849ae3a1a55be server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:27.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f40cc9700 1 --2- 172.21.15.84:0/1906017257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f3c0a9b30 0x7f1f3c0abdd0 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f1f34008c90 tx=0x7f1f34010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:27.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f3b7fe700 1 -- 172.21.15.84:0/1906017257 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f3400a160 con 0x7f1f3c0a9b30 2020-01-16T05:46:27.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f40cc9700 1 --2- 172.21.15.84:0/1906017257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f3c0a9b30 0x7f1f3c0abdd0 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f1f34008c90 tx=0x7f1f34010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:27.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f3b7fe700 1 -- 172.21.15.84:0/1906017257 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f34011bb0 con 0x7f1f3c0a9b30 2020-01-16T05:46:27.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f40cc9700 1 --2- 172.21.15.84:0/1906017257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f3c0a9b30 0x7f1f3c0abdd0 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f1f34008c90 tx=0x7f1f34010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:27.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f3b7fe700 1 -- 172.21.15.84:0/1906017257 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f3400a740 con 0x7f1f3c0a9b30 2020-01-16T05:46:27.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f414ca700 1 -- 172.21.15.84:0/1906017257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f3c0a9b30 msgr2=0x7f1f3c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:27.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f414ca700 1 --2- 172.21.15.84:0/1906017257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f3c0a9b30 0x7f1f3c0abdd0 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f1f34008c90 tx=0x7f1f34010230).stop 2020-01-16T05:46:27.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f414ca700 1 -- 172.21.15.84:0/1906017257 shutdown_connections 2020-01-16T05:46:27.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f414ca700 1 --2- 172.21.15.84:0/1906017257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f3c0a9b30 0x7f1f3c0abdd0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:27.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f414ca700 1 --2- 172.21.15.84:0/1906017257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f3c07ff10 0x7f1f3c066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:27.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f414ca700 1 -- 172.21.15.84:0/1906017257 shutdown_connections 2020-01-16T05:46:27.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f414ca700 1 -- 172.21.15.84:0/1906017257 wait complete. 2020-01-16T05:46:27.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.048+0000 7f1f414ca700 1 -- 172.21.15.84:0/1906017257 >> 172.21.15.84:0/1906017257 conn(0x7f1f3c0acfc0 msgr2=0x7f1f3c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f414ca700 1 Processor -- start 2020-01-16T05:46:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f414ca700 1 -- start start 2020-01-16T05:46:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f414ca700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1f3c07e1f0 0x7f1f3c07e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f414ca700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f3c08efb0 0x7f1f3c08f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f414ca700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3c07eb70 con 0x7f1f3c0a8720 2020-01-16T05:46:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f414ca700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3c0a1930 con 0x7f1f3c08efb0 2020-01-16T05:46:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f414ca700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3c0a1bd0 con 0x7f1f3c07e1f0 2020-01-16T05:46:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f4272c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f3c08efb0 0x7f1f3c08f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f4272c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f3c08efb0 0x7f1f3c08f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35612/0 (socket says 172.21.15.84:35612) 2020-01-16T05:46:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f4272c700 1 -- 172.21.15.84:0/13537622 learned_addr learned my addr 172.21.15.84:0/13537622 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f3bfff700 1 --2- 172.21.15.84:0/13537622 >> v2:172.21.15.142:3300/0 conn(0x7f1f3c07e1f0 0x7f1f3c07e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f4272c700 1 -- 172.21.15.84:0/13537622 >> v2:172.21.15.142:3300/0 conn(0x7f1f3c07e1f0 msgr2=0x7f1f3c07e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f4272c700 1 --2- 172.21.15.84:0/13537622 >> v2:172.21.15.142:3300/0 conn(0x7f1f3c07e1f0 0x7f1f3c07e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f4272c700 1 -- 172.21.15.84:0/13537622 >> v1:172.21.15.142:6789/0 conn(0x7f1f3c0a8720 legacy=0x7f1f3c0916e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f4272c700 1 -- 172.21.15.84:0/13537622 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c0a1e70 con 0x7f1f3c08efb0 2020-01-16T05:46:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f4272c700 1 --2- 172.21.15.84:0/13537622 >> v2:172.21.15.84:3300/0 conn(0x7f1f3c08efb0 0x7f1f3c08f3e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f3c0a07a0 tx=0x7f1f2c010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f4272c700 1 --2- 172.21.15.84:0/13537622 >> v2:172.21.15.84:3300/0 conn(0x7f1f3c08efb0 0x7f1f3c08f3e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f3c0a07a0 tx=0x7f1f2c010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f4272c700 1 --2- 172.21.15.84:0/13537622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f3c08efb0 0x7f1f3c08f3e0 secure :-1 s=READY pgs=349 cs=0 l=1 rx=0x7f1f3c0a07a0 tx=0x7f1f2c010970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f4272c700 1 --2- 172.21.15.84:0/13537622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f3c08efb0 0x7f1f3c08f3e0 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7f1f3c0a07a0 tx=0x7f1f2c010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f397fa700 1 -- 172.21.15.84:0/13537622 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f2c006bc0 con 0x7f1f3c08efb0 2020-01-16T05:46:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f4272c700 1 --2- 172.21.15.84:0/13537622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f3c08efb0 0x7f1f3c08f3e0 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7f1f3c0a07a0 tx=0x7f1f2c010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f414ca700 1 -- 172.21.15.84:0/13537622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3c0a1500 con 0x7f1f3c08efb0 2020-01-16T05:46:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f397fa700 1 -- 172.21.15.84:0/13537622 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c0067e0 con 0x7f1f3c08efb0 2020-01-16T05:46:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f4272c700 1 --2- 172.21.15.84:0/13537622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f3c08efb0 0x7f1f3c08f3e0 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7f1f3c0a07a0 tx=0x7f1f2c010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f397fa700 1 -- 172.21.15.84:0/13537622 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f2c011130 con 0x7f1f3c08efb0 2020-01-16T05:46:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.052+0000 7f1f414ca700 1 -- 172.21.15.84:0/13537622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3c13f500 con 0x7f1f3c08efb0 2020-01-16T05:46:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.056+0000 7f1f4272c700 1 --2- 172.21.15.84:0/13537622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f3c08efb0 0x7f1f3c08f3e0 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7f1f3c0a07a0 tx=0x7f1f2c010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.056+0000 7f1f414ca700 1 -- 172.21.15.84:0/13537622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3c05e1c0 con 0x7f1f3c08efb0 2020-01-16T05:46:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.056+0000 7f1f397fa700 1 -- 172.21.15.84:0/13537622 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f1f2c011400 con 0x7f1f3c08efb0 2020-01-16T05:46:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.056+0000 7f1f4272c700 1 --2- 172.21.15.84:0/13537622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f3c08efb0 0x7f1f3c08f3e0 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7f1f3c0a07a0 tx=0x7f1f2c010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.056+0000 7f1f397fa700 1 --2- 172.21.15.84:0/13537622 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1f1803c2d0 0x7f1f1803e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.056+0000 7f1f397fa700 1 -- 172.21.15.84:0/13537622 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f1f2c04ca70 con 0x7f1f3c08efb0 2020-01-16T05:46:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.056+0000 7f1f40cc9700 1 --2- 172.21.15.84:0/13537622 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1f1803c2d0 0x7f1f1803e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.056+0000 7f1f40cc9700 1 --2- 172.21.15.84:0/13537622 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1f1803c2d0 0x7f1f1803e7e0 crc :-1 s=READY pgs=139 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.064+0000 7f1f4272c700 1 --2- 172.21.15.84:0/13537622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f3c08efb0 0x7f1f3c08f3e0 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7f1f3c0a07a0 tx=0x7f1f2c010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.064+0000 7f1f397fa700 1 -- 172.21.15.84:0/13537622 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f1f2c033070 con 0x7f1f3c08efb0 2020-01-16T05:46:27.211 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.208+0000 7f1f414ca700 1 -- 172.21.15.84:0/13537622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f3c09fce0 con 0x7f1f3c08efb0 2020-01-16T05:46:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.212+0000 7f1f4272c700 1 --2- 172.21.15.84:0/13537622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f3c08efb0 0x7f1f3c08f3e0 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7f1f3c0a07a0 tx=0x7f1f2c010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.212+0000 7f1f397fa700 1 -- 172.21.15.84:0/13537622 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f1f2c0332d0 con 0x7f1f3c08efb0 2020-01-16T05:46:27.212 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:27.212 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.212+0000 7f1f414ca700 1 -- 172.21.15.84:0/13537622 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1f1803c2d0 msgr2=0x7f1f1803e7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:27.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.212+0000 7f1f414ca700 1 --2- 172.21.15.84:0/13537622 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1f1803c2d0 0x7f1f1803e7e0 crc :-1 s=READY pgs=139 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:27.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.212+0000 7f1f414ca700 1 -- 172.21.15.84:0/13537622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f3c08efb0 msgr2=0x7f1f3c08f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:27.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.212+0000 7f1f414ca700 1 --2- 172.21.15.84:0/13537622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f3c08efb0 0x7f1f3c08f3e0 secure :-1 s=READY pgs=349 cs=0 l=1 rx=0x7f1f3c0a07a0 tx=0x7f1f2c010970).stop 2020-01-16T05:46:27.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.212+0000 7f1f414ca700 1 -- 172.21.15.84:0/13537622 shutdown_connections 2020-01-16T05:46:27.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.212+0000 7f1f414ca700 1 --2- 172.21.15.84:0/13537622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f3c08efb0 0x7f1f3c08f3e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:27.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.212+0000 7f1f414ca700 1 --2- 172.21.15.84:0/13537622 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1f1803c2d0 0x7f1f1803e7e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:27.215 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.212+0000 7f1f414ca700 1 --2- 172.21.15.84:0/13537622 >> v2:172.21.15.142:3300/0 conn(0x7f1f3c07e1f0 0x7f1f3c07e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:27.215 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.212+0000 7f1f414ca700 1 -- 172.21.15.84:0/13537622 shutdown_connections 2020-01-16T05:46:27.215 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.212+0000 7f1f414ca700 1 -- 172.21.15.84:0/13537622 wait complete. 2020-01-16T05:46:27.215 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:27.212+0000 7f1f414ca700 1 -- 172.21.15.84:0/13537622 >> 172.21.15.84:0/13537622 conn(0x7f1f3c0a4c60 msgr2=0x7f1f3c0246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:27.215 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:27.225 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:27.944 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~121s 2020-01-16T05:46:29.225 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd47fff700 1 Processor -- start 2020-01-16T05:46:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd47fff700 1 -- start start 2020-01-16T05:46:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd47fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcd480a9b30 0x7fcd480abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd47fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd4807ff10 0x7fcd48066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd47fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd48066dd0 con 0x7fcd480a4250 2020-01-16T05:46:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd47fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd480a4830 con 0x7fcd480a9b30 2020-01-16T05:46:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd47fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4807f9d0 con 0x7fcd4807ff10 2020-01-16T05:46:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd477fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcd480a9b30 0x7fcd480abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd4d460700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fcd480a4250 0x7fcd480a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:51052/0 (socket says 172.21.15.84:51052) 2020-01-16T05:46:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd4d460700 1 -- 172.21.15.84:0/3315435175 learned_addr learned my addr 172.21.15.84:0/3315435175 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd46ffd700 1 --2- 172.21.15.84:0/3315435175 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd4807ff10 0x7fcd48066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd467fc700 1 -- 172.21.15.84:0/3315435175 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538061169 0 0) 0x7fcd48066dd0 con 0x7fcd480a4250 2020-01-16T05:46:29.441 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd477fe700 1 -- 172.21.15.84:0/3315435175 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd4807ff10 msgr2=0x7fcd48066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:29.441 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3315435175 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd4807ff10 0x7fcd48066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:29.441 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd477fe700 1 -- 172.21.15.84:0/3315435175 >> v1:172.21.15.142:6789/0 conn(0x7fcd480a4250 legacy=0x7fcd480a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:29.441 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd477fe700 1 -- 172.21.15.84:0/3315435175 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd48150ce0 con 0x7fcd480a9b30 2020-01-16T05:46:29.441 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd46ffd700 1 --2- 172.21.15.84:0/3315435175 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd4807ff10 0x7fcd48066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:46:29.441 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3315435175 >> v2:172.21.15.84:3300/0 conn(0x7fcd480a9b30 0x7fcd480abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcd38008910 tx=0x7fcd3800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:29.441 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3315435175 >> v2:172.21.15.84:3300/0 conn(0x7fcd480a9b30 0x7fcd480abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcd38008910 tx=0x7fcd3800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3315435175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd480a9b30 0x7fcd480abdd0 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7fcd38008910 tx=0x7fcd3800fdf0).ready entity=mon.0 client_cookie=340a77bbe64c8906 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3315435175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd480a9b30 0x7fcd480abdd0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7fcd38008910 tx=0x7fcd3800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd467fc700 1 -- 172.21.15.84:0/3315435175 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd38011660 con 0x7fcd480a9b30 2020-01-16T05:46:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3315435175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd480a9b30 0x7fcd480abdd0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7fcd38008910 tx=0x7fcd3800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3315435175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd480a9b30 0x7fcd480abdd0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7fcd38008910 tx=0x7fcd3800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd467fc700 1 -- 172.21.15.84:0/3315435175 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd38008c50 con 0x7fcd480a9b30 2020-01-16T05:46:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd47fff700 1 -- 172.21.15.84:0/3315435175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd480a9b30 msgr2=0x7fcd480abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd47fff700 1 --2- 172.21.15.84:0/3315435175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd480a9b30 0x7fcd480abdd0 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7fcd38008910 tx=0x7fcd3800fdf0).stop 2020-01-16T05:46:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.348+0000 7fcd467fc700 1 -- 172.21.15.84:0/3315435175 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd38011c40 con 0x7fcd480a9b30 2020-01-16T05:46:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.352+0000 7fcd47fff700 1 -- 172.21.15.84:0/3315435175 shutdown_connections 2020-01-16T05:46:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.352+0000 7fcd47fff700 1 --2- 172.21.15.84:0/3315435175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd480a9b30 0x7fcd480abdd0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.352+0000 7fcd47fff700 1 --2- 172.21.15.84:0/3315435175 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd4807ff10 0x7fcd48066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.352+0000 7fcd47fff700 1 -- 172.21.15.84:0/3315435175 shutdown_connections 2020-01-16T05:46:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.352+0000 7fcd47fff700 1 -- 172.21.15.84:0/3315435175 wait complete. 2020-01-16T05:46:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.352+0000 7fcd47fff700 1 -- 172.21.15.84:0/3315435175 >> 172.21.15.84:0/3315435175 conn(0x7fcd480acfc0 msgr2=0x7fcd480a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:29.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.440+0000 7fcd47fff700 1 Processor -- start 2020-01-16T05:46:29.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.440+0000 7fcd47fff700 1 -- start start 2020-01-16T05:46:29.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.440+0000 7fcd47fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd48090250 0x7fcd4807c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:29.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.440+0000 7fcd47fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd48090680 con 0x7fcd48091330 2020-01-16T05:46:29.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.440+0000 7fcd47fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd4807d420 con 0x7fcd48091760 2020-01-16T05:46:29.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.440+0000 7fcd47fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd48131540 con 0x7fcd48090250 2020-01-16T05:46:29.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.440+0000 7fcd46ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcd48091330 0x7fcd48131a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52832/0 (socket says 172.21.15.84:52832) 2020-01-16T05:46:29.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.440+0000 7fcd46ffd700 1 -- 172.21.15.84:0/3340104815 learned_addr learned my addr 172.21.15.84:0/3340104815 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:29.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.440+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd48090250 0x7fcd4807c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:29.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568758857 0 0) 0x7fcd48090680 con 0x7fcd48091330 2020-01-16T05:46:29.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd2c003230 con 0x7fcd48091330 2020-01-16T05:46:29.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879490879 0 0) 0x7fcd4807d420 con 0x7fcd48091760 2020-01-16T05:46:29.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd48090680 con 0x7fcd48091760 2020-01-16T05:46:29.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1303751744 0 0) 0x7fcd2c003230 con 0x7fcd48091330 2020-01-16T05:46:29.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcd4807d420 con 0x7fcd48091330 2020-01-16T05:46:29.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7fcd30002500 con 0x7fcd48091330 2020-01-16T05:46:29.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd48090250 msgr2=0x7fcd4807c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:29.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd48090250 0x7fcd4807c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:29.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 >> v1:172.21.15.142:6789/0 conn(0x7fcd48091760 legacy=0x7fcd4813bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:29.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 >> v1:172.21.15.84:6789/0 conn(0x7fcd48091330 legacy=0x7fcd48131a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:29.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd2c004c90 0x7fcd2c003540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:29.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd2c005110 0x7fcd2c003ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:29.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd2c0097e0 0x7fcd2c00bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:29.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd48131540 con 0x7fcd2c004c90 2020-01-16T05:46:29.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c004170 con 0x7fcd2c005110 2020-01-16T05:46:29.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c00c170 con 0x7fcd2c0097e0 2020-01-16T05:46:29.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd2c004c90 0x7fcd2c003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:29.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd4d460700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd2c0097e0 0x7fcd2c00bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:29.455 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd46ffd700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd2c005110 0x7fcd2c003ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:29.455 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd477fe700 1 -- 172.21.15.84:0/3340104815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd2c0097e0 msgr2=0x7fcd2c00bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:29.455 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd2c0097e0 0x7fcd2c00bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:29.455 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd477fe700 1 -- 172.21.15.84:0/3340104815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd2c005110 msgr2=0x7fcd2c003ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:29.455 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd2c005110 0x7fcd2c003ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:29.455 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd477fe700 1 -- 172.21.15.84:0/3340104815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4807ce80 con 0x7fcd2c004c90 2020-01-16T05:46:29.455 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd2c004c90 0x7fcd2c003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcd38008910 tx=0x7fcd380117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:29.455 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd47fff700 1 -- 172.21.15.84:0/3340104815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd48090910 con 0x7fcd2c004c90 2020-01-16T05:46:29.456 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd47fff700 1 -- 172.21.15.84:0/3340104815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd48090250 con 0x7fcd2c004c90 2020-01-16T05:46:29.456 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd2c004c90 0x7fcd2c003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcd38008910 tx=0x7fcd380117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:29.456 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd2c004c90 0x7fcd2c003540 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7fcd38008910 tx=0x7fcd380117a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:29.456 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd2c004c90 0x7fcd2c003540 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7fcd38008910 tx=0x7fcd380117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:29.456 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd3800f590 con 0x7fcd2c004c90 2020-01-16T05:46:29.456 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd2c004c90 0x7fcd2c003540 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7fcd38008910 tx=0x7fcd380117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:29.456 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd2c004c90 0x7fcd2c003540 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7fcd38008910 tx=0x7fcd380117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:29.457 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd38011860 con 0x7fcd2c004c90 2020-01-16T05:46:29.457 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd380058b0 con 0x7fcd2c004c90 2020-01-16T05:46:29.457 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.444+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd2c004c90 0x7fcd2c003540 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7fcd38008910 tx=0x7fcd380117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:29.457 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.448+0000 7fcd47fff700 1 -- 172.21.15.84:0/3340104815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd20003360 con 0x7fcd2c004c90 2020-01-16T05:46:29.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.448+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fcd38005ab0 con 0x7fcd2c004c90 2020-01-16T05:46:29.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.448+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd2c004c90 0x7fcd2c003540 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7fcd38008910 tx=0x7fcd380117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:29.474 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.448+0000 7fcd3ffff700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fcd2c045340 0x7fcd2c047850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:29.474 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.448+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fcd3804cc50 con 0x7fcd2c004c90 2020-01-16T05:46:29.475 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.448+0000 7fcd46ffd700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fcd2c045340 0x7fcd2c047850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:29.475 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.448+0000 7fcd46ffd700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fcd2c045340 0x7fcd2c047850 crc :-1 s=READY pgs=140 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:29.475 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.452+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd2c004c90 0x7fcd2c003540 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7fcd38008910 tx=0x7fcd380117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:29.475 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.452+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fcd38033250 con 0x7fcd2c004c90 2020-01-16T05:46:29.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.604+0000 7fcd47fff700 1 -- 172.21.15.84:0/3340104815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd20003790 con 0x7fcd2c004c90 2020-01-16T05:46:29.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.604+0000 7fcd477fe700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd2c004c90 0x7fcd2c003540 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7fcd38008910 tx=0x7fcd380117a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:29.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.604+0000 7fcd3ffff700 1 -- 172.21.15.84:0/3340104815 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fcd38005dc0 con 0x7fcd2c004c90 2020-01-16T05:46:29.606 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:29.606 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:29.607 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.604+0000 7fcd47fff700 1 -- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fcd2c045340 msgr2=0x7fcd2c047850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:29.607 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.604+0000 7fcd47fff700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fcd2c045340 0x7fcd2c047850 crc :-1 s=READY pgs=140 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:29.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.604+0000 7fcd47fff700 1 -- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd2c004c90 msgr2=0x7fcd2c003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:29.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.604+0000 7fcd47fff700 1 --2- 172.21.15.84:0/3340104815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd2c004c90 0x7fcd2c003540 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7fcd38008910 tx=0x7fcd380117a0).stop 2020-01-16T05:46:29.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.604+0000 7fcd4d460700 1 -- 172.21.15.84:0/3340104815 reap_dead start 2020-01-16T05:46:29.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.604+0000 7fcd4d460700 1 -- 172.21.15.84:0/3340104815 reap_dead start 2020-01-16T05:46:29.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.604+0000 7fcd47fff700 1 -- 172.21.15.84:0/3340104815 shutdown_connections 2020-01-16T05:46:29.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.604+0000 7fcd47fff700 1 -- 172.21.15.84:0/3340104815 shutdown_connections 2020-01-16T05:46:29.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.604+0000 7fcd47fff700 1 -- 172.21.15.84:0/3340104815 wait complete. 2020-01-16T05:46:29.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:29.604+0000 7fcd47fff700 1 -- 172.21.15.84:0/3340104815 >> 172.21.15.84:0/3340104815 conn(0x7fcd4805ee80 msgr2=0x7fcd4807dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:29.609 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:29.620 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:31.620 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:31.745 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.736+0000 7fd50359e700 1 Processor -- start 2020-01-16T05:46:31.745 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd50359e700 1 -- start start 2020-01-16T05:46:31.745 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd50359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5040a9b30 0x7fd5040abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:31.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd50359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd50407ff10 0x7fd504066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:31.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd50359e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd504066dd0 con 0x7fd5040a4250 2020-01-16T05:46:31.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd50359e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5040a4830 con 0x7fd50407ff10 2020-01-16T05:46:31.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd50359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50407f9d0 con 0x7fd5040a9b30 2020-01-16T05:46:31.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd508a81700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd5040a4250 0x7fd5040a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52846/0 (socket says 172.21.15.84:52846) 2020-01-16T05:46:31.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd508a81700 1 -- 172.21.15.84:0/1614480444 learned_addr learned my addr 172.21.15.84:0/1614480444 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:31.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd50259c700 1 --2- 172.21.15.84:0/1614480444 >> v2:172.21.15.142:3300/0 conn(0x7fd50407ff10 0x7fd504066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:31.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd502d9d700 1 --2- 172.21.15.84:0/1614480444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5040a9b30 0x7fd5040abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:31.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd501d9b700 1 -- 172.21.15.84:0/1614480444 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734655702 0 0) 0x7fd504066dd0 con 0x7fd5040a4250 2020-01-16T05:46:31.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd501d9b700 1 -- 172.21.15.84:0/1614480444 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4f0003230 con 0x7fd5040a4250 2020-01-16T05:46:31.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd502d9d700 1 -- 172.21.15.84:0/1614480444 >> v2:172.21.15.142:3300/0 conn(0x7fd50407ff10 msgr2=0x7fd504066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:31.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd502d9d700 1 --2- 172.21.15.84:0/1614480444 >> v2:172.21.15.142:3300/0 conn(0x7fd50407ff10 0x7fd504066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:31.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd502d9d700 1 -- 172.21.15.84:0/1614480444 >> v1:172.21.15.84:6789/0 conn(0x7fd5040a4250 legacy=0x7fd5040a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:31.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd502d9d700 1 -- 172.21.15.84:0/1614480444 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd504150ce0 con 0x7fd5040a9b30 2020-01-16T05:46:31.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd50259c700 1 --2- 172.21.15.84:0/1614480444 >> v2:172.21.15.142:3300/0 conn(0x7fd50407ff10 0x7fd504066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:46:31.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd502d9d700 1 --2- 172.21.15.84:0/1614480444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5040a9b30 0x7fd5040abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd4fc008c90 tx=0x7fd4fc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:31.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd502d9d700 1 --2- 172.21.15.84:0/1614480444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5040a9b30 0x7fd5040abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd4fc008c90 tx=0x7fd4fc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:31.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd502d9d700 1 --2- 172.21.15.84:0/1614480444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5040a9b30 0x7fd5040abdd0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7fd4fc008c90 tx=0x7fd4fc010170).ready entity=mon.2 client_cookie=da3a0563c58b2b3e server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:31.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd502d9d700 1 --2- 172.21.15.84:0/1614480444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5040a9b30 0x7fd5040abdd0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fd4fc008c90 tx=0x7fd4fc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:31.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd501d9b700 1 -- 172.21.15.84:0/1614480444 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4fc00a160 con 0x7fd5040a9b30 2020-01-16T05:46:31.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd502d9d700 1 --2- 172.21.15.84:0/1614480444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5040a9b30 0x7fd5040abdd0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fd4fc008c90 tx=0x7fd4fc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:31.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd502d9d700 1 --2- 172.21.15.84:0/1614480444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5040a9b30 0x7fd5040abdd0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fd4fc008c90 tx=0x7fd4fc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:31.749 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd501d9b700 1 -- 172.21.15.84:0/1614480444 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4fc011af0 con 0x7fd5040a9b30 2020-01-16T05:46:31.749 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd501d9b700 1 -- 172.21.15.84:0/1614480444 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4fc00a740 con 0x7fd5040a9b30 2020-01-16T05:46:31.749 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd50359e700 1 -- 172.21.15.84:0/1614480444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5040a9b30 msgr2=0x7fd5040abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:31.749 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.740+0000 7fd50359e700 1 --2- 172.21.15.84:0/1614480444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5040a9b30 0x7fd5040abdd0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7fd4fc008c90 tx=0x7fd4fc010170).stop 2020-01-16T05:46:31.749 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.744+0000 7fd50359e700 1 -- 172.21.15.84:0/1614480444 shutdown_connections 2020-01-16T05:46:31.749 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.744+0000 7fd50359e700 1 --2- 172.21.15.84:0/1614480444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5040a9b30 0x7fd5040abdd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:31.749 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.744+0000 7fd50359e700 1 --2- 172.21.15.84:0/1614480444 >> v2:172.21.15.142:3300/0 conn(0x7fd50407ff10 0x7fd504066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:31.750 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.744+0000 7fd50359e700 1 -- 172.21.15.84:0/1614480444 shutdown_connections 2020-01-16T05:46:31.750 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.744+0000 7fd50359e700 1 -- 172.21.15.84:0/1614480444 wait complete. 2020-01-16T05:46:31.750 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.744+0000 7fd50359e700 1 -- 172.21.15.84:0/1614480444 >> 172.21.15.84:0/1614480444 conn(0x7fd5040acfc0 msgr2=0x7fd5040a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:31.753 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.744+0000 7fd50359e700 1 Processor -- start 2020-01-16T05:46:31.753 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.744+0000 7fd50359e700 1 -- start start 2020-01-16T05:46:31.753 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.744+0000 7fd50359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd5040a7090 0x7fd50413d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:31.753 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.744+0000 7fd50359e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50409f850 con 0x7fd5040a6c60 2020-01-16T05:46:31.753 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.744+0000 7fd50359e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd504091c60 con 0x7fd504135930 2020-01-16T05:46:31.753 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.744+0000 7fd50359e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd50408fca0 con 0x7fd5040a7090 2020-01-16T05:46:31.753 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.744+0000 7fd50259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd5040a6c60 0x7fd50409f050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52852/0 (socket says 172.21.15.84:52852) 2020-01-16T05:46:31.754 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.744+0000 7fd50259c700 1 -- 172.21.15.84:0/2459755183 learned_addr learned my addr 172.21.15.84:0/2459755183 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:31.754 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.744+0000 7fd508a81700 1 --2- 172.21.15.84:0/2459755183 >> v2:172.21.15.142:3300/0 conn(0x7fd5040a7090 0x7fd50413d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:31.754 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd4fb7fe700 1 -- 172.21.15.84:0/2459755183 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048577915 0 0) 0x7fd50409f850 con 0x7fd5040a6c60 2020-01-16T05:46:31.754 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd4fb7fe700 1 -- 172.21.15.84:0/2459755183 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4e8003230 con 0x7fd5040a6c60 2020-01-16T05:46:31.754 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd508a81700 1 -- 172.21.15.84:0/2459755183 >> v1:172.21.15.142:6789/0 conn(0x7fd504135930 legacy=0x7fd5040a8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:31.754 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd4fb7fe700 1 -- 172.21.15.84:0/2459755183 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748519094 0 0) 0x7fd504091c60 con 0x7fd504135930 2020-01-16T05:46:31.754 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd508a81700 1 -- 172.21.15.84:0/2459755183 >> v1:172.21.15.84:6789/0 conn(0x7fd5040a6c60 legacy=0x7fd50409f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd508a81700 1 -- 172.21.15.84:0/2459755183 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50413f680 con 0x7fd5040a7090 2020-01-16T05:46:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd508a81700 1 --2- 172.21.15.84:0/2459755183 >> v2:172.21.15.142:3300/0 conn(0x7fd5040a7090 0x7fd50413d110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4f4004520 tx=0x7fd4f4010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd508a81700 1 --2- 172.21.15.84:0/2459755183 >> v2:172.21.15.142:3300/0 conn(0x7fd5040a7090 0x7fd50413d110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4f4004520 tx=0x7fd4f4010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd508a81700 1 --2- 172.21.15.84:0/2459755183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5040a7090 0x7fd50413d110 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7fd4f4004520 tx=0x7fd4f4010910).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd508a81700 1 --2- 172.21.15.84:0/2459755183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5040a7090 0x7fd50413d110 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fd4f4004520 tx=0x7fd4f4010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd4fb7fe700 1 -- 172.21.15.84:0/2459755183 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4f4005db0 con 0x7fd5040a7090 2020-01-16T05:46:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd508a81700 1 --2- 172.21.15.84:0/2459755183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5040a7090 0x7fd50413d110 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fd4f4004520 tx=0x7fd4f4010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd4fb7fe700 1 -- 172.21.15.84:0/2459755183 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f40059d0 con 0x7fd5040a7090 2020-01-16T05:46:31.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd508a81700 1 --2- 172.21.15.84:0/2459755183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5040a7090 0x7fd50413d110 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fd4f4004520 tx=0x7fd4f4010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:31.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd50359e700 1 -- 172.21.15.84:0/2459755183 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5040a52f0 con 0x7fd5040a7090 2020-01-16T05:46:31.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd4fb7fe700 1 -- 172.21.15.84:0/2459755183 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4f40064a0 con 0x7fd5040a7090 2020-01-16T05:46:31.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd50359e700 1 -- 172.21.15.84:0/2459755183 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5040a5820 con 0x7fd5040a7090 2020-01-16T05:46:31.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd508a81700 1 --2- 172.21.15.84:0/2459755183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5040a7090 0x7fd50413d110 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fd4f4004520 tx=0x7fd4f4010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:31.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd50359e700 1 -- 172.21.15.84:0/2459755183 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd50405e1c0 con 0x7fd5040a7090 2020-01-16T05:46:31.756 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd4fb7fe700 1 -- 172.21.15.84:0/2459755183 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fd4f4006770 con 0x7fd5040a7090 2020-01-16T05:46:31.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd508a81700 1 --2- 172.21.15.84:0/2459755183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5040a7090 0x7fd50413d110 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fd4f4004520 tx=0x7fd4f4010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:31.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd4fb7fe700 1 --2- 172.21.15.84:0/2459755183 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd4e803e970 0x7fd4e8040e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:31.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd4fb7fe700 1 -- 172.21.15.84:0/2459755183 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fd4f404c810 con 0x7fd5040a7090 2020-01-16T05:46:31.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd502d9d700 1 --2- 172.21.15.84:0/2459755183 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd4e803e970 0x7fd4e8040e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:31.757 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.748+0000 7fd502d9d700 1 --2- 172.21.15.84:0/2459755183 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd4e803e970 0x7fd4e8040e80 crc :-1 s=READY pgs=141 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:31.760 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.760+0000 7fd508a81700 1 --2- 172.21.15.84:0/2459755183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5040a7090 0x7fd50413d110 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fd4f4004520 tx=0x7fd4f4010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:31.760 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.760+0000 7fd4fb7fe700 1 -- 172.21.15.84:0/2459755183 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fd4f4032e10 con 0x7fd5040a7090 2020-01-16T05:46:31.913 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.912+0000 7fd50359e700 1 -- 172.21.15.84:0/2459755183 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd504126b80 con 0x7fd5040a7090 2020-01-16T05:46:31.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.912+0000 7fd508a81700 1 --2- 172.21.15.84:0/2459755183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5040a7090 0x7fd50413d110 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fd4f4004520 tx=0x7fd4f4010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:31.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.912+0000 7fd4fb7fe700 1 -- 172.21.15.84:0/2459755183 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fd4f4033070 con 0x7fd5040a7090 2020-01-16T05:46:31.915 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:31.915 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:31.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.916+0000 7fd50359e700 1 -- 172.21.15.84:0/2459755183 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd4e803e970 msgr2=0x7fd4e8040e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:31.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.916+0000 7fd50359e700 1 --2- 172.21.15.84:0/2459755183 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd4e803e970 0x7fd4e8040e80 crc :-1 s=READY pgs=141 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.916+0000 7fd50359e700 1 -- 172.21.15.84:0/2459755183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5040a7090 msgr2=0x7fd50413d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.916+0000 7fd50359e700 1 --2- 172.21.15.84:0/2459755183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5040a7090 0x7fd50413d110 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7fd4f4004520 tx=0x7fd4f4010910).stop 2020-01-16T05:46:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.916+0000 7fd50359e700 1 -- 172.21.15.84:0/2459755183 shutdown_connections 2020-01-16T05:46:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.916+0000 7fd50359e700 1 --2- 172.21.15.84:0/2459755183 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd4e803e970 0x7fd4e8040e80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.916+0000 7fd50359e700 1 --2- 172.21.15.84:0/2459755183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5040a7090 0x7fd50413d110 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.916+0000 7fd50359e700 1 -- 172.21.15.84:0/2459755183 shutdown_connections 2020-01-16T05:46:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.916+0000 7fd50359e700 1 -- 172.21.15.84:0/2459755183 wait complete. 2020-01-16T05:46:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:31.916+0000 7fd50359e700 1 -- 172.21.15.84:0/2459755183 >> 172.21.15.84:0/2459755183 conn(0x7fd5040a6400 msgr2=0x7fd5040246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:31.928 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:33.929 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:34.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd349c700 1 Processor -- start 2020-01-16T05:46:34.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd349c700 1 -- start start 2020-01-16T05:46:34.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd349c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3bcc07ff10 0x7f3bcc0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:34.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd349c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bcc0a4250 0x7f3bcc066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:34.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd349c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bcc066dd0 con 0x7f3bcc0a9b30 2020-01-16T05:46:34.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd349c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bcc0a4830 con 0x7f3bcc07ff10 2020-01-16T05:46:34.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd349c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc07f9d0 con 0x7f3bcc0a4250 2020-01-16T05:46:34.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd249a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3bcc07ff10 0x7f3bcc0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:34.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd249a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3bcc07ff10 0x7f3bcc0abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35664/0 (socket says 172.21.15.84:35664) 2020-01-16T05:46:34.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd249a700 1 -- 172.21.15.84:0/1092230149 learned_addr learned my addr 172.21.15.84:0/1092230149 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:34.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd46fe700 1 --2- 172.21.15.84:0/1092230149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bcc0a4250 0x7f3bcc066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:34.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd249a700 1 -- 172.21.15.84:0/1092230149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bcc0a4250 msgr2=0x7f3bcc066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:34.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd249a700 1 --2- 172.21.15.84:0/1092230149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bcc0a4250 0x7f3bcc066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:34.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd249a700 1 -- 172.21.15.84:0/1092230149 >> v1:172.21.15.142:6789/0 conn(0x7f3bcc0a9b30 legacy=0x7f3bcc0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:34.058 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd249a700 1 -- 172.21.15.84:0/1092230149 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc150ce0 con 0x7f3bcc07ff10 2020-01-16T05:46:34.058 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd249a700 1 --2- 172.21.15.84:0/1092230149 >> v2:172.21.15.84:3300/0 conn(0x7f3bcc07ff10 0x7f3bcc0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3bcc0a49f0 tx=0x7f3bc800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:34.058 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd249a700 1 --2- 172.21.15.84:0/1092230149 >> v2:172.21.15.84:3300/0 conn(0x7f3bcc07ff10 0x7f3bcc0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3bcc0a49f0 tx=0x7f3bc800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:34.058 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd249a700 1 --2- 172.21.15.84:0/1092230149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc07ff10 0x7f3bcc0abdd0 secure :-1 s=READY pgs=355 cs=0 l=1 rx=0x7f3bcc0a49f0 tx=0x7f3bc800feb0).ready entity=mon.0 client_cookie=72564daa36b27050 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:34.058 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd249a700 1 --2- 172.21.15.84:0/1092230149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc07ff10 0x7f3bcc0abdd0 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7f3bcc0a49f0 tx=0x7f3bc800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:34.059 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd1c99700 1 -- 172.21.15.84:0/1092230149 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bc8011720 con 0x7f3bcc07ff10 2020-01-16T05:46:34.059 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd249a700 1 --2- 172.21.15.84:0/1092230149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc07ff10 0x7f3bcc0abdd0 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7f3bcc0a49f0 tx=0x7f3bc800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:34.060 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd1c99700 1 -- 172.21.15.84:0/1092230149 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc8008d30 con 0x7f3bcc07ff10 2020-01-16T05:46:34.060 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd249a700 1 --2- 172.21.15.84:0/1092230149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc07ff10 0x7f3bcc0abdd0 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7f3bcc0a49f0 tx=0x7f3bc800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:34.060 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd1c99700 1 -- 172.21.15.84:0/1092230149 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bc8011d00 con 0x7f3bcc07ff10 2020-01-16T05:46:34.060 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd349c700 1 -- 172.21.15.84:0/1092230149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc07ff10 msgr2=0x7f3bcc0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:34.061 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.048+0000 7f3bd349c700 1 --2- 172.21.15.84:0/1092230149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc07ff10 0x7f3bcc0abdd0 secure :-1 s=READY pgs=355 cs=0 l=1 rx=0x7f3bcc0a49f0 tx=0x7f3bc800feb0).stop 2020-01-16T05:46:34.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd349c700 1 -- 172.21.15.84:0/1092230149 shutdown_connections 2020-01-16T05:46:34.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd349c700 1 --2- 172.21.15.84:0/1092230149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bcc0a4250 0x7f3bcc066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:34.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd349c700 1 --2- 172.21.15.84:0/1092230149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc07ff10 0x7f3bcc0abdd0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:34.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd349c700 1 -- 172.21.15.84:0/1092230149 shutdown_connections 2020-01-16T05:46:34.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd349c700 1 -- 172.21.15.84:0/1092230149 wait complete. 2020-01-16T05:46:34.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd349c700 1 -- 172.21.15.84:0/1092230149 >> 172.21.15.84:0/1092230149 conn(0x7f3bcc0acfc0 msgr2=0x7f3bcc0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:34.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd349c700 1 Processor -- start 2020-01-16T05:46:34.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd349c700 1 -- start start 2020-01-16T05:46:34.095 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd349c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3bcc1289a0 0x7f3bcc0a8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:34.095 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd349c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3bcc126d40 0x7f3bcc0a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:34.095 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd349c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bcc0a6070 con 0x7f3bcc126910 2020-01-16T05:46:34.095 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd349c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bcc0a70a0 con 0x7f3bcc1289a0 2020-01-16T05:46:34.095 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd349c700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bcc0a7340 con 0x7f3bcc126d40 2020-01-16T05:46:34.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd2c9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3bcc1289a0 0x7f3bcc0a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:34.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd2c9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3bcc1289a0 0x7f3bcc0a8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35668/0 (socket says 172.21.15.84:35668) 2020-01-16T05:46:34.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd2c9b700 1 -- 172.21.15.84:0/2866065197 learned_addr learned my addr 172.21.15.84:0/2866065197 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:34.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd46fe700 1 --2- 172.21.15.84:0/2866065197 >> v2:172.21.15.142:3300/0 conn(0x7f3bcc126d40 0x7f3bcc0a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:34.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd2c9b700 1 -- 172.21.15.84:0/2866065197 >> v2:172.21.15.142:3300/0 conn(0x7f3bcc126d40 msgr2=0x7f3bcc0a5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:34.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.052+0000 7f3bd2c9b700 1 --2- 172.21.15.84:0/2866065197 >> v2:172.21.15.142:3300/0 conn(0x7f3bcc126d40 0x7f3bcc0a5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:34.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bd2c9b700 1 -- 172.21.15.84:0/2866065197 >> v1:172.21.15.142:6789/0 conn(0x7f3bcc126910 legacy=0x7f3bcc0a5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:34.097 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bd2c9b700 1 -- 172.21.15.84:0/2866065197 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc0a7880 con 0x7f3bcc1289a0 2020-01-16T05:46:34.097 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bd2c9b700 1 --2- 172.21.15.84:0/2866065197 >> v2:172.21.15.84:3300/0 conn(0x7f3bcc1289a0 0x7f3bcc0a8970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3bcc129230 tx=0x7f3bc0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:34.097 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bd2c9b700 1 --2- 172.21.15.84:0/2866065197 >> v2:172.21.15.84:3300/0 conn(0x7f3bcc1289a0 0x7f3bcc0a8970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3bcc129230 tx=0x7f3bc0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:34.097 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bd2c9b700 1 --2- 172.21.15.84:0/2866065197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc1289a0 0x7f3bcc0a8970 secure :-1 s=READY pgs=356 cs=0 l=1 rx=0x7f3bcc129230 tx=0x7f3bc0010b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:34.097 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bd2c9b700 1 --2- 172.21.15.84:0/2866065197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc1289a0 0x7f3bcc0a8970 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7f3bcc129230 tx=0x7f3bc0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:34.097 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bbf7fe700 1 -- 172.21.15.84:0/2866065197 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bc0012570 con 0x7f3bcc1289a0 2020-01-16T05:46:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bd2c9b700 1 --2- 172.21.15.84:0/2866065197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc1289a0 0x7f3bcc0a8970 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7f3bcc129230 tx=0x7f3bc0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bd2c9b700 1 --2- 172.21.15.84:0/2866065197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc1289a0 0x7f3bcc0a8970 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7f3bcc129230 tx=0x7f3bc0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bbf7fe700 1 -- 172.21.15.84:0/2866065197 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc0012190 con 0x7f3bcc1289a0 2020-01-16T05:46:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bbf7fe700 1 -- 172.21.15.84:0/2866065197 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bc0012b50 con 0x7f3bcc1289a0 2020-01-16T05:46:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bd349c700 1 -- 172.21.15.84:0/2866065197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bcc127dc0 con 0x7f3bcc1289a0 2020-01-16T05:46:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bd349c700 1 -- 172.21.15.84:0/2866065197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bcc13d450 con 0x7f3bcc1289a0 2020-01-16T05:46:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bd2c9b700 1 --2- 172.21.15.84:0/2866065197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc1289a0 0x7f3bcc0a8970 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7f3bcc129230 tx=0x7f3bc0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bd349c700 1 -- 172.21.15.84:0/2866065197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bcc05e1c0 con 0x7f3bcc1289a0 2020-01-16T05:46:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bbf7fe700 1 -- 172.21.15.84:0/2866065197 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f3bc00064e0 con 0x7f3bcc1289a0 2020-01-16T05:46:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bd2c9b700 1 --2- 172.21.15.84:0/2866065197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc1289a0 0x7f3bcc0a8970 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7f3bcc129230 tx=0x7f3bc0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bbf7fe700 1 --2- 172.21.15.84:0/2866065197 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3bb403c200 0x7f3bb403e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bbf7fe700 1 -- 172.21.15.84:0/2866065197 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f3bc004c830 con 0x7f3bcc1289a0 2020-01-16T05:46:34.107 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bd249a700 1 --2- 172.21.15.84:0/2866065197 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3bb403c200 0x7f3bb403e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:34.107 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.056+0000 7f3bd249a700 1 --2- 172.21.15.84:0/2866065197 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3bb403c200 0x7f3bb403e710 crc :-1 s=READY pgs=142 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:34.107 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.060+0000 7f3bd2c9b700 1 --2- 172.21.15.84:0/2866065197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc1289a0 0x7f3bcc0a8970 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7f3bcc129230 tx=0x7f3bc0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:34.107 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.064+0000 7f3bbf7fe700 1 -- 172.21.15.84:0/2866065197 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f3bc0012de0 con 0x7f3bcc1289a0 2020-01-16T05:46:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.216+0000 7f3bd349c700 1 -- 172.21.15.84:0/2866065197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bcc05cbc0 con 0x7f3bcc1289a0 2020-01-16T05:46:34.217 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.216+0000 7f3bd2c9b700 1 --2- 172.21.15.84:0/2866065197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc1289a0 0x7f3bcc0a8970 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7f3bcc129230 tx=0x7f3bc0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:34.217 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.216+0000 7f3bbf7fe700 1 -- 172.21.15.84:0/2866065197 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f3bc0032e30 con 0x7f3bcc1289a0 2020-01-16T05:46:34.218 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:34.218 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:34.219 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.216+0000 7f3bd349c700 1 -- 172.21.15.84:0/2866065197 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3bb403c200 msgr2=0x7f3bb403e710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:34.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.216+0000 7f3bd349c700 1 --2- 172.21.15.84:0/2866065197 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3bb403c200 0x7f3bb403e710 crc :-1 s=READY pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:34.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.216+0000 7f3bd349c700 1 -- 172.21.15.84:0/2866065197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc1289a0 msgr2=0x7f3bcc0a8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:34.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.216+0000 7f3bd349c700 1 --2- 172.21.15.84:0/2866065197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc1289a0 0x7f3bcc0a8970 secure :-1 s=READY pgs=356 cs=0 l=1 rx=0x7f3bcc129230 tx=0x7f3bc0010b20).stop 2020-01-16T05:46:34.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.216+0000 7f3bd349c700 1 -- 172.21.15.84:0/2866065197 shutdown_connections 2020-01-16T05:46:34.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.216+0000 7f3bd349c700 1 --2- 172.21.15.84:0/2866065197 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3bb403c200 0x7f3bb403e710 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:34.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.216+0000 7f3bd349c700 1 --2- 172.21.15.84:0/2866065197 >> v2:172.21.15.142:3300/0 conn(0x7f3bcc126d40 0x7f3bcc0a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:34.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.216+0000 7f3bd349c700 1 --2- 172.21.15.84:0/2866065197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc1289a0 0x7f3bcc0a8970 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:34.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.220+0000 7f3bd349c700 1 -- 172.21.15.84:0/2866065197 shutdown_connections 2020-01-16T05:46:34.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.220+0000 7f3bd349c700 1 -- 172.21.15.84:0/2866065197 wait complete. 2020-01-16T05:46:34.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:34.220+0000 7f3bd349c700 1 -- 172.21.15.84:0/2866065197 >> 172.21.15.84:0/2866065197 conn(0x7f3bcc07f080 msgr2=0x7f3bcc091120 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:34.222 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:34.232 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:34.308 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~127s 2020-01-16T05:46:36.233 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.348+0000 7f7a9f59e700 1 Processor -- start 2020-01-16T05:46:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9f59e700 1 -- start start 2020-01-16T05:46:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9f59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7aa00a9b30 0x7f7aa00abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9f59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7aa00a4250 0x7f7aa0066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9f59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa0066dd0 con 0x7f7aa007ff10 2020-01-16T05:46:36.359 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9f59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa00a4830 con 0x7f7aa00a9b30 2020-01-16T05:46:36.359 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9f59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa007f9d0 con 0x7f7aa00a4250 2020-01-16T05:46:36.359 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9e59c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7aa007ff10 0x7f7aa00a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:51102/0 (socket says 172.21.15.84:51102) 2020-01-16T05:46:36.359 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9e59c700 1 -- 172.21.15.84:0/54467974 learned_addr learned my addr 172.21.15.84:0/54467974 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:36.359 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9ed9d700 1 --2- 172.21.15.84:0/54467974 >> v2:172.21.15.142:3300/0 conn(0x7f7aa00a9b30 0x7f7aa00abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:36.359 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7aa4de5700 1 --2- 172.21.15.84:0/54467974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7aa00a4250 0x7f7aa0066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:36.359 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9dd9b700 1 -- 172.21.15.84:0/54467974 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621681251 0 0) 0x7f7aa0066dd0 con 0x7f7aa007ff10 2020-01-16T05:46:36.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9dd9b700 1 -- 172.21.15.84:0/54467974 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a8c003230 con 0x7f7aa007ff10 2020-01-16T05:46:36.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9ed9d700 1 -- 172.21.15.84:0/54467974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7aa00a4250 msgr2=0x7f7aa0066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:36.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9ed9d700 1 --2- 172.21.15.84:0/54467974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7aa00a4250 0x7f7aa0066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:36.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9ed9d700 1 -- 172.21.15.84:0/54467974 >> v1:172.21.15.142:6789/0 conn(0x7f7aa007ff10 legacy=0x7f7aa00a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:36.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9ed9d700 1 -- 172.21.15.84:0/54467974 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa0150ce0 con 0x7f7aa00a9b30 2020-01-16T05:46:36.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9ed9d700 1 --2- 172.21.15.84:0/54467974 >> v2:172.21.15.142:3300/0 conn(0x7f7aa00a9b30 0x7f7aa00abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7aa00a49f0 tx=0x7f7a9800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:36.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9ed9d700 1 --2- 172.21.15.84:0/54467974 >> v2:172.21.15.142:3300/0 conn(0x7f7aa00a9b30 0x7f7aa00abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7aa00a49f0 tx=0x7f7a9800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:36.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9ed9d700 1 --2- 172.21.15.84:0/54467974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7aa00a9b30 0x7f7aa00abdd0 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7f7aa00a49f0 tx=0x7f7a9800fdf0).ready entity=mon.1 client_cookie=d30610db1a645940 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:36.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9ed9d700 1 --2- 172.21.15.84:0/54467974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7aa00a9b30 0x7f7aa00abdd0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7f7aa00a49f0 tx=0x7f7a9800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:36.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9dd9b700 1 -- 172.21.15.84:0/54467974 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a98011660 con 0x7f7aa00a9b30 2020-01-16T05:46:36.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9ed9d700 1 --2- 172.21.15.84:0/54467974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7aa00a9b30 0x7f7aa00abdd0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7f7aa00a49f0 tx=0x7f7a9800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:36.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9ed9d700 1 --2- 172.21.15.84:0/54467974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7aa00a9b30 0x7f7aa00abdd0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7f7aa00a49f0 tx=0x7f7a9800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:36.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9dd9b700 1 -- 172.21.15.84:0/54467974 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a98008c50 con 0x7f7aa00a9b30 2020-01-16T05:46:36.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9dd9b700 1 -- 172.21.15.84:0/54467974 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a98011c40 con 0x7f7aa00a9b30 2020-01-16T05:46:36.361 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9f59e700 1 -- 172.21.15.84:0/54467974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7aa00a9b30 msgr2=0x7f7aa00abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:36.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.352+0000 7f7a9f59e700 1 --2- 172.21.15.84:0/54467974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7aa00a9b30 0x7f7aa00abdd0 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7f7aa00a49f0 tx=0x7f7a9800fdf0).stop 2020-01-16T05:46:36.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.356+0000 7f7a9f59e700 1 -- 172.21.15.84:0/54467974 shutdown_connections 2020-01-16T05:46:36.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.356+0000 7f7a9f59e700 1 --2- 172.21.15.84:0/54467974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7aa00a4250 0x7f7aa0066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:36.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.356+0000 7f7a9f59e700 1 --2- 172.21.15.84:0/54467974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7aa00a9b30 0x7f7aa00abdd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:36.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.356+0000 7f7a9f59e700 1 -- 172.21.15.84:0/54467974 shutdown_connections 2020-01-16T05:46:36.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.356+0000 7f7a9f59e700 1 -- 172.21.15.84:0/54467974 wait complete. 2020-01-16T05:46:36.362 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.356+0000 7f7a9f59e700 1 -- 172.21.15.84:0/54467974 >> 172.21.15.84:0/54467974 conn(0x7f7aa00acfc0 msgr2=0x7f7aa00a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:36.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.356+0000 7f7a9f59e700 1 Processor -- start 2020-01-16T05:46:36.363 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.356+0000 7f7a9f59e700 1 -- start start 2020-01-16T05:46:36.386 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.356+0000 7f7a9f59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7aa00a8340 0x7f7aa008f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:36.387 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.356+0000 7f7a9f59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7aa013d1b0 0x7f7aa013f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:36.387 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.356+0000 7f7a9f59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa00a78b0 con 0x7f7aa008fe20 2020-01-16T05:46:36.387 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.356+0000 7f7a9f59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa00a6c60 con 0x7f7aa013d1b0 2020-01-16T05:46:36.387 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.356+0000 7f7a9f59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa00a6f00 con 0x7f7aa00a8340 2020-01-16T05:46:36.387 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.356+0000 7f7aa4de5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7aa013d1b0 0x7f7aa013f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.356+0000 7f7aa4de5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7aa013d1b0 0x7f7aa013f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35684/0 (socket says 172.21.15.84:35684) 2020-01-16T05:46:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.356+0000 7f7aa4de5700 1 -- 172.21.15.84:0/473974348 learned_addr learned my addr 172.21.15.84:0/473974348 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.356+0000 7f7a9ed9d700 1 --2- 172.21.15.84:0/473974348 >> v2:172.21.15.142:3300/0 conn(0x7f7aa00a8340 0x7f7aa008f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7aa4de5700 1 -- 172.21.15.84:0/473974348 >> v2:172.21.15.142:3300/0 conn(0x7f7aa00a8340 msgr2=0x7f7aa008f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7aa4de5700 1 --2- 172.21.15.84:0/473974348 >> v2:172.21.15.142:3300/0 conn(0x7f7aa00a8340 0x7f7aa008f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7aa4de5700 1 -- 172.21.15.84:0/473974348 >> v1:172.21.15.142:6789/0 conn(0x7f7aa008fe20 legacy=0x7f7aa0138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7aa4de5700 1 -- 172.21.15.84:0/473974348 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa0138b80 con 0x7f7aa013d1b0 2020-01-16T05:46:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7a977fe700 1 -- 172.21.15.84:0/473974348 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41682256 0 0) 0x7f7aa00a78b0 con 0x7f7aa008fe20 2020-01-16T05:46:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7aa4de5700 1 --2- 172.21.15.84:0/473974348 >> v2:172.21.15.84:3300/0 conn(0x7f7aa013d1b0 0x7f7aa013f5f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7aa00a6e20 tx=0x7f7a90010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7aa4de5700 1 --2- 172.21.15.84:0/473974348 >> v2:172.21.15.84:3300/0 conn(0x7f7aa013d1b0 0x7f7aa013f5f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7aa00a6e20 tx=0x7f7a90010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7aa4de5700 1 --2- 172.21.15.84:0/473974348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aa013d1b0 0x7f7aa013f5f0 secure :-1 s=READY pgs=357 cs=0 l=1 rx=0x7f7aa00a6e20 tx=0x7f7a90010f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7aa4de5700 1 --2- 172.21.15.84:0/473974348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aa013d1b0 0x7f7aa013f5f0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f7aa00a6e20 tx=0x7f7a90010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7a977fe700 1 -- 172.21.15.84:0/473974348 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a90007540 con 0x7f7aa013d1b0 2020-01-16T05:46:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7aa4de5700 1 --2- 172.21.15.84:0/473974348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aa013d1b0 0x7f7aa013f5f0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f7aa00a6e20 tx=0x7f7a90010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7a9f59e700 1 -- 172.21.15.84:0/473974348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa00a8d50 con 0x7f7aa013d1b0 2020-01-16T05:46:36.390 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7a977fe700 1 -- 172.21.15.84:0/473974348 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a90007160 con 0x7f7aa013d1b0 2020-01-16T05:46:36.390 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7aa4de5700 1 --2- 172.21.15.84:0/473974348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aa013d1b0 0x7f7aa013f5f0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f7aa00a6e20 tx=0x7f7a90010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:36.390 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7a977fe700 1 -- 172.21.15.84:0/473974348 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a900127a0 con 0x7f7aa013d1b0 2020-01-16T05:46:36.390 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7a9f59e700 1 -- 172.21.15.84:0/473974348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa0137d70 con 0x7f7aa013d1b0 2020-01-16T05:46:36.390 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7aa4de5700 1 --2- 172.21.15.84:0/473974348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aa013d1b0 0x7f7aa013f5f0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f7aa00a6e20 tx=0x7f7a90010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:36.390 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7a9f59e700 1 -- 172.21.15.84:0/473974348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa0126a50 con 0x7f7aa013d1b0 2020-01-16T05:46:36.390 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7a977fe700 1 -- 172.21.15.84:0/473974348 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f7a90012a40 con 0x7f7aa013d1b0 2020-01-16T05:46:36.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7aa4de5700 1 --2- 172.21.15.84:0/473974348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aa013d1b0 0x7f7aa013f5f0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f7aa00a6e20 tx=0x7f7a90010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:36.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7a977fe700 1 --2- 172.21.15.84:0/473974348 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7a8403c1c0 0x7f7a8403e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:36.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7a977fe700 1 -- 172.21.15.84:0/473974348 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f7a9004cbe0 con 0x7f7aa013d1b0 2020-01-16T05:46:36.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7a9ed9d700 1 --2- 172.21.15.84:0/473974348 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7a8403c1c0 0x7f7a8403e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:36.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.360+0000 7f7a9ed9d700 1 --2- 172.21.15.84:0/473974348 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7a8403c1c0 0x7f7a8403e6d0 crc :-1 s=READY pgs=143 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:36.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.364+0000 7f7aa4de5700 1 --2- 172.21.15.84:0/473974348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aa013d1b0 0x7f7aa013f5f0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f7aa00a6e20 tx=0x7f7a90010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:36.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.364+0000 7f7a977fe700 1 -- 172.21.15.84:0/473974348 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f7a9000b250 con 0x7f7aa013d1b0 2020-01-16T05:46:36.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.516+0000 7f7a9f59e700 1 -- 172.21.15.84:0/473974348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7aa005e1c0 con 0x7f7aa013d1b0 2020-01-16T05:46:36.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.516+0000 7f7aa4de5700 1 --2- 172.21.15.84:0/473974348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aa013d1b0 0x7f7aa013f5f0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f7aa00a6e20 tx=0x7f7a90010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:36.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.516+0000 7f7a977fe700 1 -- 172.21.15.84:0/473974348 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f7a900331e0 con 0x7f7aa013d1b0 2020-01-16T05:46:36.518 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:36.519 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:36.520 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.520+0000 7f7a9f59e700 1 -- 172.21.15.84:0/473974348 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7a8403c1c0 msgr2=0x7f7a8403e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:36.521 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.520+0000 7f7a9f59e700 1 --2- 172.21.15.84:0/473974348 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7a8403c1c0 0x7f7a8403e6d0 crc :-1 s=READY pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:36.521 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.520+0000 7f7a9f59e700 1 -- 172.21.15.84:0/473974348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aa013d1b0 msgr2=0x7f7aa013f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:36.521 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.520+0000 7f7a9f59e700 1 --2- 172.21.15.84:0/473974348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aa013d1b0 0x7f7aa013f5f0 secure :-1 s=READY pgs=357 cs=0 l=1 rx=0x7f7aa00a6e20 tx=0x7f7a90010f30).stop 2020-01-16T05:46:36.521 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.520+0000 7f7a9f59e700 1 -- 172.21.15.84:0/473974348 shutdown_connections 2020-01-16T05:46:36.521 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.520+0000 7f7a9f59e700 1 --2- 172.21.15.84:0/473974348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aa013d1b0 0x7f7aa013f5f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:36.522 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.520+0000 7f7a9f59e700 1 --2- 172.21.15.84:0/473974348 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7a8403c1c0 0x7f7a8403e6d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:36.522 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.520+0000 7f7a9f59e700 1 --2- 172.21.15.84:0/473974348 >> v2:172.21.15.142:3300/0 conn(0x7f7aa00a8340 0x7f7aa008f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:36.522 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.520+0000 7f7a9f59e700 1 -- 172.21.15.84:0/473974348 shutdown_connections 2020-01-16T05:46:36.522 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.520+0000 7f7a9f59e700 1 -- 172.21.15.84:0/473974348 wait complete. 2020-01-16T05:46:36.522 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:36.520+0000 7f7a9f59e700 1 -- 172.21.15.84:0/473974348 >> 172.21.15.84:0/473974348 conn(0x7f7aa007f130 msgr2=0x7f7aa007dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:36.523 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:36.532 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:46:38.533 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:38.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.648+0000 7fd1d100d700 1 Processor -- start 2020-01-16T05:46:38.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.648+0000 7fd1d100d700 1 -- start start 2020-01-16T05:46:38.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.648+0000 7fd1d100d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd1cc0a9b30 0x7fd1cc0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:38.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.648+0000 7fd1d100d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc07ff10 0x7fd1cc066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:38.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.648+0000 7fd1d100d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1cc066dd0 con 0x7fd1cc0a4250 2020-01-16T05:46:38.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.648+0000 7fd1d100d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1cc0a4830 con 0x7fd1cc0a9b30 2020-01-16T05:46:38.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.648+0000 7fd1d100d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc07f9d0 con 0x7fd1cc07ff10 2020-01-16T05:46:38.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d080c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd1cc0a9b30 0x7fd1cc0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:38.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d226f700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd1cc0a4250 0x7fd1cc0a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:51120/0 (socket says 172.21.15.84:51120) 2020-01-16T05:46:38.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d226f700 1 -- 172.21.15.84:0/1786633210 learned_addr learned my addr 172.21.15.84:0/1786633210 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:38.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1cbfff700 1 --2- 172.21.15.84:0/1786633210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc07ff10 0x7fd1cc066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:38.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d080c700 1 -- 172.21.15.84:0/1786633210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc07ff10 msgr2=0x7fd1cc066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:38.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d080c700 1 --2- 172.21.15.84:0/1786633210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc07ff10 0x7fd1cc066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:38.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d080c700 1 -- 172.21.15.84:0/1786633210 >> v1:172.21.15.142:6789/0 conn(0x7fd1cc0a4250 legacy=0x7fd1cc0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:38.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d080c700 1 -- 172.21.15.84:0/1786633210 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc150ce0 con 0x7fd1cc0a9b30 2020-01-16T05:46:38.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d080c700 1 --2- 172.21.15.84:0/1786633210 >> v2:172.21.15.142:3300/0 conn(0x7fd1cc0a9b30 0x7fd1cc0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd1c4008c90 tx=0x7fd1c4010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:38.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d080c700 1 --2- 172.21.15.84:0/1786633210 >> v2:172.21.15.142:3300/0 conn(0x7fd1cc0a9b30 0x7fd1cc0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd1c4008c90 tx=0x7fd1c4010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:38.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d080c700 1 --2- 172.21.15.84:0/1786633210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1cc0a9b30 0x7fd1cc0abdd0 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7fd1c4008c90 tx=0x7fd1c4010170).ready entity=mon.1 client_cookie=cf6a6ffa6c14f328 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:38.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d080c700 1 --2- 172.21.15.84:0/1786633210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1cc0a9b30 0x7fd1cc0abdd0 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fd1c4008c90 tx=0x7fd1c4010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:38.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1cb7fe700 1 -- 172.21.15.84:0/1786633210 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1c400a160 con 0x7fd1cc0a9b30 2020-01-16T05:46:38.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d080c700 1 --2- 172.21.15.84:0/1786633210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1cc0a9b30 0x7fd1cc0abdd0 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fd1c4008c90 tx=0x7fd1c4010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:38.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d080c700 1 --2- 172.21.15.84:0/1786633210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1cc0a9b30 0x7fd1cc0abdd0 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fd1c4008c90 tx=0x7fd1c4010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:38.668 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1cb7fe700 1 -- 172.21.15.84:0/1786633210 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c4011af0 con 0x7fd1cc0a9b30 2020-01-16T05:46:38.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1cb7fe700 1 -- 172.21.15.84:0/1786633210 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1c400a740 con 0x7fd1cc0a9b30 2020-01-16T05:46:38.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d100d700 1 -- 172.21.15.84:0/1786633210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1cc0a9b30 msgr2=0x7fd1cc0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:38.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d100d700 1 --2- 172.21.15.84:0/1786633210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1cc0a9b30 0x7fd1cc0abdd0 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7fd1c4008c90 tx=0x7fd1c4010170).stop 2020-01-16T05:46:38.669 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d100d700 1 -- 172.21.15.84:0/1786633210 shutdown_connections 2020-01-16T05:46:38.672 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d100d700 1 --2- 172.21.15.84:0/1786633210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1cc0a9b30 0x7fd1cc0abdd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:38.673 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d100d700 1 --2- 172.21.15.84:0/1786633210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc07ff10 0x7fd1cc066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:38.673 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d100d700 1 -- 172.21.15.84:0/1786633210 shutdown_connections 2020-01-16T05:46:38.673 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d100d700 1 -- 172.21.15.84:0/1786633210 wait complete. 2020-01-16T05:46:38.673 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.652+0000 7fd1d100d700 1 -- 172.21.15.84:0/1786633210 >> 172.21.15.84:0/1786633210 conn(0x7fd1cc0acfc0 msgr2=0x7fd1cc0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:38.673 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1d100d700 1 Processor -- start 2020-01-16T05:46:38.673 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1d100d700 1 -- start start 2020-01-16T05:46:38.673 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1d100d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc090c70 0x7fd1cc08f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:38.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1d100d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd1cc129fb0 0x7fd1cc12a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:38.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1d100d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1cc0a9510 con 0x7fd1cc065550 2020-01-16T05:46:38.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1d100d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1cc065a20 con 0x7fd1cc129fb0 2020-01-16T05:46:38.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1d100d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc065cc0 con 0x7fd1cc090c70 2020-01-16T05:46:38.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1d080c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd1cc065550 0x7fd1cc134900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52900/0 (socket says 172.21.15.84:52900) 2020-01-16T05:46:38.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1d080c700 1 -- 172.21.15.84:0/3929607248 learned_addr learned my addr 172.21.15.84:0/3929607248 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:38.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1cbfff700 1 --2- 172.21.15.84:0/3929607248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc090c70 0x7fd1cc08f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:38.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1d226f700 1 --2- 172.21.15.84:0/3929607248 >> v2:172.21.15.142:3300/0 conn(0x7fd1cc129fb0 0x7fd1cc12a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:38.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1c97fa700 1 -- 172.21.15.84:0/3929607248 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837575809 0 0) 0x7fd1cc0a9510 con 0x7fd1cc065550 2020-01-16T05:46:38.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1c97fa700 1 -- 172.21.15.84:0/3929607248 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1ac003230 con 0x7fd1cc065550 2020-01-16T05:46:38.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1c97fa700 1 -- 172.21.15.84:0/3929607248 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4205366713 0 0) 0x7fd1ac003230 con 0x7fd1cc065550 2020-01-16T05:46:38.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1cbfff700 1 -- 172.21.15.84:0/3929607248 >> v2:172.21.15.142:3300/0 conn(0x7fd1cc129fb0 msgr2=0x7fd1cc12a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:38.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1cbfff700 1 --2- 172.21.15.84:0/3929607248 >> v2:172.21.15.142:3300/0 conn(0x7fd1cc129fb0 0x7fd1cc12a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:38.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1cbfff700 1 -- 172.21.15.84:0/3929607248 >> v1:172.21.15.84:6789/0 conn(0x7fd1cc065550 legacy=0x7fd1cc134900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:38.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1cbfff700 1 -- 172.21.15.84:0/3929607248 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc12a930 con 0x7fd1cc090c70 2020-01-16T05:46:38.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1cbfff700 1 --2- 172.21.15.84:0/3929607248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc090c70 0x7fd1cc08f6c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd1c4007b70 tx=0x7fd1c4010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:38.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1cbfff700 1 --2- 172.21.15.84:0/3929607248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc090c70 0x7fd1cc08f6c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd1c4007b70 tx=0x7fd1c4010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:38.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1cbfff700 1 --2- 172.21.15.84:0/3929607248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc090c70 0x7fd1cc08f6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fd1c4007b70 tx=0x7fd1c4010680).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:38.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1cbfff700 1 --2- 172.21.15.84:0/3929607248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc090c70 0x7fd1cc08f6c0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fd1c4007b70 tx=0x7fd1c4010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:38.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1c97fa700 1 -- 172.21.15.84:0/3929607248 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1c400a160 con 0x7fd1cc090c70 2020-01-16T05:46:38.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1cbfff700 1 --2- 172.21.15.84:0/3929607248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc090c70 0x7fd1cc08f6c0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fd1c4007b70 tx=0x7fd1c4010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:38.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1cbfff700 1 --2- 172.21.15.84:0/3929607248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc090c70 0x7fd1cc08f6c0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fd1c4007b70 tx=0x7fd1c4010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:38.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1d100d700 1 -- 172.21.15.84:0/3929607248 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1cc135100 con 0x7fd1cc090c70 2020-01-16T05:46:38.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1c97fa700 1 -- 172.21.15.84:0/3929607248 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c400a360 con 0x7fd1cc090c70 2020-01-16T05:46:38.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1c97fa700 1 -- 172.21.15.84:0/3929607248 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1c0012b70 con 0x7fd1cc090c70 2020-01-16T05:46:38.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1d100d700 1 -- 172.21.15.84:0/3929607248 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1cc13f310 con 0x7fd1cc090c70 2020-01-16T05:46:38.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.656+0000 7fd1cbfff700 1 --2- 172.21.15.84:0/3929607248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc090c70 0x7fd1cc08f6c0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fd1c4007b70 tx=0x7fd1c4010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:38.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.660+0000 7fd1d100d700 1 -- 172.21.15.84:0/3929607248 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1cc05e1c0 con 0x7fd1cc090c70 2020-01-16T05:46:38.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.660+0000 7fd1cbfff700 1 --2- 172.21.15.84:0/3929607248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc090c70 0x7fd1cc08f6c0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fd1c4007b70 tx=0x7fd1c4010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:38.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.660+0000 7fd1c97fa700 1 -- 172.21.15.84:0/3929607248 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fd1c0007170 con 0x7fd1cc090c70 2020-01-16T05:46:38.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.660+0000 7fd1c97fa700 1 --2- 172.21.15.84:0/3929607248 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd1ac03c790 0x7fd1ac03eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:38.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.660+0000 7fd1c97fa700 1 -- 172.21.15.84:0/3929607248 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fd1c0013060 con 0x7fd1cc090c70 2020-01-16T05:46:38.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.660+0000 7fd1d080c700 1 --2- 172.21.15.84:0/3929607248 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd1ac03c790 0x7fd1ac03eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:38.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.660+0000 7fd1d080c700 1 --2- 172.21.15.84:0/3929607248 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd1ac03c790 0x7fd1ac03eca0 crc :-1 s=READY pgs=144 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:38.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.668+0000 7fd1cbfff700 1 --2- 172.21.15.84:0/3929607248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc090c70 0x7fd1cc08f6c0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fd1c4007b70 tx=0x7fd1c4010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:38.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.668+0000 7fd1c97fa700 1 -- 172.21.15.84:0/3929607248 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fd1cc12a930 con 0x7fd1cc090c70 2020-01-16T05:46:38.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.820+0000 7fd1d100d700 1 -- 172.21.15.84:0/3929607248 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1cc05cbc0 con 0x7fd1cc090c70 2020-01-16T05:46:38.822 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.820+0000 7fd1cbfff700 1 --2- 172.21.15.84:0/3929607248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc090c70 0x7fd1cc08f6c0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fd1c4007b70 tx=0x7fd1c4010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:38.822 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.820+0000 7fd1c97fa700 1 -- 172.21.15.84:0/3929607248 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fd1c000d0b0 con 0x7fd1cc090c70 2020-01-16T05:46:38.822 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:38.822 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:38.823 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.820+0000 7fd1d100d700 1 -- 172.21.15.84:0/3929607248 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd1ac03c790 msgr2=0x7fd1ac03eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:38.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.820+0000 7fd1d100d700 1 --2- 172.21.15.84:0/3929607248 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd1ac03c790 0x7fd1ac03eca0 crc :-1 s=READY pgs=144 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:38.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.820+0000 7fd1d100d700 1 -- 172.21.15.84:0/3929607248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc090c70 msgr2=0x7fd1cc08f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:38.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.820+0000 7fd1d100d700 1 --2- 172.21.15.84:0/3929607248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc090c70 0x7fd1cc08f6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fd1c4007b70 tx=0x7fd1c4010680).stop 2020-01-16T05:46:38.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.820+0000 7fd1d100d700 1 -- 172.21.15.84:0/3929607248 shutdown_connections 2020-01-16T05:46:38.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.820+0000 7fd1d100d700 1 --2- 172.21.15.84:0/3929607248 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd1ac03c790 0x7fd1ac03eca0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:38.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.820+0000 7fd1d100d700 1 --2- 172.21.15.84:0/3929607248 >> v2:172.21.15.142:3300/0 conn(0x7fd1cc129fb0 0x7fd1cc12a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:38.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.820+0000 7fd1d100d700 1 --2- 172.21.15.84:0/3929607248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc090c70 0x7fd1cc08f6c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:38.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.820+0000 7fd1d100d700 1 -- 172.21.15.84:0/3929607248 shutdown_connections 2020-01-16T05:46:38.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.820+0000 7fd1d100d700 1 -- 172.21.15.84:0/3929607248 wait complete. 2020-01-16T05:46:38.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:38.820+0000 7fd1d100d700 1 -- 172.21.15.84:0/3929607248 >> 172.21.15.84:0/3929607248 conn(0x7fd1cc091c30 msgr2=0x7fd1cc0246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:38.825 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:38.840 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:40.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~133s 2020-01-16T05:46:40.844 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:40.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.964+0000 7f6ce3990700 1 Processor -- start 2020-01-16T05:46:40.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.964+0000 7f6ce3990700 1 -- start start 2020-01-16T05:46:40.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce3990700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6cdc0a2f60 0x7f6cdc05b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce3990700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc0a8ff0 0x7f6cdc08fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce3990700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6cdc07c560 0x7f6cdc07c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce3990700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cdc0a3390 con 0x7f6cdc07c560 2020-01-16T05:46:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce3990700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cdc0905b0 con 0x7f6cdc0a2f60 2020-01-16T05:46:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce3990700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc0a2a20 con 0x7f6cdc0a8ff0 2020-01-16T05:46:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce272e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6cdc07c560 0x7f6cdc07c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce272e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6cdc07c560 0x7f6cdc07c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35710/0 (socket says 172.21.15.84:35710) 2020-01-16T05:46:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce272e700 1 -- 172.21.15.84:0/2580940329 learned_addr learned my addr 172.21.15.84:0/2580940329 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce172c700 1 --2- 172.21.15.84:0/2580940329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc0a8ff0 0x7f6cdc08fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce1f2d700 1 --2- 172.21.15.84:0/2580940329 >> v2:172.21.15.142:3300/0 conn(0x7f6cdc0a2f60 0x7f6cdc05b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce272e700 1 -- 172.21.15.84:0/2580940329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc0a8ff0 msgr2=0x7f6cdc08fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce272e700 1 --2- 172.21.15.84:0/2580940329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc0a8ff0 0x7f6cdc08fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce272e700 1 -- 172.21.15.84:0/2580940329 >> v2:172.21.15.142:3300/0 conn(0x7f6cdc0a2f60 msgr2=0x7f6cdc05b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce272e700 1 --2- 172.21.15.84:0/2580940329 >> v2:172.21.15.142:3300/0 conn(0x7f6cdc0a2f60 0x7f6cdc05b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce272e700 1 -- 172.21.15.84:0/2580940329 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc0902d0 con 0x7f6cdc07c560 2020-01-16T05:46:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce272e700 1 --2- 172.21.15.84:0/2580940329 >> v2:172.21.15.84:3300/0 conn(0x7f6cdc07c560 0x7f6cdc07c990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6cdc090770 tx=0x7f6ccc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce272e700 1 --2- 172.21.15.84:0/2580940329 >> v2:172.21.15.84:3300/0 conn(0x7f6cdc07c560 0x7f6cdc07c990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6cdc090770 tx=0x7f6ccc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce272e700 1 --2- 172.21.15.84:0/2580940329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cdc07c560 0x7f6cdc07c990 secure :-1 s=READY pgs=361 cs=0 l=1 rx=0x7f6cdc090770 tx=0x7f6ccc00ff30).ready entity=mon.0 client_cookie=dcf219a841201755 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce272e700 1 --2- 172.21.15.84:0/2580940329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cdc07c560 0x7f6cdc07c990 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f6cdc090770 tx=0x7f6ccc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce0f2b700 1 -- 172.21.15.84:0/2580940329 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ccc011760 con 0x7f6cdc07c560 2020-01-16T05:46:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce272e700 1 --2- 172.21.15.84:0/2580940329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cdc07c560 0x7f6cdc07c990 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f6cdc090770 tx=0x7f6ccc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce272e700 1 --2- 172.21.15.84:0/2580940329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cdc07c560 0x7f6cdc07c990 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f6cdc090770 tx=0x7f6ccc00ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:40.975 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce0f2b700 1 -- 172.21.15.84:0/2580940329 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc008d30 con 0x7f6cdc07c560 2020-01-16T05:46:40.975 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce0f2b700 1 -- 172.21.15.84:0/2580940329 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ccc011d40 con 0x7f6cdc07c560 2020-01-16T05:46:40.975 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce3990700 1 -- 172.21.15.84:0/2580940329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cdc07c560 msgr2=0x7f6cdc07c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:40.975 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce3990700 1 --2- 172.21.15.84:0/2580940329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cdc07c560 0x7f6cdc07c990 secure :-1 s=READY pgs=361 cs=0 l=1 rx=0x7f6cdc090770 tx=0x7f6ccc00ff30).stop 2020-01-16T05:46:40.975 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce3990700 1 -- 172.21.15.84:0/2580940329 shutdown_connections 2020-01-16T05:46:40.975 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce3990700 1 --2- 172.21.15.84:0/2580940329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cdc07c560 0x7f6cdc07c990 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce3990700 1 --2- 172.21.15.84:0/2580940329 >> v2:172.21.15.142:3300/0 conn(0x7f6cdc0a2f60 0x7f6cdc05b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce3990700 1 --2- 172.21.15.84:0/2580940329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc0a8ff0 0x7f6cdc08fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce3990700 1 -- 172.21.15.84:0/2580940329 shutdown_connections 2020-01-16T05:46:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce3990700 1 -- 172.21.15.84:0/2580940329 wait complete. 2020-01-16T05:46:40.976 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.968+0000 7f6ce3990700 1 -- 172.21.15.84:0/2580940329 >> 172.21.15.84:0/2580940329 conn(0x7f6cdc0abc10 msgr2=0x7f6cdc05a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:40.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce3990700 1 Processor -- start 2020-01-16T05:46:40.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce3990700 1 -- start start 2020-01-16T05:46:40.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce3990700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6cdc0a4820 0x7f6cdc0a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:40.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce3990700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc09dbb0 0x7f6cdc134bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:40.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce3990700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cdc0a1b20 con 0x7f6cdc09d780 2020-01-16T05:46:40.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce3990700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cdc0a42e0 con 0x7f6cdc0a4820 2020-01-16T05:46:40.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce3990700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc0a4580 con 0x7f6cdc09dbb0 2020-01-16T05:46:40.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce172c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f6cdc09d780 0x7f6cdc07d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:51140/0 (socket says 172.21.15.84:51140) 2020-01-16T05:46:40.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce172c700 1 -- 172.21.15.84:0/3325467595 learned_addr learned my addr 172.21.15.84:0/3325467595 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:40.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce1f2d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6cdc0a4820 0x7f6cdc0a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:40.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce272e700 1 --2- 172.21.15.84:0/3325467595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc09dbb0 0x7f6cdc134bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:40.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce272e700 1 -- 172.21.15.84:0/3325467595 >> v2:172.21.15.142:3300/0 conn(0x7f6cdc0a4820 msgr2=0x7f6cdc0a3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:40.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce272e700 1 --2- 172.21.15.84:0/3325467595 >> v2:172.21.15.142:3300/0 conn(0x7f6cdc0a4820 0x7f6cdc0a3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:40.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce272e700 1 -- 172.21.15.84:0/3325467595 >> v1:172.21.15.142:6789/0 conn(0x7f6cdc09d780 legacy=0x7f6cdc07d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:40.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6cda7fc700 1 -- 172.21.15.84:0/3325467595 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930006558 0 0) 0x7f6cdc0a1b20 con 0x7f6cdc09d780 2020-01-16T05:46:40.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce272e700 1 -- 172.21.15.84:0/3325467595 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc127780 con 0x7f6cdc09dbb0 2020-01-16T05:46:40.982 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce1f2d700 1 --2- 172.21.15.84:0/3325467595 >> v2:172.21.15.142:3300/0 conn(0x7f6cdc0a4820 0x7f6cdc0a3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:46:40.982 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce272e700 1 --2- 172.21.15.84:0/3325467595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc09dbb0 0x7f6cdc134bd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6cdc090770 tx=0x7f6ccc0115f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:40.982 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce272e700 1 --2- 172.21.15.84:0/3325467595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc09dbb0 0x7f6cdc134bd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6cdc090770 tx=0x7f6ccc0115f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:40.982 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce272e700 1 --2- 172.21.15.84:0/3325467595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc09dbb0 0x7f6cdc134bd0 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f6cdc090770 tx=0x7f6ccc0115f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:40.982 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce272e700 1 --2- 172.21.15.84:0/3325467595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc09dbb0 0x7f6cdc134bd0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f6cdc090770 tx=0x7f6ccc0115f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:40.982 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6cda7fc700 1 -- 172.21.15.84:0/3325467595 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ccc00f760 con 0x7f6cdc09dbb0 2020-01-16T05:46:40.983 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce272e700 1 --2- 172.21.15.84:0/3325467595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc09dbb0 0x7f6cdc134bd0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f6cdc090770 tx=0x7f6ccc0115f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:40.983 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce3990700 1 -- 172.21.15.84:0/3325467595 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cdc135120 con 0x7f6cdc09dbb0 2020-01-16T05:46:40.983 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6cda7fc700 1 -- 172.21.15.84:0/3325467595 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc011960 con 0x7f6cdc09dbb0 2020-01-16T05:46:40.983 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce272e700 1 --2- 172.21.15.84:0/3325467595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc09dbb0 0x7f6cdc134bd0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f6cdc090770 tx=0x7f6ccc0115f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:40.983 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6cda7fc700 1 -- 172.21.15.84:0/3325467595 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ccc007530 con 0x7f6cdc09dbb0 2020-01-16T05:46:40.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.972+0000 7f6ce3990700 1 -- 172.21.15.84:0/3325467595 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cdc13f5e0 con 0x7f6cdc09dbb0 2020-01-16T05:46:40.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.976+0000 7f6ce272e700 1 --2- 172.21.15.84:0/3325467595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc09dbb0 0x7f6cdc134bd0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f6cdc090770 tx=0x7f6ccc0115f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:40.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.976+0000 7f6cda7fc700 1 -- 172.21.15.84:0/3325467595 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f6ccc0056c0 con 0x7f6cdc09dbb0 2020-01-16T05:46:40.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.976+0000 7f6ce272e700 1 --2- 172.21.15.84:0/3325467595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc09dbb0 0x7f6cdc134bd0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f6cdc090770 tx=0x7f6ccc0115f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:40.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.976+0000 7f6ce3990700 1 -- 172.21.15.84:0/3325467595 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cdc05e1c0 con 0x7f6cdc09dbb0 2020-01-16T05:46:40.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.976+0000 7f6cda7fc700 1 --2- 172.21.15.84:0/3325467595 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6cbc03c1e0 0x7f6cbc03e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:40.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.976+0000 7f6cda7fc700 1 -- 172.21.15.84:0/3325467595 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f6ccc090eb0 con 0x7f6cdc09dbb0 2020-01-16T05:46:40.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.976+0000 7f6ce1f2d700 1 --2- 172.21.15.84:0/3325467595 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6cbc03c1e0 0x7f6cbc03e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:40.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.976+0000 7f6ce1f2d700 1 --2- 172.21.15.84:0/3325467595 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6cbc03c1e0 0x7f6cbc03e6f0 crc :-1 s=READY pgs=145 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:40.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.984+0000 7f6ce272e700 1 --2- 172.21.15.84:0/3325467595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc09dbb0 0x7f6cdc134bd0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f6cdc090770 tx=0x7f6ccc0115f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:40.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:40.984+0000 7f6cda7fc700 1 -- 172.21.15.84:0/3325467595 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f6ccc0774b0 con 0x7f6cdc09dbb0 2020-01-16T05:46:41.140 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:41.140+0000 7f6ce3990700 1 -- 172.21.15.84:0/3325467595 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cdc08f350 con 0x7f6cdc09dbb0 2020-01-16T05:46:41.142 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:41.140+0000 7f6ce272e700 1 --2- 172.21.15.84:0/3325467595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc09dbb0 0x7f6cdc134bd0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f6cdc090770 tx=0x7f6ccc0115f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:41.142 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:41.140+0000 7f6cda7fc700 1 -- 172.21.15.84:0/3325467595 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f6ccc077710 con 0x7f6cdc09dbb0 2020-01-16T05:46:41.142 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:41.142 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:41.144+0000 7f6ce3990700 1 -- 172.21.15.84:0/3325467595 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6cbc03c1e0 msgr2=0x7f6cbc03e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:41.144+0000 7f6ce3990700 1 --2- 172.21.15.84:0/3325467595 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6cbc03c1e0 0x7f6cbc03e6f0 crc :-1 s=READY pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:41.144+0000 7f6ce3990700 1 -- 172.21.15.84:0/3325467595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc09dbb0 msgr2=0x7f6cdc134bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:41.144+0000 7f6ce3990700 1 --2- 172.21.15.84:0/3325467595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc09dbb0 0x7f6cdc134bd0 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f6cdc090770 tx=0x7f6ccc0115f0).stop 2020-01-16T05:46:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:41.144+0000 7f6ce3990700 1 -- 172.21.15.84:0/3325467595 shutdown_connections 2020-01-16T05:46:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:41.144+0000 7f6ce3990700 1 --2- 172.21.15.84:0/3325467595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cdc09dbb0 0x7f6cdc134bd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:41.144+0000 7f6ce3990700 1 --2- 172.21.15.84:0/3325467595 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f6cbc03c1e0 0x7f6cbc03e6f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:41.144+0000 7f6ce3990700 1 --2- 172.21.15.84:0/3325467595 >> v2:172.21.15.142:3300/0 conn(0x7f6cdc0a4820 0x7f6cdc0a3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:41.144+0000 7f6ce3990700 1 -- 172.21.15.84:0/3325467595 shutdown_connections 2020-01-16T05:46:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:41.144+0000 7f6ce3990700 1 -- 172.21.15.84:0/3325467595 wait complete. 2020-01-16T05:46:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:41.144+0000 7f6ce3990700 1 -- 172.21.15.84:0/3325467595 >> 172.21.15.84:0/3325467595 conn(0x7f6cdc090a70 msgr2=0x7f6cdc129d60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:41.170 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:43.172 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:43.298 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.288+0000 7f147b59e700 1 Processor -- start 2020-01-16T05:46:43.298 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.288+0000 7f147b59e700 1 -- start start 2020-01-16T05:46:43.299 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147b59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f147c0a4250 0x7f147c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:43.299 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147b59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c066880 con 0x7f147c07ff10 2020-01-16T05:46:43.299 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147b59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c066ab0 con 0x7f147c0a9b30 2020-01-16T05:46:43.299 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147b59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0a4830 con 0x7f147c0a4250 2020-01-16T05:46:43.300 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147a59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f147c07ff10 0x7f147c14dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52924/0 (socket says 172.21.15.84:52924) 2020-01-16T05:46:43.300 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147a59c700 1 -- 172.21.15.84:0/2780336448 learned_addr learned my addr 172.21.15.84:0/2780336448 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:43.301 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1480c13700 1 --2- 172.21.15.84:0/2780336448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f147c0a4250 0x7f147c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:43.301 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1479d9b700 1 -- 172.21.15.84:0/2780336448 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166567295 0 0) 0x7f147c066880 con 0x7f147c07ff10 2020-01-16T05:46:43.307 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1479d9b700 1 -- 172.21.15.84:0/2780336448 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1464003230 con 0x7f147c07ff10 2020-01-16T05:46:43.307 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1479d9b700 1 -- 172.21.15.84:0/2780336448 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3238158956 0 0) 0x7f1464003230 con 0x7f147c07ff10 2020-01-16T05:46:43.307 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1479d9b700 1 -- 172.21.15.84:0/2780336448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f147c0a4250 msgr2=0x7f147c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:43.307 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1479d9b700 1 --2- 172.21.15.84:0/2780336448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f147c0a4250 0x7f147c0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:43.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1479d9b700 1 -- 172.21.15.84:0/2780336448 >> v1:172.21.15.142:6789/0 conn(0x7f147c0a9b30 legacy=0x7f147c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:43.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1479d9b700 1 -- 172.21.15.84:0/2780336448 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c066ce0 con 0x7f147c07ff10 2020-01-16T05:46:43.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1479d9b700 1 -- 172.21.15.84:0/2780336448 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f1470001750 con 0x7f147c07ff10 2020-01-16T05:46:43.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1479d9b700 1 -- 172.21.15.84:0/2780336448 >> v1:172.21.15.84:6789/0 conn(0x7f147c07ff10 legacy=0x7f147c14dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:43.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1479d9b700 1 --2- 172.21.15.84:0/2780336448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1464003890 0x7f1464003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:43.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1479d9b700 1 --2- 172.21.15.84:0/2780336448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14640045a0 0x7f14640049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:43.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1479d9b700 1 --2- 172.21.15.84:0/2780336448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1464004f20 0x7f146400b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:43.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1479d9b700 1 -- 172.21.15.84:0/2780336448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0a4830 con 0x7f14640045a0 2020-01-16T05:46:43.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1479d9b700 1 -- 172.21.15.84:0/2780336448 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1464005350 con 0x7f1464003890 2020-01-16T05:46:43.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1479d9b700 1 -- 172.21.15.84:0/2780336448 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146404fd50 con 0x7f1464004f20 2020-01-16T05:46:43.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147a59c700 1 --2- 172.21.15.84:0/2780336448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14640045a0 0x7f14640049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:43.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147ad9d700 1 --2- 172.21.15.84:0/2780336448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1464003890 0x7f1464003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:43.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1480c13700 1 --2- 172.21.15.84:0/2780336448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1464004f20 0x7f146400b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:43.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147a59c700 1 -- 172.21.15.84:0/2780336448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1464004f20 msgr2=0x7f146400b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:43.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147a59c700 1 --2- 172.21.15.84:0/2780336448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1464004f20 0x7f146400b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:43.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147a59c700 1 -- 172.21.15.84:0/2780336448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1464003890 msgr2=0x7f1464003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:43.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147a59c700 1 --2- 172.21.15.84:0/2780336448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1464003890 0x7f1464003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:43.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147a59c700 1 -- 172.21.15.84:0/2780336448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146404ffd0 con 0x7f14640045a0 2020-01-16T05:46:43.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147a59c700 1 --2- 172.21.15.84:0/2780336448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14640045a0 0x7f14640049d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1470001460 tx=0x7f147000c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:43.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147a59c700 1 --2- 172.21.15.84:0/2780336448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14640045a0 0x7f14640049d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1470001460 tx=0x7f147000c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:43.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147a59c700 1 --2- 172.21.15.84:0/2780336448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14640045a0 0x7f14640049d0 secure :-1 s=READY pgs=363 cs=0 l=1 rx=0x7f1470001460 tx=0x7f147000c2c0).ready entity=mon.0 client_cookie=90429d7fc9dc6685 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:43.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147a59c700 1 --2- 172.21.15.84:0/2780336448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14640045a0 0x7f14640049d0 secure :-1 s=THROTTLE_DONE pgs=363 cs=0 l=1 rx=0x7f1470001460 tx=0x7f147000c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:43.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1479d9b700 1 -- 172.21.15.84:0/2780336448 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14700057d0 con 0x7f14640045a0 2020-01-16T05:46:43.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147a59c700 1 --2- 172.21.15.84:0/2780336448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14640045a0 0x7f14640049d0 secure :-1 s=THROTTLE_DONE pgs=363 cs=0 l=1 rx=0x7f1470001460 tx=0x7f147000c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:43.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1479d9b700 1 -- 172.21.15.84:0/2780336448 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147000edf0 con 0x7f14640045a0 2020-01-16T05:46:43.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147a59c700 1 --2- 172.21.15.84:0/2780336448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14640045a0 0x7f14640049d0 secure :-1 s=THROTTLE_DONE pgs=363 cs=0 l=1 rx=0x7f1470001460 tx=0x7f147000c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:43.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1479d9b700 1 -- 172.21.15.84:0/2780336448 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1470005db0 con 0x7f14640045a0 2020-01-16T05:46:43.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147b59e700 1 -- 172.21.15.84:0/2780336448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14640045a0 msgr2=0x7f14640049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:43.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f147b59e700 1 --2- 172.21.15.84:0/2780336448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14640045a0 0x7f14640049d0 secure :-1 s=READY pgs=363 cs=0 l=1 rx=0x7f1470001460 tx=0x7f147000c2c0).stop 2020-01-16T05:46:43.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.292+0000 7f1480c13700 1 -- 172.21.15.84:0/2780336448 reap_dead start 2020-01-16T05:46:43.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.296+0000 7f147b59e700 1 -- 172.21.15.84:0/2780336448 shutdown_connections 2020-01-16T05:46:43.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.296+0000 7f147b59e700 1 -- 172.21.15.84:0/2780336448 shutdown_connections 2020-01-16T05:46:43.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.296+0000 7f147b59e700 1 -- 172.21.15.84:0/2780336448 wait complete. 2020-01-16T05:46:43.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.296+0000 7f147b59e700 1 -- 172.21.15.84:0/2780336448 >> 172.21.15.84:0/2780336448 conn(0x7f147c0acfc0 msgr2=0x7f147c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:43.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.296+0000 7f147b59e700 1 Processor -- start 2020-01-16T05:46:43.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.296+0000 7f147b59e700 1 -- start start 2020-01-16T05:46:43.316 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.296+0000 7f147b59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f147c127b70 0x7f147c125600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.296+0000 7f147b59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f147c135b70 0x7f147c07c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.296+0000 7f147b59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c135fa0 con 0x7f147c1231d0 2020-01-16T05:46:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.296+0000 7f147b59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147c128540 con 0x7f147c135b70 2020-01-16T05:46:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.296+0000 7f147b59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c125360 con 0x7f147c127b70 2020-01-16T05:46:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.296+0000 7f147ad9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f147c1231d0 0x7f147c07be50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52932/0 (socket says 172.21.15.84:52932) 2020-01-16T05:46:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.296+0000 7f147ad9d700 1 -- 172.21.15.84:0/1099402306 learned_addr learned my addr 172.21.15.84:0/1099402306 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f1480c13700 1 --2- 172.21.15.84:0/1099402306 >> v2:172.21.15.84:3300/0 conn(0x7f147c135b70 0x7f147c07c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f147a59c700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f147c127b70 0x7f147c125600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f146b7fe700 1 -- 172.21.15.84:0/1099402306 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176876092 0 0) 0x7f147c135fa0 con 0x7f147c1231d0 2020-01-16T05:46:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f146b7fe700 1 -- 172.21.15.84:0/1099402306 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1460003230 con 0x7f147c1231d0 2020-01-16T05:46:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f1480c13700 1 -- 172.21.15.84:0/1099402306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f147c127b70 msgr2=0x7f147c125600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:43.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f1480c13700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f147c127b70 0x7f147c125600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:43.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f1480c13700 1 -- 172.21.15.84:0/1099402306 >> v1:172.21.15.84:6789/0 conn(0x7f147c1231d0 legacy=0x7f147c07be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:43.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f1480c13700 1 -- 172.21.15.84:0/1099402306 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c07cba0 con 0x7f147c135b70 2020-01-16T05:46:43.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f147a59c700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f147c127b70 0x7f147c125600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:46:43.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f1480c13700 1 --2- 172.21.15.84:0/1099402306 >> v2:172.21.15.84:3300/0 conn(0x7f147c135b70 0x7f147c07c650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f147c128700 tx=0x7f1474010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:43.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f1480c13700 1 --2- 172.21.15.84:0/1099402306 >> v2:172.21.15.84:3300/0 conn(0x7f147c135b70 0x7f147c07c650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f147c128700 tx=0x7f1474010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:43.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f1480c13700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f147c135b70 0x7f147c07c650 secure :-1 s=READY pgs=365 cs=0 l=1 rx=0x7f147c128700 tx=0x7f1474010ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:43.320 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f1480c13700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f147c135b70 0x7f147c07c650 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f147c128700 tx=0x7f1474010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:43.320 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f146b7fe700 1 -- 172.21.15.84:0/1099402306 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1474011820 con 0x7f147c135b70 2020-01-16T05:46:43.320 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f1480c13700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f147c135b70 0x7f147c07c650 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f147c128700 tx=0x7f1474010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:43.321 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f146b7fe700 1 -- 172.21.15.84:0/1099402306 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1474005a40 con 0x7f147c135b70 2020-01-16T05:46:43.321 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f147b59e700 1 -- 172.21.15.84:0/1099402306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147c066270 con 0x7f147c135b70 2020-01-16T05:46:43.321 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f1480c13700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f147c135b70 0x7f147c07c650 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f147c128700 tx=0x7f1474010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:43.321 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f146b7fe700 1 -- 172.21.15.84:0/1099402306 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1474011e00 con 0x7f147c135b70 2020-01-16T05:46:43.321 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f147b59e700 1 -- 172.21.15.84:0/1099402306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c13d1f0 con 0x7f147c135b70 2020-01-16T05:46:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f1480c13700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f147c135b70 0x7f147c07c650 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f147c128700 tx=0x7f1474010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f147b59e700 1 -- 172.21.15.84:0/1099402306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147c05f480 con 0x7f147c135b70 2020-01-16T05:46:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f146b7fe700 1 -- 172.21.15.84:0/1099402306 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f1474008760 con 0x7f147c135b70 2020-01-16T05:46:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f1480c13700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f147c135b70 0x7f147c07c650 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f147c128700 tx=0x7f1474010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f146b7fe700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f146003c800 0x7f146003ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f146b7fe700 1 -- 172.21.15.84:0/1099402306 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f147404c480 con 0x7f147c135b70 2020-01-16T05:46:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f147ad9d700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f146003c800 0x7f146003ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.300+0000 7f147ad9d700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f146003c800 0x7f146003ed10 crc :-1 s=READY pgs=146 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.308+0000 7f1480c13700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f147c135b70 0x7f147c07c650 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f147c128700 tx=0x7f1474010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:43.323 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.308+0000 7f146b7fe700 1 -- 172.21.15.84:0/1099402306 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f1474032a80 con 0x7f147c135b70 2020-01-16T05:46:43.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.460+0000 7f147b59e700 1 -- 172.21.15.84:0/1099402306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f147c05e1c0 con 0x7f147c135b70 2020-01-16T05:46:43.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.460+0000 7f1480c13700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f147c135b70 0x7f147c07c650 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f147c128700 tx=0x7f1474010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:43.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.460+0000 7f146b7fe700 1 -- 172.21.15.84:0/1099402306 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f1474032ce0 con 0x7f147c135b70 2020-01-16T05:46:43.463 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:43.463 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:43.465 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.464+0000 7f147b59e700 1 -- 172.21.15.84:0/1099402306 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f146003c800 msgr2=0x7f146003ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:43.465 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.464+0000 7f147b59e700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f146003c800 0x7f146003ed10 crc :-1 s=READY pgs=146 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:43.466 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.464+0000 7f147b59e700 1 -- 172.21.15.84:0/1099402306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f147c135b70 msgr2=0x7f147c07c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:43.466 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.464+0000 7f147b59e700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f147c135b70 0x7f147c07c650 secure :-1 s=READY pgs=365 cs=0 l=1 rx=0x7f147c128700 tx=0x7f1474010ea0).stop 2020-01-16T05:46:43.466 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.464+0000 7f147b59e700 1 -- 172.21.15.84:0/1099402306 shutdown_connections 2020-01-16T05:46:43.466 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.464+0000 7f147b59e700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f146003c800 0x7f146003ed10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:43.466 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.464+0000 7f147b59e700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f147c135b70 0x7f147c07c650 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:43.467 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.464+0000 7f147b59e700 1 --2- 172.21.15.84:0/1099402306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f147c127b70 0x7f147c125600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:43.467 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.464+0000 7f147b59e700 1 -- 172.21.15.84:0/1099402306 shutdown_connections 2020-01-16T05:46:43.467 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.464+0000 7f147b59e700 1 -- 172.21.15.84:0/1099402306 wait complete. 2020-01-16T05:46:43.467 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:43.464+0000 7f147b59e700 1 -- 172.21.15.84:0/1099402306 >> 172.21.15.84:0/1099402306 conn(0x7f147c066a10 msgr2=0x7f147c024940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:43.467 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:43.489 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:44.203 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:46:44.213 INFO:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:46:45.490 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:45.616 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.608+0000 7f754511b700 1 Processor -- start 2020-01-16T05:46:45.616 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.608+0000 7f754511b700 1 -- start start 2020-01-16T05:46:45.616 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.608+0000 7f754511b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75400a4250 0x7f75400abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:45.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.608+0000 7f754511b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7540066880 con 0x7f754007ff10 2020-01-16T05:46:45.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.608+0000 7f754511b700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7540066ab0 con 0x7f75400a9b30 2020-01-16T05:46:45.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.608+0000 7f754511b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75400a4830 con 0x7f75400a4250 2020-01-16T05:46:45.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.608+0000 7f754637d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75400a4250 0x7f75400abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:45.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.608+0000 7f753ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f754007ff10 0x7f754014dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52944/0 (socket says 172.21.15.84:52944) 2020-01-16T05:46:45.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.608+0000 7f753ffff700 1 -- 172.21.15.84:0/831012783 learned_addr learned my addr 172.21.15.84:0/831012783 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:45.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f753f7fe700 1 -- 172.21.15.84:0/831012783 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663246612 0 0) 0x7f7540066880 con 0x7f754007ff10 2020-01-16T05:46:45.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f754637d700 1 -- 172.21.15.84:0/831012783 >> v1:172.21.15.142:6789/0 conn(0x7f75400a9b30 legacy=0x7f75400a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:45.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f754637d700 1 -- 172.21.15.84:0/831012783 >> v1:172.21.15.84:6789/0 conn(0x7f754007ff10 legacy=0x7f754014dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:45.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f754637d700 1 -- 172.21.15.84:0/831012783 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7540066ce0 con 0x7f75400a4250 2020-01-16T05:46:45.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f754637d700 1 --2- 172.21.15.84:0/831012783 >> v2:172.21.15.84:3300/0 conn(0x7f75400a4250 0x7f75400abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7530008910 tx=0x7f753000fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:45.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f754637d700 1 --2- 172.21.15.84:0/831012783 >> v2:172.21.15.84:3300/0 conn(0x7f75400a4250 0x7f75400abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7530008910 tx=0x7f753000fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:45.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f754637d700 1 --2- 172.21.15.84:0/831012783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75400a4250 0x7f75400abdd0 secure :-1 s=READY pgs=367 cs=0 l=1 rx=0x7f7530008910 tx=0x7f753000fd70).ready entity=mon.0 client_cookie=7e395483d2d488e server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:45.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f754637d700 1 --2- 172.21.15.84:0/831012783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75400a4250 0x7f75400abdd0 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f7530008910 tx=0x7f753000fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:45.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f753f7fe700 1 -- 172.21.15.84:0/831012783 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75300115e0 con 0x7f75400a4250 2020-01-16T05:46:45.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f754637d700 1 --2- 172.21.15.84:0/831012783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75400a4250 0x7f75400abdd0 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f7530008910 tx=0x7f753000fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:45.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f753f7fe700 1 -- 172.21.15.84:0/831012783 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7530008d40 con 0x7f75400a4250 2020-01-16T05:46:45.619 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f754637d700 1 --2- 172.21.15.84:0/831012783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75400a4250 0x7f75400abdd0 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f7530008910 tx=0x7f753000fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:45.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f754511b700 1 -- 172.21.15.84:0/831012783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75400a4250 msgr2=0x7f75400abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:45.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f753f7fe700 1 -- 172.21.15.84:0/831012783 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7530011bc0 con 0x7f75400a4250 2020-01-16T05:46:45.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f754511b700 1 --2- 172.21.15.84:0/831012783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75400a4250 0x7f75400abdd0 secure :-1 s=READY pgs=367 cs=0 l=1 rx=0x7f7530008910 tx=0x7f753000fd70).stop 2020-01-16T05:46:45.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f754511b700 1 -- 172.21.15.84:0/831012783 shutdown_connections 2020-01-16T05:46:45.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f754511b700 1 --2- 172.21.15.84:0/831012783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75400a4250 0x7f75400abdd0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:45.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f754511b700 1 -- 172.21.15.84:0/831012783 shutdown_connections 2020-01-16T05:46:45.620 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f754511b700 1 -- 172.21.15.84:0/831012783 wait complete. 2020-01-16T05:46:45.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.612+0000 7f754511b700 1 -- 172.21.15.84:0/831012783 >> 172.21.15.84:0/831012783 conn(0x7f75400acfc0 msgr2=0x7f75400a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:45.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754511b700 1 Processor -- start 2020-01-16T05:46:45.621 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754511b700 1 -- start start 2020-01-16T05:46:45.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754511b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75400a0b60 0x7f754009ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:45.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754511b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f754009f220 0x7f754009f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:45.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754511b700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75401323f0 con 0x7f75400a0730 2020-01-16T05:46:45.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754511b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754007f830 con 0x7f754009f220 2020-01-16T05:46:45.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754511b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75400a3440 con 0x7f75400a0b60 2020-01-16T05:46:45.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754637d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f754009f220 0x7f754009f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:45.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754637d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f754009f220 0x7f754009f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35750/0 (socket says 172.21.15.84:35750) 2020-01-16T05:46:45.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754637d700 1 -- 172.21.15.84:0/1914054136 learned_addr learned my addr 172.21.15.84:0/1914054136 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:45.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f753ffff700 1 --2- 172.21.15.84:0/1914054136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75400a0b60 0x7f754009ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:45.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754637d700 1 -- 172.21.15.84:0/1914054136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75400a0b60 msgr2=0x7f754009ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:45.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754637d700 1 --2- 172.21.15.84:0/1914054136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75400a0b60 0x7f754009ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:45.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754637d700 1 -- 172.21.15.84:0/1914054136 >> v1:172.21.15.142:6789/0 conn(0x7f75400a0730 legacy=0x7f7540131bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:45.625 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754637d700 1 -- 172.21.15.84:0/1914054136 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7540066240 con 0x7f754009f220 2020-01-16T05:46:45.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754637d700 1 --2- 172.21.15.84:0/1914054136 >> v2:172.21.15.84:3300/0 conn(0x7f754009f220 0x7f754009f650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f754007f9f0 tx=0x7f75300116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:45.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754637d700 1 --2- 172.21.15.84:0/1914054136 >> v2:172.21.15.84:3300/0 conn(0x7f754009f220 0x7f754009f650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f754007f9f0 tx=0x7f75300116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:45.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754637d700 1 --2- 172.21.15.84:0/1914054136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f754009f220 0x7f754009f650 secure :-1 s=READY pgs=368 cs=0 l=1 rx=0x7f754007f9f0 tx=0x7f75300116a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:45.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754637d700 1 --2- 172.21.15.84:0/1914054136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f754009f220 0x7f754009f650 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7f754007f9f0 tx=0x7f75300116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:45.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f753d7fa700 1 -- 172.21.15.84:0/1914054136 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f753000f760 con 0x7f754009f220 2020-01-16T05:46:45.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754637d700 1 --2- 172.21.15.84:0/1914054136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f754009f220 0x7f754009f650 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7f754007f9f0 tx=0x7f75300116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:45.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754637d700 1 --2- 172.21.15.84:0/1914054136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f754009f220 0x7f754009f650 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7f754007f9f0 tx=0x7f75300116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:45.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f753d7fa700 1 -- 172.21.15.84:0/1914054136 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75300117e0 con 0x7f754009f220 2020-01-16T05:46:45.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754511b700 1 -- 172.21.15.84:0/1914054136 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75400a9440 con 0x7f754009f220 2020-01-16T05:46:45.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f753d7fa700 1 -- 172.21.15.84:0/1914054136 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7530007530 con 0x7f754009f220 2020-01-16T05:46:45.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754511b700 1 -- 172.21.15.84:0/1914054136 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754013c840 con 0x7f754009f220 2020-01-16T05:46:45.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754637d700 1 --2- 172.21.15.84:0/1914054136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f754009f220 0x7f754009f650 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7f754007f9f0 tx=0x7f75300116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:45.628 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.616+0000 7f754511b700 1 -- 172.21.15.84:0/1914054136 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754005e1c0 con 0x7f754009f220 2020-01-16T05:46:45.628 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.620+0000 7f753d7fa700 1 -- 172.21.15.84:0/1914054136 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f75300056c0 con 0x7f754009f220 2020-01-16T05:46:45.628 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.620+0000 7f754637d700 1 --2- 172.21.15.84:0/1914054136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f754009f220 0x7f754009f650 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7f754007f9f0 tx=0x7f75300116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:45.628 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.620+0000 7f753d7fa700 1 --2- 172.21.15.84:0/1914054136 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f752403c2a0 0x7f752403e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:45.628 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.620+0000 7f753d7fa700 1 -- 172.21.15.84:0/1914054136 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f753004cf60 con 0x7f754009f220 2020-01-16T05:46:45.629 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.620+0000 7f754491a700 1 --2- 172.21.15.84:0/1914054136 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f752403c2a0 0x7f752403e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:45.629 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.620+0000 7f754491a700 1 --2- 172.21.15.84:0/1914054136 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f752403c2a0 0x7f752403e7b0 crc :-1 s=READY pgs=147 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:45.630 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.624+0000 7f754637d700 1 --2- 172.21.15.84:0/1914054136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f754009f220 0x7f754009f650 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7f754007f9f0 tx=0x7f75300116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:45.630 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.624+0000 7f753d7fa700 1 -- 172.21.15.84:0/1914054136 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f7530033580 con 0x7f754009f220 2020-01-16T05:46:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.776+0000 7f754511b700 1 -- 172.21.15.84:0/1914054136 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75400aab10 con 0x7f754009f220 2020-01-16T05:46:45.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.776+0000 7f754637d700 1 --2- 172.21.15.84:0/1914054136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f754009f220 0x7f754009f650 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7f754007f9f0 tx=0x7f75300116a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:45.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.776+0000 7f753d7fa700 1 -- 172.21.15.84:0/1914054136 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f75300337e0 con 0x7f754009f220 2020-01-16T05:46:45.779 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:45.780 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:45.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.780+0000 7f754511b700 1 -- 172.21.15.84:0/1914054136 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f752403c2a0 msgr2=0x7f752403e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:45.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.780+0000 7f754511b700 1 --2- 172.21.15.84:0/1914054136 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f752403c2a0 0x7f752403e7b0 crc :-1 s=READY pgs=147 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:45.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.780+0000 7f754511b700 1 -- 172.21.15.84:0/1914054136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f754009f220 msgr2=0x7f754009f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:45.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.780+0000 7f754511b700 1 --2- 172.21.15.84:0/1914054136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f754009f220 0x7f754009f650 secure :-1 s=READY pgs=368 cs=0 l=1 rx=0x7f754007f9f0 tx=0x7f75300116a0).stop 2020-01-16T05:46:45.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.780+0000 7f754511b700 1 -- 172.21.15.84:0/1914054136 shutdown_connections 2020-01-16T05:46:45.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.780+0000 7f754511b700 1 --2- 172.21.15.84:0/1914054136 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f752403c2a0 0x7f752403e7b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:45.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.780+0000 7f754511b700 1 --2- 172.21.15.84:0/1914054136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f754009f220 0x7f754009f650 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:45.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.780+0000 7f754511b700 1 --2- 172.21.15.84:0/1914054136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75400a0b60 0x7f754009ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:45.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.780+0000 7f754511b700 1 -- 172.21.15.84:0/1914054136 shutdown_connections 2020-01-16T05:46:45.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.780+0000 7f754511b700 1 -- 172.21.15.84:0/1914054136 wait complete. 2020-01-16T05:46:45.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:45.780+0000 7f754511b700 1 -- 172.21.15.84:0/1914054136 >> 172.21.15.84:0/1914054136 conn(0x7f754007f400 msgr2=0x7f75400246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:45.787 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:45.800 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:46.931 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~140s 2020-01-16T05:46:47.801 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:47.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.916+0000 7f155c8b2700 1 Processor -- start 2020-01-16T05:46:47.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.916+0000 7f155c8b2700 1 -- start start 2020-01-16T05:46:47.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155c8b2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15580a9b30 0x7f15580abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:47.927 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155c8b2700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f155807ff10 0x7f1558066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:47.928 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155c8b2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1558066dd0 con 0x7f15580a4250 2020-01-16T05:46:47.928 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155c8b2700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15580a4830 con 0x7f155807ff10 2020-01-16T05:46:47.928 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155c8b2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155807f9d0 con 0x7f15580a9b30 2020-01-16T05:46:47.929 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155d0b3700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f15580a4250 0x7f15580a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52964/0 (socket says 172.21.15.84:52964) 2020-01-16T05:46:47.929 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155d0b3700 1 -- 172.21.15.84:0/1181523337 learned_addr learned my addr 172.21.15.84:0/1181523337 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:47.929 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f1556d9d700 1 --2- 172.21.15.84:0/1181523337 >> v2:172.21.15.142:3300/0 conn(0x7f155807ff10 0x7f1558066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:47.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155759e700 1 --2- 172.21.15.84:0/1181523337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15580a9b30 0x7f15580abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:47.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155659c700 1 -- 172.21.15.84:0/1181523337 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840643788 0 0) 0x7f1558066dd0 con 0x7f15580a4250 2020-01-16T05:46:47.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155659c700 1 -- 172.21.15.84:0/1181523337 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1544003230 con 0x7f15580a4250 2020-01-16T05:46:47.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f1556d9d700 1 -- 172.21.15.84:0/1181523337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15580a9b30 msgr2=0x7f15580abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:47.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f1556d9d700 1 --2- 172.21.15.84:0/1181523337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15580a9b30 0x7f15580abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:47.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f1556d9d700 1 -- 172.21.15.84:0/1181523337 >> v1:172.21.15.84:6789/0 conn(0x7f15580a4250 legacy=0x7f15580a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:47.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f1556d9d700 1 -- 172.21.15.84:0/1181523337 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1558150ce0 con 0x7f155807ff10 2020-01-16T05:46:47.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f1556d9d700 1 --2- 172.21.15.84:0/1181523337 >> v2:172.21.15.142:3300/0 conn(0x7f155807ff10 0x7f1558066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1540008910 tx=0x7f154000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:47.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f1556d9d700 1 --2- 172.21.15.84:0/1181523337 >> v2:172.21.15.142:3300/0 conn(0x7f155807ff10 0x7f1558066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1540008910 tx=0x7f154000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:47.937 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f1556d9d700 1 --2- 172.21.15.84:0/1181523337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f155807ff10 0x7f1558066880 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f1540008910 tx=0x7f154000fdf0).ready entity=mon.1 client_cookie=40dc2a5869508e90 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:47.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f1556d9d700 1 --2- 172.21.15.84:0/1181523337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f155807ff10 0x7f1558066880 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f1540008910 tx=0x7f154000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:47.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155659c700 1 -- 172.21.15.84:0/1181523337 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1540011660 con 0x7f155807ff10 2020-01-16T05:46:47.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f1556d9d700 1 --2- 172.21.15.84:0/1181523337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f155807ff10 0x7f1558066880 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f1540008910 tx=0x7f154000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:47.938 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155659c700 1 -- 172.21.15.84:0/1181523337 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1540008c50 con 0x7f155807ff10 2020-01-16T05:46:47.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f1556d9d700 1 --2- 172.21.15.84:0/1181523337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f155807ff10 0x7f1558066880 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f1540008910 tx=0x7f154000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:47.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155659c700 1 -- 172.21.15.84:0/1181523337 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1540011c40 con 0x7f155807ff10 2020-01-16T05:46:47.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155c8b2700 1 -- 172.21.15.84:0/1181523337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f155807ff10 msgr2=0x7f1558066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:47.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155c8b2700 1 --2- 172.21.15.84:0/1181523337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f155807ff10 0x7f1558066880 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f1540008910 tx=0x7f154000fdf0).stop 2020-01-16T05:46:47.939 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155c8b2700 1 -- 172.21.15.84:0/1181523337 shutdown_connections 2020-01-16T05:46:47.940 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155c8b2700 1 --2- 172.21.15.84:0/1181523337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15580a9b30 0x7f15580abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:47.956 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155c8b2700 1 --2- 172.21.15.84:0/1181523337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f155807ff10 0x7f1558066880 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:47.956 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155c8b2700 1 -- 172.21.15.84:0/1181523337 shutdown_connections 2020-01-16T05:46:47.956 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155c8b2700 1 -- 172.21.15.84:0/1181523337 wait complete. 2020-01-16T05:46:47.956 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.920+0000 7f155c8b2700 1 -- 172.21.15.84:0/1181523337 >> 172.21.15.84:0/1181523337 conn(0x7f15580acfc0 msgr2=0x7f15580a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:47.970 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.924+0000 7f155c8b2700 1 Processor -- start 2020-01-16T05:46:47.970 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.924+0000 7f155c8b2700 1 -- start start 2020-01-16T05:46:47.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f155c8b2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f155812a6e0 0x7f1558127290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:47.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f155c8b2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155807d420 con 0x7f155807cbc0 2020-01-16T05:46:47.977 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f155c8b2700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1558122cd0 con 0x7f155807cff0 2020-01-16T05:46:47.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f155c8b2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15581283a0 con 0x7f155812a6e0 2020-01-16T05:46:47.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f1556d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f155807cbc0 0x7f15581379b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52970/0 (socket says 172.21.15.84:52970) 2020-01-16T05:46:47.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f1556d9d700 1 -- 172.21.15.84:0/2417987019 learned_addr learned my addr 172.21.15.84:0/2417987019 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:47.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f155759e700 1 --2- 172.21.15.84:0/2417987019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f155812a6e0 0x7f1558127290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:47.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f154ffff700 1 -- 172.21.15.84:0/2417987019 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543459306 0 0) 0x7f155807d420 con 0x7f155807cbc0 2020-01-16T05:46:47.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f154ffff700 1 -- 172.21.15.84:0/2417987019 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f153c003230 con 0x7f155807cbc0 2020-01-16T05:46:47.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f154ffff700 1 -- 172.21.15.84:0/2417987019 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925927997 0 0) 0x7f1558122cd0 con 0x7f155807cff0 2020-01-16T05:46:47.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f154ffff700 1 -- 172.21.15.84:0/2417987019 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f155807d420 con 0x7f155807cff0 2020-01-16T05:46:47.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f155759e700 1 -- 172.21.15.84:0/2417987019 >> v1:172.21.15.142:6789/0 conn(0x7f155807cff0 legacy=0x7f15581381b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:47.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f155759e700 1 -- 172.21.15.84:0/2417987019 >> v1:172.21.15.84:6789/0 conn(0x7f155807cbc0 legacy=0x7f15581379b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:47.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f154ffff700 1 -- 172.21.15.84:0/2417987019 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3895842927 0 0) 0x7f153c003230 con 0x7f155807cbc0 2020-01-16T05:46:47.980 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f155759e700 1 -- 172.21.15.84:0/2417987019 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1558123a10 con 0x7f155812a6e0 2020-01-16T05:46:47.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f155759e700 1 --2- 172.21.15.84:0/2417987019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f155812a6e0 0x7f1558127290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1540011f20 tx=0x7f1540010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:47.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f155759e700 1 --2- 172.21.15.84:0/2417987019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f155812a6e0 0x7f1558127290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1540011f20 tx=0x7f1540010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:47.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f155759e700 1 --2- 172.21.15.84:0/2417987019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f155812a6e0 0x7f1558127290 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f1540011f20 tx=0x7f1540010300).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:47.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f155759e700 1 --2- 172.21.15.84:0/2417987019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f155812a6e0 0x7f1558127290 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f1540011f20 tx=0x7f1540010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:47.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f154ffff700 1 -- 172.21.15.84:0/2417987019 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15400085f0 con 0x7f155812a6e0 2020-01-16T05:46:47.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f155759e700 1 --2- 172.21.15.84:0/2417987019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f155812a6e0 0x7f1558127290 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f1540011f20 tx=0x7f1540010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:47.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f155c8b2700 1 -- 172.21.15.84:0/2417987019 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1558123170 con 0x7f155812a6e0 2020-01-16T05:46:47.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f154ffff700 1 -- 172.21.15.84:0/2417987019 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1540011860 con 0x7f155812a6e0 2020-01-16T05:46:47.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f155759e700 1 --2- 172.21.15.84:0/2417987019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f155812a6e0 0x7f1558127290 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f1540011f20 tx=0x7f1540010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:47.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f154ffff700 1 -- 172.21.15.84:0/2417987019 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1548005c90 con 0x7f155812a6e0 2020-01-16T05:46:47.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f155c8b2700 1 -- 172.21.15.84:0/2417987019 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15581277e0 con 0x7f155812a6e0 2020-01-16T05:46:47.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f155759e700 1 --2- 172.21.15.84:0/2417987019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f155812a6e0 0x7f1558127290 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f1540011f20 tx=0x7f1540010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:47.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.928+0000 7f155c8b2700 1 -- 172.21.15.84:0/2417987019 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155805e1c0 con 0x7f155812a6e0 2020-01-16T05:46:47.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.932+0000 7f154ffff700 1 -- 172.21.15.84:0/2417987019 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f1548007140 con 0x7f155812a6e0 2020-01-16T05:46:47.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.932+0000 7f155759e700 1 --2- 172.21.15.84:0/2417987019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f155812a6e0 0x7f1558127290 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f1540011f20 tx=0x7f1540010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:47.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.932+0000 7f154ffff700 1 --2- 172.21.15.84:0/2417987019 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f153c03c9a0 0x7f153c03eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:47.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.932+0000 7f154ffff700 1 -- 172.21.15.84:0/2417987019 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f154804c250 con 0x7f155812a6e0 2020-01-16T05:46:47.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.932+0000 7f1556d9d700 1 --2- 172.21.15.84:0/2417987019 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f153c03c9a0 0x7f153c03eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:47.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.932+0000 7f1556d9d700 1 --2- 172.21.15.84:0/2417987019 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f153c03c9a0 0x7f153c03eeb0 crc :-1 s=READY pgs=148 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:47.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.940+0000 7f155759e700 1 --2- 172.21.15.84:0/2417987019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f155812a6e0 0x7f1558127290 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f1540011f20 tx=0x7f1540010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:47.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:47.940+0000 7f154ffff700 1 -- 172.21.15.84:0/2417987019 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f1548032850 con 0x7f155812a6e0 2020-01-16T05:46:48.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:48.092+0000 7f155c8b2700 1 -- 172.21.15.84:0/2417987019 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1558128d20 con 0x7f155812a6e0 2020-01-16T05:46:48.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:48.092+0000 7f155759e700 1 --2- 172.21.15.84:0/2417987019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f155812a6e0 0x7f1558127290 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f1540011f20 tx=0x7f1540010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:48.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:48.092+0000 7f154ffff700 1 -- 172.21.15.84:0/2417987019 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f1548032ab0 con 0x7f155812a6e0 2020-01-16T05:46:48.094 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:48.094 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:48.095 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:48.092+0000 7f155c8b2700 1 -- 172.21.15.84:0/2417987019 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f153c03c9a0 msgr2=0x7f153c03eeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:48.095 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:48.092+0000 7f155c8b2700 1 --2- 172.21.15.84:0/2417987019 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f153c03c9a0 0x7f153c03eeb0 crc :-1 s=READY pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:48.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:48.092+0000 7f155c8b2700 1 -- 172.21.15.84:0/2417987019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f155812a6e0 msgr2=0x7f1558127290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:48.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:48.092+0000 7f155c8b2700 1 --2- 172.21.15.84:0/2417987019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f155812a6e0 0x7f1558127290 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f1540011f20 tx=0x7f1540010300).stop 2020-01-16T05:46:48.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:48.096+0000 7f155c8b2700 1 -- 172.21.15.84:0/2417987019 shutdown_connections 2020-01-16T05:46:48.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:48.096+0000 7f155c8b2700 1 --2- 172.21.15.84:0/2417987019 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f153c03c9a0 0x7f153c03eeb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:48.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:48.096+0000 7f155c8b2700 1 --2- 172.21.15.84:0/2417987019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f155812a6e0 0x7f1558127290 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:48.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:48.096+0000 7f155c8b2700 1 -- 172.21.15.84:0/2417987019 shutdown_connections 2020-01-16T05:46:48.097 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:48.096+0000 7f155c8b2700 1 -- 172.21.15.84:0/2417987019 wait complete. 2020-01-16T05:46:48.097 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:48.096+0000 7f155c8b2700 1 -- 172.21.15.84:0/2417987019 >> 172.21.15.84:0/2417987019 conn(0x7f15580acfc0 msgr2=0x7f15580654e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:48.097 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:48.107 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:46:50.108 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:50.232 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.224+0000 7f136f2bd700 1 Processor -- start 2020-01-16T05:46:50.233 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.224+0000 7f136f2bd700 1 -- start start 2020-01-16T05:46:50.233 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.224+0000 7f136f2bd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13680a9b30 0x7f13680abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:50.234 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.224+0000 7f136f2bd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f136807ff10 0x7f1368066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:50.234 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.224+0000 7f136f2bd700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1368066dd0 con 0x7f13680a4250 2020-01-16T05:46:50.234 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.224+0000 7f136f2bd700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13680a4830 con 0x7f136807ff10 2020-01-16T05:46:50.237 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.224+0000 7f136f2bd700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136807f9d0 con 0x7f13680a9b30 2020-01-16T05:46:50.238 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.224+0000 7f137051f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f13680a4250 0x7f13680a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52978/0 (socket says 172.21.15.84:52978) 2020-01-16T05:46:50.238 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.224+0000 7f137051f700 1 -- 172.21.15.84:0/1985213287 learned_addr learned my addr 172.21.15.84:0/1985213287 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:50.238 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.224+0000 7f136eabc700 1 --2- 172.21.15.84:0/1985213287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13680a9b30 0x7f13680abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:50.238 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.224+0000 7f136e2bb700 1 --2- 172.21.15.84:0/1985213287 >> v2:172.21.15.142:3300/0 conn(0x7f136807ff10 0x7f1368066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:50.238 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.224+0000 7f136daba700 1 -- 172.21.15.84:0/1985213287 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822621636 0 0) 0x7f1368066dd0 con 0x7f13680a4250 2020-01-16T05:46:50.238 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.224+0000 7f136daba700 1 -- 172.21.15.84:0/1985213287 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1350003230 con 0x7f13680a4250 2020-01-16T05:46:50.239 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136daba700 1 -- 172.21.15.84:0/1985213287 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1030553893 0 0) 0x7f1350003230 con 0x7f13680a4250 2020-01-16T05:46:50.239 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136daba700 1 -- 172.21.15.84:0/1985213287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13680a9b30 msgr2=0x7f13680abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:50.239 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136daba700 1 --2- 172.21.15.84:0/1985213287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13680a9b30 0x7f13680abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:50.239 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136daba700 1 -- 172.21.15.84:0/1985213287 >> v2:172.21.15.142:3300/0 conn(0x7f136807ff10 msgr2=0x7f1368066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:50.239 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136daba700 1 --2- 172.21.15.84:0/1985213287 >> v2:172.21.15.142:3300/0 conn(0x7f136807ff10 0x7f1368066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:50.239 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136daba700 1 -- 172.21.15.84:0/1985213287 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1368150ce0 con 0x7f13680a4250 2020-01-16T05:46:50.239 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136daba700 1 -- 172.21.15.84:0/1985213287 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f1360001750 con 0x7f13680a4250 2020-01-16T05:46:50.239 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136daba700 1 -- 172.21.15.84:0/1985213287 >> v1:172.21.15.84:6789/0 conn(0x7f13680a4250 legacy=0x7f13680a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:50.240 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136daba700 1 --2- 172.21.15.84:0/1985213287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1350003860 0x7f1350003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:50.240 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136daba700 1 --2- 172.21.15.84:0/1985213287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13500045a0 0x7f13500049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:50.240 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136daba700 1 --2- 172.21.15.84:0/1985213287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350004f20 0x7f135004f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:50.240 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136daba700 1 -- 172.21.15.84:0/1985213287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13680a4830 con 0x7f1350004f20 2020-01-16T05:46:50.240 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136daba700 1 -- 172.21.15.84:0/1985213287 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136807f9d0 con 0x7f13500045a0 2020-01-16T05:46:50.240 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136daba700 1 -- 172.21.15.84:0/1985213287 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135004fd50 con 0x7f1350003860 2020-01-16T05:46:50.240 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f137051f700 1 --2- 172.21.15.84:0/1985213287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350004f20 0x7f135004f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:50.241 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136e2bb700 1 --2- 172.21.15.84:0/1985213287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13500045a0 0x7f13500049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:50.241 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136eabc700 1 --2- 172.21.15.84:0/1985213287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1350003860 0x7f1350003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:50.241 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f137051f700 1 -- 172.21.15.84:0/1985213287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1350003860 msgr2=0x7f1350003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:50.241 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f137051f700 1 --2- 172.21.15.84:0/1985213287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1350003860 0x7f1350003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:50.241 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f137051f700 1 -- 172.21.15.84:0/1985213287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13500045a0 msgr2=0x7f13500049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:50.241 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f137051f700 1 --2- 172.21.15.84:0/1985213287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13500045a0 0x7f13500049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:50.241 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f137051f700 1 -- 172.21.15.84:0/1985213287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135004ff10 con 0x7f1350004f20 2020-01-16T05:46:50.245 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f137051f700 1 --2- 172.21.15.84:0/1985213287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350004f20 0x7f135004f800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1360001a50 tx=0x7f136000c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:50.245 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f137051f700 1 --2- 172.21.15.84:0/1985213287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350004f20 0x7f135004f800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1360001a50 tx=0x7f136000c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:50.245 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f137051f700 1 --2- 172.21.15.84:0/1985213287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350004f20 0x7f135004f800 secure :-1 s=READY pgs=372 cs=0 l=1 rx=0x7f1360001a50 tx=0x7f136000c3a0).ready entity=mon.0 client_cookie=f5c7d5a2ce19f85d server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:50.246 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f137051f700 1 --2- 172.21.15.84:0/1985213287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350004f20 0x7f135004f800 secure :-1 s=THROTTLE_DONE pgs=372 cs=0 l=1 rx=0x7f1360001a50 tx=0x7f136000c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:50.246 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136daba700 1 -- 172.21.15.84:0/1985213287 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f136000b450 con 0x7f1350004f20 2020-01-16T05:46:50.247 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f137051f700 1 --2- 172.21.15.84:0/1985213287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350004f20 0x7f135004f800 secure :-1 s=THROTTLE_DONE pgs=372 cs=0 l=1 rx=0x7f1360001a50 tx=0x7f136000c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:50.247 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f137051f700 1 --2- 172.21.15.84:0/1985213287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350004f20 0x7f135004f800 secure :-1 s=THROTTLE_DONE pgs=372 cs=0 l=1 rx=0x7f1360001a50 tx=0x7f136000c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:50.247 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136daba700 1 -- 172.21.15.84:0/1985213287 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136000b070 con 0x7f1350004f20 2020-01-16T05:46:50.247 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136daba700 1 -- 172.21.15.84:0/1985213287 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f136000aa70 con 0x7f1350004f20 2020-01-16T05:46:50.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136f2bd700 1 -- 172.21.15.84:0/1985213287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350004f20 msgr2=0x7f135004f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:50.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136f2bd700 1 --2- 172.21.15.84:0/1985213287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350004f20 0x7f135004f800 secure :-1 s=READY pgs=372 cs=0 l=1 rx=0x7f1360001a50 tx=0x7f136000c3a0).stop 2020-01-16T05:46:50.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f137051f700 1 -- 172.21.15.84:0/1985213287 reap_dead start 2020-01-16T05:46:50.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136f2bd700 1 -- 172.21.15.84:0/1985213287 shutdown_connections 2020-01-16T05:46:50.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136f2bd700 1 -- 172.21.15.84:0/1985213287 shutdown_connections 2020-01-16T05:46:50.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136f2bd700 1 -- 172.21.15.84:0/1985213287 wait complete. 2020-01-16T05:46:50.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.228+0000 7f136f2bd700 1 -- 172.21.15.84:0/1985213287 >> 172.21.15.84:0/1985213287 conn(0x7f13680acfc0 msgr2=0x7f13680a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:50.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136f2bd700 1 Processor -- start 2020-01-16T05:46:50.251 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136f2bd700 1 -- start start 2020-01-16T05:46:50.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136f2bd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1368122f80 0x7f136807c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:50.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136f2bd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f13681233b0 0x7f136807c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:50.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136f2bd700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1368090b00 con 0x7f136808f8d0 2020-01-16T05:46:50.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136f2bd700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1368092270 con 0x7f13681233b0 2020-01-16T05:46:50.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136f2bd700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1368090e80 con 0x7f1368122f80 2020-01-16T05:46:50.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136e2bb700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f13681233b0 0x7f136807c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:50.258 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136e2bb700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f13681233b0 0x7f136807c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.84:45774/0 (socket says 172.21.15.84:45774) 2020-01-16T05:46:50.258 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136e2bb700 1 -- 172.21.15.84:0/1703905327 learned_addr learned my addr 172.21.15.84:0/1703905327 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:50.258 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136eabc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1368122f80 0x7f136807c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:50.258 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136e2bb700 1 -- 172.21.15.84:0/1703905327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1368122f80 msgr2=0x7f136807c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:50.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136e2bb700 1 --2- 172.21.15.84:0/1703905327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1368122f80 0x7f136807c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:50.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136e2bb700 1 -- 172.21.15.84:0/1703905327 >> v1:172.21.15.142:6789/0 conn(0x7f136808f8d0 legacy=0x7f136808fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:50.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f13677fe700 1 -- 172.21.15.84:0/1703905327 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715720435 0 0) 0x7f1368090b00 con 0x7f136808f8d0 2020-01-16T05:46:50.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136e2bb700 1 -- 172.21.15.84:0/1703905327 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13680a6c60 con 0x7f13681233b0 2020-01-16T05:46:50.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136eabc700 1 --2- 172.21.15.84:0/1703905327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1368122f80 0x7f136807c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:46:50.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136e2bb700 1 --2- 172.21.15.84:0/1703905327 >> v2:172.21.15.142:3300/0 conn(0x7f13681233b0 0x7f136807c760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1368091040 tx=0x7f135c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:50.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136e2bb700 1 --2- 172.21.15.84:0/1703905327 >> v2:172.21.15.142:3300/0 conn(0x7f13681233b0 0x7f136807c760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1368091040 tx=0x7f135c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:50.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136e2bb700 1 --2- 172.21.15.84:0/1703905327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13681233b0 0x7f136807c760 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7f1368091040 tx=0x7f135c010cf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:50.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.232+0000 7f136e2bb700 1 --2- 172.21.15.84:0/1703905327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13681233b0 0x7f136807c760 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f1368091040 tx=0x7f135c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:50.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.236+0000 7f13677fe700 1 -- 172.21.15.84:0/1703905327 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f135c008d50 con 0x7f13681233b0 2020-01-16T05:46:50.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.236+0000 7f136e2bb700 1 --2- 172.21.15.84:0/1703905327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13681233b0 0x7f136807c760 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f1368091040 tx=0x7f135c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:50.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.236+0000 7f136f2bd700 1 -- 172.21.15.84:0/1703905327 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136805f400 con 0x7f13681233b0 2020-01-16T05:46:50.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.236+0000 7f13677fe700 1 -- 172.21.15.84:0/1703905327 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c008970 con 0x7f13681233b0 2020-01-16T05:46:50.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.236+0000 7f136e2bb700 1 --2- 172.21.15.84:0/1703905327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13681233b0 0x7f136807c760 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f1368091040 tx=0x7f135c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:50.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.236+0000 7f13677fe700 1 -- 172.21.15.84:0/1703905327 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f135c012ad0 con 0x7f13681233b0 2020-01-16T05:46:50.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.236+0000 7f136f2bd700 1 -- 172.21.15.84:0/1703905327 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136813bc30 con 0x7f13681233b0 2020-01-16T05:46:50.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.236+0000 7f136e2bb700 1 --2- 172.21.15.84:0/1703905327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13681233b0 0x7f136807c760 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f1368091040 tx=0x7f135c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:50.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.236+0000 7f136f2bd700 1 -- 172.21.15.84:0/1703905327 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136805e1c0 con 0x7f13681233b0 2020-01-16T05:46:50.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.236+0000 7f13677fe700 1 -- 172.21.15.84:0/1703905327 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f135c0056c0 con 0x7f13681233b0 2020-01-16T05:46:50.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.236+0000 7f136e2bb700 1 --2- 172.21.15.84:0/1703905327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13681233b0 0x7f136807c760 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f1368091040 tx=0x7f135c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:50.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.236+0000 7f13677fe700 1 --2- 172.21.15.84:0/1703905327 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f134803c190 0x7f134803e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:50.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.236+0000 7f13677fe700 1 -- 172.21.15.84:0/1703905327 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f135c04ced0 con 0x7f13681233b0 2020-01-16T05:46:50.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.236+0000 7f136eabc700 1 --2- 172.21.15.84:0/1703905327 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f134803c190 0x7f134803e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:50.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.236+0000 7f136eabc700 1 --2- 172.21.15.84:0/1703905327 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f134803c190 0x7f134803e6a0 crc :-1 s=READY pgs=149 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:50.271 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.244+0000 7f136e2bb700 1 --2- 172.21.15.84:0/1703905327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13681233b0 0x7f136807c760 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f1368091040 tx=0x7f135c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:50.272 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.244+0000 7f13677fe700 1 -- 172.21.15.84:0/1703905327 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f135c0334d0 con 0x7f13681233b0 2020-01-16T05:46:50.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.396+0000 7f136f2bd700 1 -- 172.21.15.84:0/1703905327 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f136809fce0 con 0x7f13681233b0 2020-01-16T05:46:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.400+0000 7f136e2bb700 1 --2- 172.21.15.84:0/1703905327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13681233b0 0x7f136807c760 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f1368091040 tx=0x7f135c010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.400+0000 7f13677fe700 1 -- 172.21.15.84:0/1703905327 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f135c033730 con 0x7f13681233b0 2020-01-16T05:46:50.400 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:50.400 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:50.403 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.400+0000 7f136f2bd700 1 -- 172.21.15.84:0/1703905327 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f134803c190 msgr2=0x7f134803e6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:50.404 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.400+0000 7f136f2bd700 1 --2- 172.21.15.84:0/1703905327 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f134803c190 0x7f134803e6a0 crc :-1 s=READY pgs=149 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:50.404 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.400+0000 7f136f2bd700 1 -- 172.21.15.84:0/1703905327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13681233b0 msgr2=0x7f136807c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:50.404 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.400+0000 7f136f2bd700 1 --2- 172.21.15.84:0/1703905327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13681233b0 0x7f136807c760 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7f1368091040 tx=0x7f135c010cf0).stop 2020-01-16T05:46:50.404 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.400+0000 7f136f2bd700 1 -- 172.21.15.84:0/1703905327 shutdown_connections 2020-01-16T05:46:50.405 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.400+0000 7f136f2bd700 1 --2- 172.21.15.84:0/1703905327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1368122f80 0x7f136807c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:50.405 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.400+0000 7f136f2bd700 1 --2- 172.21.15.84:0/1703905327 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f134803c190 0x7f134803e6a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:50.405 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.400+0000 7f136f2bd700 1 --2- 172.21.15.84:0/1703905327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13681233b0 0x7f136807c760 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:50.405 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.400+0000 7f136f2bd700 1 -- 172.21.15.84:0/1703905327 shutdown_connections 2020-01-16T05:46:50.406 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.400+0000 7f136f2bd700 1 -- 172.21.15.84:0/1703905327 wait complete. 2020-01-16T05:46:50.406 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:50.400+0000 7f136f2bd700 1 -- 172.21.15.84:0/1703905327 >> 172.21.15.84:0/1703905327 conn(0x7f13680a9b30 msgr2=0x7f13680665b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:50.406 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:50.413 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:52.414 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:52.541 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014b59e700 1 Processor -- start 2020-01-16T05:46:52.541 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014b59e700 1 -- start start 2020-01-16T05:46:52.541 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014b59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c0a4250 0x7f014c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:52.541 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014b59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c066880 con 0x7f014c0a9b30 2020-01-16T05:46:52.542 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014b59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c066ab0 con 0x7f014c07ff10 2020-01-16T05:46:52.542 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014b59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0a4830 con 0x7f014c0a4250 2020-01-16T05:46:52.542 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014ad9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f014c0a9b30 0x7f014c0a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53004/0 (socket says 172.21.15.84:53004) 2020-01-16T05:46:52.542 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014ad9d700 1 -- 172.21.15.84:0/395411871 learned_addr learned my addr 172.21.15.84:0/395411871 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:52.543 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f01508a6700 1 --2- 172.21.15.84:0/395411871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c0a4250 0x7f014c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:52.543 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014a59c700 1 -- 172.21.15.84:0/395411871 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266341062 0 0) 0x7f014c066880 con 0x7f014c0a9b30 2020-01-16T05:46:52.544 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014a59c700 1 -- 172.21.15.84:0/395411871 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0138003230 con 0x7f014c0a9b30 2020-01-16T05:46:52.544 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014a59c700 1 -- 172.21.15.84:0/395411871 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1522993533 0 0) 0x7f0138003230 con 0x7f014c0a9b30 2020-01-16T05:46:52.544 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014a59c700 1 -- 172.21.15.84:0/395411871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c0a4250 msgr2=0x7f014c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:52.544 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014a59c700 1 --2- 172.21.15.84:0/395411871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c0a4250 0x7f014c0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:52.545 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014a59c700 1 -- 172.21.15.84:0/395411871 >> v1:172.21.15.142:6789/0 conn(0x7f014c07ff10 legacy=0x7f014c14dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:52.546 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014a59c700 1 -- 172.21.15.84:0/395411871 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c066ce0 con 0x7f014c0a9b30 2020-01-16T05:46:52.546 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014a59c700 1 -- 172.21.15.84:0/395411871 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f013c001ad0 con 0x7f014c0a9b30 2020-01-16T05:46:52.547 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014a59c700 1 -- 172.21.15.84:0/395411871 >> v1:172.21.15.84:6789/0 conn(0x7f014c0a9b30 legacy=0x7f014c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:52.547 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014a59c700 1 --2- 172.21.15.84:0/395411871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0138003890 0x7f0138003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:52.547 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014a59c700 1 --2- 172.21.15.84:0/395411871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01380045a0 0x7f01380049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:52.547 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014a59c700 1 --2- 172.21.15.84:0/395411871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0138004f20 0x7f013800b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:52.548 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014a59c700 1 -- 172.21.15.84:0/395411871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0a4830 con 0x7f01380045a0 2020-01-16T05:46:52.548 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014259c700 1 --2- 172.21.15.84:0/395411871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01380045a0 0x7f01380049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:52.548 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014a59c700 1 -- 172.21.15.84:0/395411871 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0138005380 con 0x7f0138003890 2020-01-16T05:46:52.548 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014a59c700 1 -- 172.21.15.84:0/395411871 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013804fd80 con 0x7f0138004f20 2020-01-16T05:46:52.549 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f01508a6700 1 --2- 172.21.15.84:0/395411871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0138004f20 0x7f013800b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:52.549 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014ad9d700 1 --2- 172.21.15.84:0/395411871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0138003890 0x7f0138003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:52.549 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014259c700 1 -- 172.21.15.84:0/395411871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0138004f20 msgr2=0x7f013800b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:52.549 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014259c700 1 --2- 172.21.15.84:0/395411871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0138004f20 0x7f013800b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:52.550 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014259c700 1 -- 172.21.15.84:0/395411871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0138003890 msgr2=0x7f0138003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:52.550 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014259c700 1 --2- 172.21.15.84:0/395411871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0138003890 0x7f0138003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:52.550 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014259c700 1 -- 172.21.15.84:0/395411871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0138050080 con 0x7f01380045a0 2020-01-16T05:46:52.550 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014259c700 1 --2- 172.21.15.84:0/395411871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01380045a0 0x7f01380049d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0134001000 tx=0x7f013400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:52.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014259c700 1 --2- 172.21.15.84:0/395411871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01380045a0 0x7f01380049d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0134001000 tx=0x7f013400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:52.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014259c700 1 --2- 172.21.15.84:0/395411871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01380045a0 0x7f01380049d0 secure :-1 s=READY pgs=374 cs=0 l=1 rx=0x7f0134001000 tx=0x7f013400fe50).ready entity=mon.0 client_cookie=459f167e88808a14 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:52.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014259c700 1 --2- 172.21.15.84:0/395411871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01380045a0 0x7f01380049d0 secure :-1 s=THROTTLE_DONE pgs=374 cs=0 l=1 rx=0x7f0134001000 tx=0x7f013400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:52.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.536+0000 7f014a59c700 1 -- 172.21.15.84:0/395411871 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0134003540 con 0x7f01380045a0 2020-01-16T05:46:52.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.540+0000 7f014259c700 1 --2- 172.21.15.84:0/395411871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01380045a0 0x7f01380049d0 secure :-1 s=THROTTLE_DONE pgs=374 cs=0 l=1 rx=0x7f0134001000 tx=0x7f013400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:52.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.540+0000 7f014259c700 1 --2- 172.21.15.84:0/395411871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01380045a0 0x7f01380049d0 secure :-1 s=THROTTLE_DONE pgs=374 cs=0 l=1 rx=0x7f0134001000 tx=0x7f013400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:52.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.540+0000 7f014a59c700 1 -- 172.21.15.84:0/395411871 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0134003160 con 0x7f01380045a0 2020-01-16T05:46:52.553 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.540+0000 7f014a59c700 1 -- 172.21.15.84:0/395411871 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0134003b20 con 0x7f01380045a0 2020-01-16T05:46:52.553 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.540+0000 7f014b59e700 1 -- 172.21.15.84:0/395411871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01380045a0 msgr2=0x7f01380049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:52.553 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.540+0000 7f014b59e700 1 --2- 172.21.15.84:0/395411871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01380045a0 0x7f01380049d0 secure :-1 s=READY pgs=374 cs=0 l=1 rx=0x7f0134001000 tx=0x7f013400fe50).stop 2020-01-16T05:46:52.553 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.540+0000 7f01508a6700 1 -- 172.21.15.84:0/395411871 reap_dead start 2020-01-16T05:46:52.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.540+0000 7f014b59e700 1 -- 172.21.15.84:0/395411871 shutdown_connections 2020-01-16T05:46:52.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.540+0000 7f014b59e700 1 -- 172.21.15.84:0/395411871 shutdown_connections 2020-01-16T05:46:52.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.540+0000 7f014b59e700 1 -- 172.21.15.84:0/395411871 wait complete. 2020-01-16T05:46:52.555 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.540+0000 7f014b59e700 1 -- 172.21.15.84:0/395411871 >> 172.21.15.84:0/395411871 conn(0x7f014c0acfc0 msgr2=0x7f014c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:52.559 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.540+0000 7f014b59e700 1 Processor -- start 2020-01-16T05:46:52.559 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.540+0000 7f014b59e700 1 -- start start 2020-01-16T05:46:52.559 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.540+0000 7f014b59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c05ef00 0x7f014c09f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:52.559 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.540+0000 7f014b59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f014c13b1b0 0x7f014c13d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:52.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.540+0000 7f014b59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c09fcd0 con 0x7f014c09f8a0 2020-01-16T05:46:52.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.540+0000 7f014b59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014c125ac0 con 0x7f014c13b1b0 2020-01-16T05:46:52.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.540+0000 7f014b59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c125d60 con 0x7f014c05ef00 2020-01-16T05:46:52.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f01508a6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f014c13b1b0 0x7f014c13d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:52.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f014ad9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c05ef00 0x7f014c09f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:52.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f01508a6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f014c13b1b0 0x7f014c13d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35820/0 (socket says 172.21.15.84:35820) 2020-01-16T05:46:52.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f014259c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f014c09f8a0 0x7f014c0a5320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:51244/0 (socket says 172.21.15.84:51244) 2020-01-16T05:46:52.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f01508a6700 1 -- 172.21.15.84:0/2976944946 learned_addr learned my addr 172.21.15.84:0/2976944946 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:52.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f01508a6700 1 -- 172.21.15.84:0/2976944946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c05ef00 msgr2=0x7f014c09f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:52.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f0143fff700 1 -- 172.21.15.84:0/2976944946 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572659830 0 0) 0x7f014c09fcd0 con 0x7f014c09f8a0 2020-01-16T05:46:52.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f01508a6700 1 --2- 172.21.15.84:0/2976944946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c05ef00 0x7f014c09f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:52.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f01508a6700 1 -- 172.21.15.84:0/2976944946 >> v1:172.21.15.142:6789/0 conn(0x7f014c09f8a0 legacy=0x7f014c0a5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:52.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f01508a6700 1 -- 172.21.15.84:0/2976944946 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c0a61c0 con 0x7f014c13b1b0 2020-01-16T05:46:52.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f01508a6700 1 --2- 172.21.15.84:0/2976944946 >> v2:172.21.15.84:3300/0 conn(0x7f014c13b1b0 0x7f014c13d5f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f014c125c80 tx=0x7f0144010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:52.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f01508a6700 1 --2- 172.21.15.84:0/2976944946 >> v2:172.21.15.84:3300/0 conn(0x7f014c13b1b0 0x7f014c13d5f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f014c125c80 tx=0x7f0144010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:52.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f01508a6700 1 --2- 172.21.15.84:0/2976944946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f014c13b1b0 0x7f014c13d5f0 secure :-1 s=READY pgs=375 cs=0 l=1 rx=0x7f014c125c80 tx=0x7f0144010b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:52.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f01508a6700 1 --2- 172.21.15.84:0/2976944946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f014c13b1b0 0x7f014c13d5f0 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f014c125c80 tx=0x7f0144010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:52.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f0143fff700 1 -- 172.21.15.84:0/2976944946 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0144005aa0 con 0x7f014c13b1b0 2020-01-16T05:46:52.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f01508a6700 1 --2- 172.21.15.84:0/2976944946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f014c13b1b0 0x7f014c13d5f0 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f014c125c80 tx=0x7f0144010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:52.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f0143fff700 1 -- 172.21.15.84:0/2976944946 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01440056c0 con 0x7f014c13b1b0 2020-01-16T05:46:52.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f014b59e700 1 -- 172.21.15.84:0/2976944946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014c07c430 con 0x7f014c13b1b0 2020-01-16T05:46:52.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f01508a6700 1 --2- 172.21.15.84:0/2976944946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f014c13b1b0 0x7f014c13d5f0 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f014c125c80 tx=0x7f0144010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:52.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f0143fff700 1 -- 172.21.15.84:0/2976944946 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0144012690 con 0x7f014c13b1b0 2020-01-16T05:46:52.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f014b59e700 1 -- 172.21.15.84:0/2976944946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014c066220 con 0x7f014c13b1b0 2020-01-16T05:46:52.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f01508a6700 1 --2- 172.21.15.84:0/2976944946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f014c13b1b0 0x7f014c13d5f0 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f014c125c80 tx=0x7f0144010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:52.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f014b59e700 1 -- 172.21.15.84:0/2976944946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014c05e1c0 con 0x7f014c13b1b0 2020-01-16T05:46:52.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f0143fff700 1 -- 172.21.15.84:0/2976944946 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f0144007140 con 0x7f014c13b1b0 2020-01-16T05:46:52.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f01508a6700 1 --2- 172.21.15.84:0/2976944946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f014c13b1b0 0x7f014c13d5f0 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f014c125c80 tx=0x7f0144010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:52.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f0143fff700 1 --2- 172.21.15.84:0/2976944946 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f013003c190 0x7f013003e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:52.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.544+0000 7f0143fff700 1 -- 172.21.15.84:0/2976944946 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f014404c310 con 0x7f014c13b1b0 2020-01-16T05:46:52.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.548+0000 7f014ad9d700 1 --2- 172.21.15.84:0/2976944946 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f013003c190 0x7f013003e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:52.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.548+0000 7f014ad9d700 1 --2- 172.21.15.84:0/2976944946 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f013003c190 0x7f013003e6a0 crc :-1 s=READY pgs=150 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:52.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.552+0000 7f01508a6700 1 --2- 172.21.15.84:0/2976944946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f014c13b1b0 0x7f014c13d5f0 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f014c125c80 tx=0x7f0144010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:52.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.552+0000 7f0143fff700 1 -- 172.21.15.84:0/2976944946 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f0144007450 con 0x7f014c13b1b0 2020-01-16T05:46:52.706 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.704+0000 7f014b59e700 1 -- 172.21.15.84:0/2976944946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f014c0a5cc0 con 0x7f014c13b1b0 2020-01-16T05:46:52.707 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.704+0000 7f01508a6700 1 --2- 172.21.15.84:0/2976944946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f014c13b1b0 0x7f014c13d5f0 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f014c125c80 tx=0x7f0144010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:52.707 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.704+0000 7f0143fff700 1 -- 172.21.15.84:0/2976944946 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f0144032910 con 0x7f014c13b1b0 2020-01-16T05:46:52.707 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:52.707 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:52.709 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.708+0000 7f014b59e700 1 -- 172.21.15.84:0/2976944946 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f013003c190 msgr2=0x7f013003e6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:52.709 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.708+0000 7f014b59e700 1 --2- 172.21.15.84:0/2976944946 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f013003c190 0x7f013003e6a0 crc :-1 s=READY pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:52.710 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.708+0000 7f014b59e700 1 -- 172.21.15.84:0/2976944946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f014c13b1b0 msgr2=0x7f014c13d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:52.710 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.708+0000 7f014b59e700 1 --2- 172.21.15.84:0/2976944946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f014c13b1b0 0x7f014c13d5f0 secure :-1 s=READY pgs=375 cs=0 l=1 rx=0x7f014c125c80 tx=0x7f0144010b20).stop 2020-01-16T05:46:52.710 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.708+0000 7f014b59e700 1 -- 172.21.15.84:0/2976944946 shutdown_connections 2020-01-16T05:46:52.710 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.708+0000 7f014b59e700 1 --2- 172.21.15.84:0/2976944946 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f013003c190 0x7f013003e6a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:52.710 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.708+0000 7f014b59e700 1 --2- 172.21.15.84:0/2976944946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f014c13b1b0 0x7f014c13d5f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:52.710 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.708+0000 7f014b59e700 1 --2- 172.21.15.84:0/2976944946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c05ef00 0x7f014c09f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:52.711 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.708+0000 7f014b59e700 1 -- 172.21.15.84:0/2976944946 shutdown_connections 2020-01-16T05:46:52.711 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.708+0000 7f014b59e700 1 -- 172.21.15.84:0/2976944946 wait complete. 2020-01-16T05:46:52.711 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:52.708+0000 7f014b59e700 1 -- 172.21.15.84:0/2976944946 >> 172.21.15.84:0/2976944946 conn(0x7f014c0a9b30 msgr2=0x7f014c07f070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:52.712 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:52.720 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:53.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~146s 2020-01-16T05:46:54.721 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:54.851 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4d0021f700 1 Processor -- start 2020-01-16T05:46:54.851 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4d0021f700 1 -- start start 2020-01-16T05:46:54.852 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4d0021f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf80a2f60 0x7f4cf805b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:54.852 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4d0021f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4cf80a8ff0 0x7f4cf808fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:54.852 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4d0021f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4cf807c560 0x7f4cf807c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:54.852 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4d0021f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf80a3390 con 0x7f4cf80a8ff0 2020-01-16T05:46:54.852 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4d0021f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf80905b0 con 0x7f4cf807c560 2020-01-16T05:46:54.853 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4d0021f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf80a2a20 con 0x7f4cf80a2f60 2020-01-16T05:46:54.853 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfdfbb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4cf80a8ff0 0x7f4cf808fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:54.853 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfdfbb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4cf80a8ff0 0x7f4cf808fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35830/0 (socket says 172.21.15.84:35830) 2020-01-16T05:46:54.853 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfdfbb700 1 -- 172.21.15.84:0/3564155675 learned_addr learned my addr 172.21.15.84:0/3564155675 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:54.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfe7bc700 1 --2- 172.21.15.84:0/3564155675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf80a2f60 0x7f4cf805b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:54.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfefbd700 1 --2- 172.21.15.84:0/3564155675 >> v2:172.21.15.142:3300/0 conn(0x7f4cf807c560 0x7f4cf807c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:54.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfdfbb700 1 -- 172.21.15.84:0/3564155675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf80a2f60 msgr2=0x7f4cf805b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:54.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfdfbb700 1 --2- 172.21.15.84:0/3564155675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf80a2f60 0x7f4cf805b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfdfbb700 1 -- 172.21.15.84:0/3564155675 >> v2:172.21.15.142:3300/0 conn(0x7f4cf807c560 msgr2=0x7f4cf807c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfdfbb700 1 --2- 172.21.15.84:0/3564155675 >> v2:172.21.15.142:3300/0 conn(0x7f4cf807c560 0x7f4cf807c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfdfbb700 1 -- 172.21.15.84:0/3564155675 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf80902d0 con 0x7f4cf80a8ff0 2020-01-16T05:46:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfdfbb700 1 --2- 172.21.15.84:0/3564155675 >> v2:172.21.15.84:3300/0 conn(0x7f4cf80a8ff0 0x7f4cf808fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4cf8090770 tx=0x7f4cf400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfdfbb700 1 --2- 172.21.15.84:0/3564155675 >> v2:172.21.15.84:3300/0 conn(0x7f4cf80a8ff0 0x7f4cf808fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4cf8090770 tx=0x7f4cf400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfdfbb700 1 --2- 172.21.15.84:0/3564155675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf80a8ff0 0x7f4cf808fd80 secure :-1 s=READY pgs=376 cs=0 l=1 rx=0x7f4cf8090770 tx=0x7f4cf400ff30).ready entity=mon.0 client_cookie=e5828234208226 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfdfbb700 1 --2- 172.21.15.84:0/3564155675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf80a8ff0 0x7f4cf808fd80 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f4cf8090770 tx=0x7f4cf400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfdfbb700 1 --2- 172.21.15.84:0/3564155675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf80a8ff0 0x7f4cf808fd80 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f4cf8090770 tx=0x7f4cf400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfd7ba700 1 -- 172.21.15.84:0/3564155675 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cf4011760 con 0x7f4cf80a8ff0 2020-01-16T05:46:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfdfbb700 1 --2- 172.21.15.84:0/3564155675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf80a8ff0 0x7f4cf808fd80 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f4cf8090770 tx=0x7f4cf400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfd7ba700 1 -- 172.21.15.84:0/3564155675 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf4008d30 con 0x7f4cf80a8ff0 2020-01-16T05:46:54.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4cfd7ba700 1 -- 172.21.15.84:0/3564155675 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cf4011d40 con 0x7f4cf80a8ff0 2020-01-16T05:46:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4d0021f700 1 -- 172.21.15.84:0/3564155675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf80a8ff0 msgr2=0x7f4cf808fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.840+0000 7f4d0021f700 1 --2- 172.21.15.84:0/3564155675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf80a8ff0 0x7f4cf808fd80 secure :-1 s=READY pgs=376 cs=0 l=1 rx=0x7f4cf8090770 tx=0x7f4cf400ff30).stop 2020-01-16T05:46:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4d0021f700 1 -- 172.21.15.84:0/3564155675 shutdown_connections 2020-01-16T05:46:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4d0021f700 1 --2- 172.21.15.84:0/3564155675 >> v2:172.21.15.142:3300/0 conn(0x7f4cf807c560 0x7f4cf807c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4d0021f700 1 --2- 172.21.15.84:0/3564155675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf80a2f60 0x7f4cf805b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:54.885 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4d0021f700 1 --2- 172.21.15.84:0/3564155675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf80a8ff0 0x7f4cf808fd80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:54.885 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4d0021f700 1 -- 172.21.15.84:0/3564155675 shutdown_connections 2020-01-16T05:46:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4d0021f700 1 -- 172.21.15.84:0/3564155675 wait complete. 2020-01-16T05:46:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4d0021f700 1 -- 172.21.15.84:0/3564155675 >> 172.21.15.84:0/3564155675 conn(0x7f4cf80abc10 msgr2=0x7f4cf805a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4d0021f700 1 Processor -- start 2020-01-16T05:46:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4d0021f700 1 -- start start 2020-01-16T05:46:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4d0021f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4cf81295b0 0x7f4cf807ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4d0021f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4cf809dc40 0x7f4cf809e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4d0021f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf807ecc0 0x7f4cf807f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4d0021f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf807a9c0 con 0x7f4cf81295b0 2020-01-16T05:46:54.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4d0021f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf807da40 con 0x7f4cf809dc40 2020-01-16T05:46:54.888 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4d0021f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf807dce0 con 0x7f4cf807ecc0 2020-01-16T05:46:54.892 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4cfe7bc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4cf81295b0 0x7f4cf807ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:54.893 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4cfe7bc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4cf81295b0 0x7f4cf807ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35832/0 (socket says 172.21.15.84:35832) 2020-01-16T05:46:54.893 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4cfe7bc700 1 -- 172.21.15.84:0/3972785890 learned_addr learned my addr 172.21.15.84:0/3972785890 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:54.893 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4cfefbd700 1 --2- 172.21.15.84:0/3972785890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf807ecc0 0x7f4cf807f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:54.893 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4cfdfbb700 1 --2- 172.21.15.84:0/3972785890 >> v2:172.21.15.142:3300/0 conn(0x7f4cf809dc40 0x7f4cf809e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:54.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4cfe7bc700 1 -- 172.21.15.84:0/3972785890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf807ecc0 msgr2=0x7f4cf807f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:54.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4cfe7bc700 1 --2- 172.21.15.84:0/3972785890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf807ecc0 0x7f4cf807f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:54.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4cfe7bc700 1 -- 172.21.15.84:0/3972785890 >> v2:172.21.15.142:3300/0 conn(0x7f4cf809dc40 msgr2=0x7f4cf809e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:54.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4cfe7bc700 1 --2- 172.21.15.84:0/3972785890 >> v2:172.21.15.142:3300/0 conn(0x7f4cf809dc40 0x7f4cf809e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:54.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.844+0000 7f4cfe7bc700 1 -- 172.21.15.84:0/3972785890 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf807d730 con 0x7f4cf81295b0 2020-01-16T05:46:54.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4cfe7bc700 1 --2- 172.21.15.84:0/3972785890 >> v2:172.21.15.84:3300/0 conn(0x7f4cf81295b0 0x7f4cf807ce50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4cf807ab80 tx=0x7f4ce8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:54.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4cfe7bc700 1 --2- 172.21.15.84:0/3972785890 >> v2:172.21.15.84:3300/0 conn(0x7f4cf81295b0 0x7f4cf807ce50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4cf807ab80 tx=0x7f4ce8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:54.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4cfe7bc700 1 --2- 172.21.15.84:0/3972785890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf81295b0 0x7f4cf807ce50 secure :-1 s=READY pgs=377 cs=0 l=1 rx=0x7f4cf807ab80 tx=0x7f4ce8010d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:54.896 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4cfe7bc700 1 --2- 172.21.15.84:0/3972785890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf81295b0 0x7f4cf807ce50 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f4cf807ab80 tx=0x7f4ce8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:54.897 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4cfe7bc700 1 --2- 172.21.15.84:0/3972785890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf81295b0 0x7f4cf807ce50 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f4cf807ab80 tx=0x7f4ce8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:54.897 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4cfe7bc700 1 --2- 172.21.15.84:0/3972785890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf81295b0 0x7f4cf807ce50 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f4cf807ab80 tx=0x7f4ce8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:54.897 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4ceeffd700 1 -- 172.21.15.84:0/3972785890 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ce8012750 con 0x7f4cf81295b0 2020-01-16T05:46:54.897 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4ceeffd700 1 -- 172.21.15.84:0/3972785890 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce8007150 con 0x7f4cf81295b0 2020-01-16T05:46:54.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4ceeffd700 1 -- 172.21.15.84:0/3972785890 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ce8012d30 con 0x7f4cf81295b0 2020-01-16T05:46:54.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4d0021f700 1 -- 172.21.15.84:0/3972785890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf807f640 con 0x7f4cf81295b0 2020-01-16T05:46:54.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4d0021f700 1 -- 172.21.15.84:0/3972785890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf809fe00 con 0x7f4cf81295b0 2020-01-16T05:46:54.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4cfe7bc700 1 --2- 172.21.15.84:0/3972785890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf81295b0 0x7f4cf807ce50 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f4cf807ab80 tx=0x7f4ce8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:54.899 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4d0021f700 1 -- 172.21.15.84:0/3972785890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf805e1c0 con 0x7f4cf81295b0 2020-01-16T05:46:54.899 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4ceeffd700 1 -- 172.21.15.84:0/3972785890 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f4ce80056c0 con 0x7f4cf81295b0 2020-01-16T05:46:54.899 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4cfe7bc700 1 --2- 172.21.15.84:0/3972785890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf81295b0 0x7f4cf807ce50 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f4cf807ab80 tx=0x7f4ce8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:54.900 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4ceeffd700 1 --2- 172.21.15.84:0/3972785890 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4ce003c320 0x7f4ce003e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:54.900 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4ceeffd700 1 -- 172.21.15.84:0/3972785890 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f4ce804ce10 con 0x7f4cf81295b0 2020-01-16T05:46:54.900 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4cfdfbb700 1 --2- 172.21.15.84:0/3972785890 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4ce003c320 0x7f4ce003e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:54.900 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.848+0000 7f4cfdfbb700 1 --2- 172.21.15.84:0/3972785890 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4ce003c320 0x7f4ce003e830 crc :-1 s=READY pgs=151 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:54.901 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.856+0000 7f4cfe7bc700 1 --2- 172.21.15.84:0/3972785890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf81295b0 0x7f4cf807ce50 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f4cf807ab80 tx=0x7f4ce8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:54.902 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:54.856+0000 7f4ceeffd700 1 -- 172.21.15.84:0/3972785890 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f4ce800d0c0 con 0x7f4cf81295b0 2020-01-16T05:46:55.006 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:55.004+0000 7f4d0021f700 1 -- 172.21.15.84:0/3972785890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4cf807d510 con 0x7f4cf81295b0 2020-01-16T05:46:55.007 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:55.004+0000 7f4cfe7bc700 1 --2- 172.21.15.84:0/3972785890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf81295b0 0x7f4cf807ce50 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f4cf807ab80 tx=0x7f4ce8010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:55.007 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:55.004+0000 7f4ceeffd700 1 -- 172.21.15.84:0/3972785890 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f4ce8033430 con 0x7f4cf81295b0 2020-01-16T05:46:55.008 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:55.008 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:55.009 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:55.008+0000 7f4d0021f700 1 -- 172.21.15.84:0/3972785890 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4ce003c320 msgr2=0x7f4ce003e830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:55.010 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:55.008+0000 7f4d0021f700 1 --2- 172.21.15.84:0/3972785890 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4ce003c320 0x7f4ce003e830 crc :-1 s=READY pgs=151 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:55.010 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:55.008+0000 7f4d0021f700 1 -- 172.21.15.84:0/3972785890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf81295b0 msgr2=0x7f4cf807ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:55.010 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:55.008+0000 7f4d0021f700 1 --2- 172.21.15.84:0/3972785890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf81295b0 0x7f4cf807ce50 secure :-1 s=READY pgs=377 cs=0 l=1 rx=0x7f4cf807ab80 tx=0x7f4ce8010d60).stop 2020-01-16T05:46:55.010 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:55.008+0000 7f4d0021f700 1 -- 172.21.15.84:0/3972785890 shutdown_connections 2020-01-16T05:46:55.011 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:55.008+0000 7f4d0021f700 1 --2- 172.21.15.84:0/3972785890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf807ecc0 0x7f4cf807f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:55.012 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:55.008+0000 7f4d0021f700 1 --2- 172.21.15.84:0/3972785890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf81295b0 0x7f4cf807ce50 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:55.012 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:55.008+0000 7f4d0021f700 1 --2- 172.21.15.84:0/3972785890 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4ce003c320 0x7f4ce003e830 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:55.012 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:55.008+0000 7f4d0021f700 1 --2- 172.21.15.84:0/3972785890 >> v2:172.21.15.142:3300/0 conn(0x7f4cf809dc40 0x7f4cf809e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:55.013 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:55.008+0000 7f4d0021f700 1 -- 172.21.15.84:0/3972785890 shutdown_connections 2020-01-16T05:46:55.013 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:55.008+0000 7f4d0021f700 1 -- 172.21.15.84:0/3972785890 wait complete. 2020-01-16T05:46:55.013 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:55.008+0000 7f4d0021f700 1 -- 172.21.15.84:0/3972785890 >> 172.21.15.84:0/3972785890 conn(0x7f4cf80a58a0 msgr2=0x7f4cf807ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:55.014 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:55.021 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:57.022 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:57.148 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.140+0000 7f05ebfff700 1 Processor -- start 2020-01-16T05:46:57.148 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.140+0000 7f05ebfff700 1 -- start start 2020-01-16T05:46:57.148 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05ebfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f05ec0a9b30 0x7f05ec0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:57.148 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05ebfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f05ec07ff10 0x7f05ec066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:57.148 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05ebfff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ec066dd0 con 0x7f05ec0a4250 2020-01-16T05:46:57.149 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05ebfff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ec0a4830 con 0x7f05ec07ff10 2020-01-16T05:46:57.149 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05ebfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ec07f9d0 con 0x7f05ec0a9b30 2020-01-16T05:46:57.149 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05eaffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f05ec07ff10 0x7f05ec066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:57.149 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05f17fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f05ec0a4250 0x7f05ec0a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53044/0 (socket says 172.21.15.84:53044) 2020-01-16T05:46:57.149 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05f17fe700 1 -- 172.21.15.84:0/3251491702 learned_addr learned my addr 172.21.15.84:0/3251491702 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:57.149 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05eb7fe700 1 --2- 172.21.15.84:0/3251491702 >> v2:172.21.15.142:3300/0 conn(0x7f05ec0a9b30 0x7f05ec0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:57.152 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05eaffd700 1 -- 172.21.15.84:0/3251491702 >> v2:172.21.15.142:3300/0 conn(0x7f05ec0a9b30 msgr2=0x7f05ec0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:57.152 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05eaffd700 1 --2- 172.21.15.84:0/3251491702 >> v2:172.21.15.142:3300/0 conn(0x7f05ec0a9b30 0x7f05ec0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:57.152 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05eaffd700 1 -- 172.21.15.84:0/3251491702 >> v1:172.21.15.84:6789/0 conn(0x7f05ec0a4250 legacy=0x7f05ec0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:57.152 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05eaffd700 1 -- 172.21.15.84:0/3251491702 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec150ce0 con 0x7f05ec07ff10 2020-01-16T05:46:57.152 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05eaffd700 1 --2- 172.21.15.84:0/3251491702 >> v2:172.21.15.84:3300/0 conn(0x7f05ec07ff10 0x7f05ec066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f05ec0a49f0 tx=0x7f05d400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:57.153 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05eaffd700 1 --2- 172.21.15.84:0/3251491702 >> v2:172.21.15.84:3300/0 conn(0x7f05ec07ff10 0x7f05ec066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f05ec0a49f0 tx=0x7f05d400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:57.153 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05eaffd700 1 --2- 172.21.15.84:0/3251491702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05ec07ff10 0x7f05ec066880 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7f05ec0a49f0 tx=0x7f05d400fdf0).ready entity=mon.0 client_cookie=30a019527b3d3e86 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:57.153 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05eaffd700 1 --2- 172.21.15.84:0/3251491702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05ec07ff10 0x7f05ec066880 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f05ec0a49f0 tx=0x7f05d400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:57.153 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05eaffd700 1 --2- 172.21.15.84:0/3251491702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05ec07ff10 0x7f05ec066880 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f05ec0a49f0 tx=0x7f05d400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:57.155 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05eaffd700 1 --2- 172.21.15.84:0/3251491702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05ec07ff10 0x7f05ec066880 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f05ec0a49f0 tx=0x7f05d400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:57.156 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05ea7fc700 1 -- 172.21.15.84:0/3251491702 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05d4011620 con 0x7f05ec07ff10 2020-01-16T05:46:57.156 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05ea7fc700 1 -- 172.21.15.84:0/3251491702 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d4008c50 con 0x7f05ec07ff10 2020-01-16T05:46:57.156 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05ea7fc700 1 -- 172.21.15.84:0/3251491702 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05d4011c00 con 0x7f05ec07ff10 2020-01-16T05:46:57.156 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05ebfff700 1 -- 172.21.15.84:0/3251491702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05ec07ff10 msgr2=0x7f05ec066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:57.158 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05ebfff700 1 --2- 172.21.15.84:0/3251491702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05ec07ff10 0x7f05ec066880 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7f05ec0a49f0 tx=0x7f05d400fdf0).stop 2020-01-16T05:46:57.158 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05ebfff700 1 -- 172.21.15.84:0/3251491702 shutdown_connections 2020-01-16T05:46:57.159 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05ebfff700 1 --2- 172.21.15.84:0/3251491702 >> v2:172.21.15.142:3300/0 conn(0x7f05ec0a9b30 0x7f05ec0abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:57.159 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05ebfff700 1 --2- 172.21.15.84:0/3251491702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05ec07ff10 0x7f05ec066880 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:57.159 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05ebfff700 1 -- 172.21.15.84:0/3251491702 shutdown_connections 2020-01-16T05:46:57.159 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05ebfff700 1 -- 172.21.15.84:0/3251491702 wait complete. 2020-01-16T05:46:57.159 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.144+0000 7f05ebfff700 1 -- 172.21.15.84:0/3251491702 >> 172.21.15.84:0/3251491702 conn(0x7f05ec0acfc0 msgr2=0x7f05ec0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:57.164 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.148+0000 7f05ebfff700 1 Processor -- start 2020-01-16T05:46:57.164 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.148+0000 7f05ebfff700 1 -- start start 2020-01-16T05:46:57.164 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.148+0000 7f05ebfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f05ec024920 0x7f05ec091350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:57.165 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.148+0000 7f05ebfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f05ec126530 0x7f05ec09f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:57.165 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.148+0000 7f05ebfff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ec025610 con 0x7f05ec09f670 2020-01-16T05:46:57.165 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.148+0000 7f05ebfff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ec024e30 con 0x7f05ec126530 2020-01-16T05:46:57.165 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.148+0000 7f05ebfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ec0250d0 con 0x7f05ec024920 2020-01-16T05:46:57.165 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.148+0000 7f05eaffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f05ec126530 0x7f05ec09f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:57.165 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.148+0000 7f05eaffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f05ec126530 0x7f05ec09f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35846/0 (socket says 172.21.15.84:35846) 2020-01-16T05:46:57.166 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.148+0000 7f05f17fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f05ec09f670 0x7f05ec135c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53050/0 (socket says 172.21.15.84:53050) 2020-01-16T05:46:57.166 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.148+0000 7f05eaffd700 1 -- 172.21.15.84:0/3945724186 learned_addr learned my addr 172.21.15.84:0/3945724186 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:46:57.166 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05eb7fe700 1 --2- 172.21.15.84:0/3945724186 >> v2:172.21.15.142:3300/0 conn(0x7f05ec024920 0x7f05ec091350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:57.166 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05eaffd700 1 -- 172.21.15.84:0/3945724186 >> v2:172.21.15.142:3300/0 conn(0x7f05ec024920 msgr2=0x7f05ec091350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:57.166 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05eaffd700 1 --2- 172.21.15.84:0/3945724186 >> v2:172.21.15.142:3300/0 conn(0x7f05ec024920 0x7f05ec091350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:57.167 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05eaffd700 1 -- 172.21.15.84:0/3945724186 >> v1:172.21.15.84:6789/0 conn(0x7f05ec09f670 legacy=0x7f05ec135c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:57.167 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05eaffd700 1 -- 172.21.15.84:0/3945724186 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec136400 con 0x7f05ec126530 2020-01-16T05:46:57.167 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05eb7fe700 1 --2- 172.21.15.84:0/3945724186 >> v2:172.21.15.142:3300/0 conn(0x7f05ec024920 0x7f05ec091350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:46:57.167 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05e3fff700 1 -- 172.21.15.84:0/3945724186 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690097842 0 0) 0x7f05ec066dd0 con 0x7f05ec09f670 2020-01-16T05:46:57.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05eaffd700 1 --2- 172.21.15.84:0/3945724186 >> v2:172.21.15.84:3300/0 conn(0x7f05ec126530 0x7f05ec09f120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05ec024ff0 tx=0x7f05d40116e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:57.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05eaffd700 1 --2- 172.21.15.84:0/3945724186 >> v2:172.21.15.84:3300/0 conn(0x7f05ec126530 0x7f05ec09f120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05ec024ff0 tx=0x7f05d40116e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:57.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05eaffd700 1 --2- 172.21.15.84:0/3945724186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05ec126530 0x7f05ec09f120 secure :-1 s=READY pgs=381 cs=0 l=1 rx=0x7f05ec024ff0 tx=0x7f05d40116e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:57.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05eaffd700 1 --2- 172.21.15.84:0/3945724186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05ec126530 0x7f05ec09f120 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7f05ec024ff0 tx=0x7f05d40116e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:57.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05e3fff700 1 -- 172.21.15.84:0/3945724186 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05d400f760 con 0x7f05ec126530 2020-01-16T05:46:57.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05eaffd700 1 --2- 172.21.15.84:0/3945724186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05ec126530 0x7f05ec09f120 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7f05ec024ff0 tx=0x7f05d40116e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:57.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05e3fff700 1 -- 172.21.15.84:0/3945724186 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d4011820 con 0x7f05ec126530 2020-01-16T05:46:57.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05eaffd700 1 --2- 172.21.15.84:0/3945724186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05ec126530 0x7f05ec09f120 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7f05ec024ff0 tx=0x7f05d40116e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:57.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05ebfff700 1 -- 172.21.15.84:0/3945724186 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ec13d050 con 0x7f05ec126530 2020-01-16T05:46:57.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05e3fff700 1 -- 172.21.15.84:0/3945724186 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05d40056c0 con 0x7f05ec126530 2020-01-16T05:46:57.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05ebfff700 1 -- 172.21.15.84:0/3945724186 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ec13d600 con 0x7f05ec126530 2020-01-16T05:46:57.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05eaffd700 1 --2- 172.21.15.84:0/3945724186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05ec126530 0x7f05ec09f120 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7f05ec024ff0 tx=0x7f05d40116e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:57.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05ebfff700 1 -- 172.21.15.84:0/3945724186 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ec05e1c0 con 0x7f05ec126530 2020-01-16T05:46:57.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05e3fff700 1 -- 172.21.15.84:0/3945724186 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f05d4005960 con 0x7f05ec126530 2020-01-16T05:46:57.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05eaffd700 1 --2- 172.21.15.84:0/3945724186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05ec126530 0x7f05ec09f120 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7f05ec024ff0 tx=0x7f05d40116e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:57.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05e3fff700 1 --2- 172.21.15.84:0/3945724186 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f05c403c1b0 0x7f05c403e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:57.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05e3fff700 1 -- 172.21.15.84:0/3945724186 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f05d404d170 con 0x7f05ec126530 2020-01-16T05:46:57.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05eb7fe700 1 --2- 172.21.15.84:0/3945724186 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f05c403c1b0 0x7f05c403e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:57.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.152+0000 7f05eb7fe700 1 --2- 172.21.15.84:0/3945724186 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f05c403c1b0 0x7f05c403e6c0 crc :-1 s=READY pgs=152 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:57.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.160+0000 7f05eaffd700 1 --2- 172.21.15.84:0/3945724186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05ec126530 0x7f05ec09f120 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7f05ec024ff0 tx=0x7f05d40116e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:57.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.160+0000 7f05e3fff700 1 -- 172.21.15.84:0/3945724186 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f05d4033770 con 0x7f05ec126530 2020-01-16T05:46:57.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.308+0000 7f05ebfff700 1 -- 172.21.15.84:0/3945724186 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05ec05cbc0 con 0x7f05ec126530 2020-01-16T05:46:57.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.308+0000 7f05eaffd700 1 --2- 172.21.15.84:0/3945724186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05ec126530 0x7f05ec09f120 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7f05ec024ff0 tx=0x7f05d40116e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:57.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.308+0000 7f05e3fff700 1 -- 172.21.15.84:0/3945724186 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f05d40339d0 con 0x7f05ec126530 2020-01-16T05:46:57.310 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:57.311 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:57.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.312+0000 7f05ebfff700 1 -- 172.21.15.84:0/3945724186 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f05c403c1b0 msgr2=0x7f05c403e6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:57.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.312+0000 7f05ebfff700 1 --2- 172.21.15.84:0/3945724186 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f05c403c1b0 0x7f05c403e6c0 crc :-1 s=READY pgs=152 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:57.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.312+0000 7f05ebfff700 1 -- 172.21.15.84:0/3945724186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05ec126530 msgr2=0x7f05ec09f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:57.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.312+0000 7f05ebfff700 1 --2- 172.21.15.84:0/3945724186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05ec126530 0x7f05ec09f120 secure :-1 s=READY pgs=381 cs=0 l=1 rx=0x7f05ec024ff0 tx=0x7f05d40116e0).stop 2020-01-16T05:46:57.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.312+0000 7f05ebfff700 1 -- 172.21.15.84:0/3945724186 shutdown_connections 2020-01-16T05:46:57.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.312+0000 7f05ebfff700 1 --2- 172.21.15.84:0/3945724186 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f05c403c1b0 0x7f05c403e6c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:57.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.312+0000 7f05ebfff700 1 --2- 172.21.15.84:0/3945724186 >> v2:172.21.15.142:3300/0 conn(0x7f05ec024920 0x7f05ec091350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:57.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.312+0000 7f05ebfff700 1 --2- 172.21.15.84:0/3945724186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05ec126530 0x7f05ec09f120 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:57.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.312+0000 7f05ebfff700 1 -- 172.21.15.84:0/3945724186 shutdown_connections 2020-01-16T05:46:57.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.312+0000 7f05ebfff700 1 -- 172.21.15.84:0/3945724186 wait complete. 2020-01-16T05:46:57.314 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:57.312+0000 7f05ebfff700 1 -- 172.21.15.84:0/3945724186 >> 172.21.15.84:0/3945724186 conn(0x7f05ec0a93c0 msgr2=0x7f05ec127350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:57.315 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:57.323 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:46:59.324 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:46:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18ce6e700 1 Processor -- start 2020-01-16T05:46:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18ce6e700 1 -- start start 2020-01-16T05:46:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18ce6e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff18805b0f0 0x7ff1880a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18ce6e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff18808fd80 0x7ff1881503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:46:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18ce6e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18807cd60 con 0x7ff1880a2f60 2020-01-16T05:46:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18ce6e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1880a3390 con 0x7ff18805b0f0 2020-01-16T05:46:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18ce6e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1880905b0 con 0x7ff18808fd80 2020-01-16T05:46:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff18808fd80 0x7ff1881503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff17e59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff18805b0f0 0x7ff1880a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff186d9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff1880a2f60 0x7ff18807c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:51286/0 (socket says 172.21.15.84:51286) 2020-01-16T05:46:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff186d9d700 1 -- 172.21.15.84:0/672686965 learned_addr learned my addr 172.21.15.84:0/672686965 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18659c700 1 -- 172.21.15.84:0/672686965 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774283887 0 0) 0x7ff18807cd60 con 0x7ff1880a2f60 2020-01-16T05:46:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18659c700 1 -- 172.21.15.84:0/672686965 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff174003230 con 0x7ff1880a2f60 2020-01-16T05:46:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18759e700 1 -- 172.21.15.84:0/672686965 >> v2:172.21.15.142:3300/0 conn(0x7ff18805b0f0 msgr2=0x7ff1880a8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:46:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18759e700 1 --2- 172.21.15.84:0/672686965 >> v2:172.21.15.142:3300/0 conn(0x7ff18805b0f0 0x7ff1880a8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18759e700 1 -- 172.21.15.84:0/672686965 >> v1:172.21.15.142:6789/0 conn(0x7ff1880a2f60 legacy=0x7ff18807c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18759e700 1 -- 172.21.15.84:0/672686965 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18805b520 con 0x7ff18808fd80 2020-01-16T05:46:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18759e700 1 --2- 172.21.15.84:0/672686965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff18808fd80 0x7ff1881503f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff180008c90 tx=0x7ff180010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18759e700 1 --2- 172.21.15.84:0/672686965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff18808fd80 0x7ff1881503f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff180008c90 tx=0x7ff180010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18759e700 1 --2- 172.21.15.84:0/672686965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff18808fd80 0x7ff1881503f0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7ff180008c90 tx=0x7ff180010170).ready entity=mon.2 client_cookie=88d38e52cefdb33d server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18759e700 1 --2- 172.21.15.84:0/672686965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff18808fd80 0x7ff1881503f0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7ff180008c90 tx=0x7ff180010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18659c700 1 -- 172.21.15.84:0/672686965 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff18000a160 con 0x7ff18808fd80 2020-01-16T05:46:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18759e700 1 --2- 172.21.15.84:0/672686965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff18808fd80 0x7ff1881503f0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7ff180008c90 tx=0x7ff180010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18759e700 1 --2- 172.21.15.84:0/672686965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff18808fd80 0x7ff1881503f0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7ff180008c90 tx=0x7ff180010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18659c700 1 -- 172.21.15.84:0/672686965 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff180011af0 con 0x7ff18808fd80 2020-01-16T05:46:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18659c700 1 -- 172.21.15.84:0/672686965 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff18000a740 con 0x7ff18808fd80 2020-01-16T05:46:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18ce6e700 1 -- 172.21.15.84:0/672686965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff18808fd80 msgr2=0x7ff1881503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.444+0000 7ff18ce6e700 1 --2- 172.21.15.84:0/672686965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff18808fd80 0x7ff1881503f0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7ff180008c90 tx=0x7ff180010170).stop 2020-01-16T05:46:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.448+0000 7ff18ce6e700 1 -- 172.21.15.84:0/672686965 shutdown_connections 2020-01-16T05:46:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.448+0000 7ff18ce6e700 1 --2- 172.21.15.84:0/672686965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff18808fd80 0x7ff1881503f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.448+0000 7ff18ce6e700 1 --2- 172.21.15.84:0/672686965 >> v2:172.21.15.142:3300/0 conn(0x7ff18805b0f0 0x7ff1880a8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:46:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.448+0000 7ff18ce6e700 1 -- 172.21.15.84:0/672686965 shutdown_connections 2020-01-16T05:46:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.448+0000 7ff18ce6e700 1 -- 172.21.15.84:0/672686965 wait complete. 2020-01-16T05:46:59.455 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.448+0000 7ff18ce6e700 1 -- 172.21.15.84:0/672686965 >> 172.21.15.84:0/672686965 conn(0x7ff1880abc10 msgr2=0x7ff18805a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:59.458 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.448+0000 7ff18ce6e700 1 Processor -- start 2020-01-16T05:46:59.458 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.448+0000 7ff18ce6e700 1 -- start start 2020-01-16T05:46:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.448+0000 7ff18ce6e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1880a1940 0x7ff18809ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.448+0000 7ff18ce6e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff18809f3c0 0x7ff18813f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.448+0000 7ff18ce6e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18807fed0 con 0x7ff1881346b0 2020-01-16T05:46:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.448+0000 7ff18ce6e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18809fd70 con 0x7ff18809f3c0 2020-01-16T05:46:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.448+0000 7ff18ce6e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1880a1d70 con 0x7ff1880a1940 2020-01-16T05:46:59.460 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.448+0000 7ff186d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff1881346b0 0x7ff1880a01f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53064/0 (socket says 172.21.15.84:53064) 2020-01-16T05:46:59.460 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.448+0000 7ff186d9d700 1 -- 172.21.15.84:0/889086998 learned_addr learned my addr 172.21.15.84:0/889086998 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:46:59.460 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.448+0000 7ff17e59c700 1 --2- 172.21.15.84:0/889086998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1880a1940 0x7ff18809ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:59.460 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.448+0000 7ff18759e700 1 --2- 172.21.15.84:0/889086998 >> v2:172.21.15.142:3300/0 conn(0x7ff18809f3c0 0x7ff18813f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:59.460 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff17ffff700 1 -- 172.21.15.84:0/889086998 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031596360 0 0) 0x7ff18807fed0 con 0x7ff1881346b0 2020-01-16T05:46:59.460 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff17ffff700 1 -- 172.21.15.84:0/889086998 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff16c003230 con 0x7ff1881346b0 2020-01-16T05:46:59.460 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff17e59c700 1 -- 172.21.15.84:0/889086998 >> v2:172.21.15.142:3300/0 conn(0x7ff18809f3c0 msgr2=0x7ff18813f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:59.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff17e59c700 1 --2- 172.21.15.84:0/889086998 >> v2:172.21.15.142:3300/0 conn(0x7ff18809f3c0 0x7ff18813f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:59.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff17e59c700 1 -- 172.21.15.84:0/889086998 >> v1:172.21.15.84:6789/0 conn(0x7ff1881346b0 legacy=0x7ff1880a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:59.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff17e59c700 1 -- 172.21.15.84:0/889086998 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18809c820 con 0x7ff1880a1940 2020-01-16T05:46:59.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff17e59c700 1 --2- 172.21.15.84:0/889086998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1880a1940 0x7ff18809ee70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff170002f30 tx=0x7ff170010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:59.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff17e59c700 1 --2- 172.21.15.84:0/889086998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1880a1940 0x7ff18809ee70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff170002f30 tx=0x7ff170010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:59.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff17e59c700 1 --2- 172.21.15.84:0/889086998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1880a1940 0x7ff18809ee70 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7ff170002f30 tx=0x7ff170010d60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:59.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff17e59c700 1 --2- 172.21.15.84:0/889086998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1880a1940 0x7ff18809ee70 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7ff170002f30 tx=0x7ff170010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:59.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff17ffff700 1 -- 172.21.15.84:0/889086998 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff170012810 con 0x7ff1880a1940 2020-01-16T05:46:59.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff17e59c700 1 --2- 172.21.15.84:0/889086998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1880a1940 0x7ff18809ee70 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7ff170002f30 tx=0x7ff170010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:59.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff17e59c700 1 --2- 172.21.15.84:0/889086998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1880a1940 0x7ff18809ee70 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7ff170002f30 tx=0x7ff170010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:59.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff17ffff700 1 -- 172.21.15.84:0/889086998 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff170007150 con 0x7ff1880a1940 2020-01-16T05:46:59.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff18ce6e700 1 -- 172.21.15.84:0/889086998 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18809f7f0 con 0x7ff1880a1940 2020-01-16T05:46:59.462 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff17ffff700 1 -- 172.21.15.84:0/889086998 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff170012df0 con 0x7ff1880a1940 2020-01-16T05:46:59.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff18ce6e700 1 -- 172.21.15.84:0/889086998 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18813f610 con 0x7ff1880a1940 2020-01-16T05:46:59.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff17e59c700 1 --2- 172.21.15.84:0/889086998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1880a1940 0x7ff18809ee70 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7ff170002f30 tx=0x7ff170010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:59.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff18ce6e700 1 -- 172.21.15.84:0/889086998 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18805e1c0 con 0x7ff1880a1940 2020-01-16T05:46:59.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff17ffff700 1 -- 172.21.15.84:0/889086998 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7ff1700056c0 con 0x7ff1880a1940 2020-01-16T05:46:59.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.452+0000 7ff17e59c700 1 --2- 172.21.15.84:0/889086998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1880a1940 0x7ff18809ee70 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7ff170002f30 tx=0x7ff170010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:59.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.456+0000 7ff17ffff700 1 --2- 172.21.15.84:0/889086998 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7ff16c03c7b0 0x7ff16c03ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:46:59.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.456+0000 7ff17ffff700 1 -- 172.21.15.84:0/889086998 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7ff17004cd20 con 0x7ff1880a1940 2020-01-16T05:46:59.464 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.456+0000 7ff186d9d700 1 --2- 172.21.15.84:0/889086998 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7ff16c03c7b0 0x7ff16c03ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:46:59.464 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.456+0000 7ff186d9d700 1 --2- 172.21.15.84:0/889086998 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7ff16c03c7b0 0x7ff16c03ecc0 crc :-1 s=READY pgs=153 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:46:59.465 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.460+0000 7ff17e59c700 1 --2- 172.21.15.84:0/889086998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1880a1940 0x7ff18809ee70 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7ff170002f30 tx=0x7ff170010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:59.465 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.460+0000 7ff17ffff700 1 -- 172.21.15.84:0/889086998 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7ff170033340 con 0x7ff1880a1940 2020-01-16T05:46:59.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~152s 2020-01-16T05:46:59.617 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.616+0000 7ff18ce6e700 1 -- 172.21.15.84:0/889086998 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff18808f350 con 0x7ff1880a1940 2020-01-16T05:46:59.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.616+0000 7ff17e59c700 1 --2- 172.21.15.84:0/889086998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1880a1940 0x7ff18809ee70 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7ff170002f30 tx=0x7ff170010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:46:59.618 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.616+0000 7ff17ffff700 1 -- 172.21.15.84:0/889086998 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7ff1700335a0 con 0x7ff1880a1940 2020-01-16T05:46:59.619 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:46:59.619 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:46:59.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.620+0000 7ff18ce6e700 1 -- 172.21.15.84:0/889086998 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7ff16c03c7b0 msgr2=0x7ff16c03ecc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:59.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.620+0000 7ff18ce6e700 1 --2- 172.21.15.84:0/889086998 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7ff16c03c7b0 0x7ff16c03ecc0 crc :-1 s=READY pgs=153 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:59.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.620+0000 7ff18ce6e700 1 -- 172.21.15.84:0/889086998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1880a1940 msgr2=0x7ff18809ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:46:59.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.620+0000 7ff18ce6e700 1 --2- 172.21.15.84:0/889086998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1880a1940 0x7ff18809ee70 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7ff170002f30 tx=0x7ff170010d60).stop 2020-01-16T05:46:59.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.620+0000 7ff18ce6e700 1 -- 172.21.15.84:0/889086998 shutdown_connections 2020-01-16T05:46:59.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.620+0000 7ff18ce6e700 1 --2- 172.21.15.84:0/889086998 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7ff16c03c7b0 0x7ff16c03ecc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:59.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.620+0000 7ff18ce6e700 1 --2- 172.21.15.84:0/889086998 >> v2:172.21.15.142:3300/0 conn(0x7ff18809f3c0 0x7ff18813f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:59.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.620+0000 7ff18ce6e700 1 --2- 172.21.15.84:0/889086998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1880a1940 0x7ff18809ee70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:46:59.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.620+0000 7ff18ce6e700 1 -- 172.21.15.84:0/889086998 shutdown_connections 2020-01-16T05:46:59.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.620+0000 7ff18ce6e700 1 -- 172.21.15.84:0/889086998 wait complete. 2020-01-16T05:46:59.623 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:46:59.620+0000 7ff18ce6e700 1 -- 172.21.15.84:0/889086998 >> 172.21.15.84:0/889086998 conn(0x7ff188090090 msgr2=0x7ff188128980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:46:59.623 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:46:59.638 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:47:01.639 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:01.763 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.756+0000 7fd7af1b3700 1 Processor -- start 2020-01-16T05:47:01.764 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.756+0000 7fd7af1b3700 1 -- start start 2020-01-16T05:47:01.764 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.756+0000 7fd7af1b3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7a80a9b30 0x7fd7a80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:01.764 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.756+0000 7fd7af1b3700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7a807ff10 0x7fd7a8066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:01.764 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.756+0000 7fd7af1b3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a8066dd0 con 0x7fd7a80a4250 2020-01-16T05:47:01.765 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.756+0000 7fd7af1b3700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a80a4830 con 0x7fd7a807ff10 2020-01-16T05:47:01.765 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.756+0000 7fd7af1b3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a807f9d0 con 0x7fd7a80a9b30 2020-01-16T05:47:01.765 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7b0415700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd7a80a4250 0x7fd7a80a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53076/0 (socket says 172.21.15.84:53076) 2020-01-16T05:47:01.765 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7b0415700 1 -- 172.21.15.84:0/880923733 learned_addr learned my addr 172.21.15.84:0/880923733 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ae9b2700 1 --2- 172.21.15.84:0/880923733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7a80a9b30 0x7fd7a80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ae1b1700 1 --2- 172.21.15.84:0/880923733 >> v2:172.21.15.142:3300/0 conn(0x7fd7a807ff10 0x7fd7a8066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ad9b0700 1 -- 172.21.15.84:0/880923733 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193063873 0 0) 0x7fd7a8066dd0 con 0x7fd7a80a4250 2020-01-16T05:47:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ad9b0700 1 -- 172.21.15.84:0/880923733 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd790003230 con 0x7fd7a80a4250 2020-01-16T05:47:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ad9b0700 1 -- 172.21.15.84:0/880923733 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2699778212 0 0) 0x7fd790003230 con 0x7fd7a80a4250 2020-01-16T05:47:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ae9b2700 1 -- 172.21.15.84:0/880923733 >> v2:172.21.15.142:3300/0 conn(0x7fd7a807ff10 msgr2=0x7fd7a8066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ae9b2700 1 --2- 172.21.15.84:0/880923733 >> v2:172.21.15.142:3300/0 conn(0x7fd7a807ff10 0x7fd7a8066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ae9b2700 1 -- 172.21.15.84:0/880923733 >> v1:172.21.15.84:6789/0 conn(0x7fd7a80a4250 legacy=0x7fd7a80a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:01.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ae9b2700 1 -- 172.21.15.84:0/880923733 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a8150ce0 con 0x7fd7a80a9b30 2020-01-16T05:47:01.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ae1b1700 1 --2- 172.21.15.84:0/880923733 >> v2:172.21.15.142:3300/0 conn(0x7fd7a807ff10 0x7fd7a8066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:47:01.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ae9b2700 1 --2- 172.21.15.84:0/880923733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7a80a9b30 0x7fd7a80abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd798008c90 tx=0x7fd7a00019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:01.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ae9b2700 1 --2- 172.21.15.84:0/880923733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7a80a9b30 0x7fd7a80abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd798008c90 tx=0x7fd7a00019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:01.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ae9b2700 1 --2- 172.21.15.84:0/880923733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7a80a9b30 0x7fd7a80abdd0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fd798008c90 tx=0x7fd7a00019d0).ready entity=mon.2 client_cookie=2d76408da737c355 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:01.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ae9b2700 1 --2- 172.21.15.84:0/880923733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7a80a9b30 0x7fd7a80abdd0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fd798008c90 tx=0x7fd7a00019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:01.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ad9b0700 1 -- 172.21.15.84:0/880923733 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7a0001750 con 0x7fd7a80a9b30 2020-01-16T05:47:01.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ae9b2700 1 --2- 172.21.15.84:0/880923733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7a80a9b30 0x7fd7a80abdd0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fd798008c90 tx=0x7fd7a00019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:01.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ad9b0700 1 -- 172.21.15.84:0/880923733 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a0001560 con 0x7fd7a80a9b30 2020-01-16T05:47:01.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ae9b2700 1 --2- 172.21.15.84:0/880923733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7a80a9b30 0x7fd7a80abdd0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fd798008c90 tx=0x7fd7a00019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:01.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7ad9b0700 1 -- 172.21.15.84:0/880923733 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd79800a160 con 0x7fd7a80a9b30 2020-01-16T05:47:01.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7af1b3700 1 -- 172.21.15.84:0/880923733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7a80a9b30 msgr2=0x7fd7a80abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:01.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7af1b3700 1 --2- 172.21.15.84:0/880923733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7a80a9b30 0x7fd7a80abdd0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fd798008c90 tx=0x7fd7a00019d0).stop 2020-01-16T05:47:01.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7af1b3700 1 -- 172.21.15.84:0/880923733 shutdown_connections 2020-01-16T05:47:01.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7af1b3700 1 --2- 172.21.15.84:0/880923733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7a80a9b30 0x7fd7a80abdd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:01.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7af1b3700 1 --2- 172.21.15.84:0/880923733 >> v2:172.21.15.142:3300/0 conn(0x7fd7a807ff10 0x7fd7a8066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:01.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7af1b3700 1 -- 172.21.15.84:0/880923733 shutdown_connections 2020-01-16T05:47:01.772 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7af1b3700 1 -- 172.21.15.84:0/880923733 wait complete. 2020-01-16T05:47:01.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.760+0000 7fd7af1b3700 1 -- 172.21.15.84:0/880923733 >> 172.21.15.84:0/880923733 conn(0x7fd7a80acfc0 msgr2=0x7fd7a80a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:01.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7af1b3700 1 Processor -- start 2020-01-16T05:47:01.773 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7af1b3700 1 -- start start 2020-01-16T05:47:01.776 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7af1b3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd7a813c310 0x7fd7a813e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:01.776 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7af1b3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a80a03c0 con 0x7fd7a8136040 2020-01-16T05:47:01.776 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7af1b3700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a807bd80 con 0x7fd7a81266c0 2020-01-16T05:47:01.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7af1b3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a80a32d0 con 0x7fd7a813c310 2020-01-16T05:47:01.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7ae1b1700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd7a8136040 0x7fd7a8136470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53080/0 (socket says 172.21.15.84:53080) 2020-01-16T05:47:01.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7ae1b1700 1 -- 172.21.15.84:0/1222099649 learned_addr learned my addr 172.21.15.84:0/1222099649 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:01.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7b0415700 1 --2- 172.21.15.84:0/1222099649 >> v2:172.21.15.84:3300/0 conn(0x7fd7a813c310 0x7fd7a813e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:01.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7a77fe700 1 -- 172.21.15.84:0/1222099649 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950566608 0 0) 0x7fd7a80a03c0 con 0x7fd7a8136040 2020-01-16T05:47:01.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7a77fe700 1 -- 172.21.15.84:0/1222099649 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd788003230 con 0x7fd7a8136040 2020-01-16T05:47:01.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7a77fe700 1 -- 172.21.15.84:0/1222099649 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4099854398 0 0) 0x7fd788003230 con 0x7fd7a8136040 2020-01-16T05:47:01.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7b0415700 1 -- 172.21.15.84:0/1222099649 >> v1:172.21.15.142:6789/0 conn(0x7fd7a81266c0 legacy=0x7fd7a809f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:01.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7b0415700 1 -- 172.21.15.84:0/1222099649 >> v1:172.21.15.84:6789/0 conn(0x7fd7a8136040 legacy=0x7fd7a8136470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:01.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7b0415700 1 -- 172.21.15.84:0/1222099649 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a8079b10 con 0x7fd7a813c310 2020-01-16T05:47:01.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7b0415700 1 --2- 172.21.15.84:0/1222099649 >> v2:172.21.15.84:3300/0 conn(0x7fd7a813c310 0x7fd7a813e750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd79c002700 tx=0x7fd7a00019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:01.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7b0415700 1 --2- 172.21.15.84:0/1222099649 >> v2:172.21.15.84:3300/0 conn(0x7fd7a813c310 0x7fd7a813e750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd79c002700 tx=0x7fd7a00019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:01.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7b0415700 1 --2- 172.21.15.84:0/1222099649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7a813c310 0x7fd7a813e750 secure :-1 s=READY pgs=385 cs=0 l=1 rx=0x7fd79c002700 tx=0x7fd7a00019d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7b0415700 1 --2- 172.21.15.84:0/1222099649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7a813c310 0x7fd7a813e750 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7fd79c002700 tx=0x7fd7a00019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7a77fe700 1 -- 172.21.15.84:0/1222099649 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd79c002500 con 0x7fd7a813c310 2020-01-16T05:47:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7b0415700 1 --2- 172.21.15.84:0/1222099649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7a813c310 0x7fd7a813e750 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7fd79c002700 tx=0x7fd7a00019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7af1b3700 1 -- 172.21.15.84:0/1222099649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a809fac0 con 0x7fd7a813c310 2020-01-16T05:47:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7a77fe700 1 -- 172.21.15.84:0/1222099649 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79c002310 con 0x7fd7a813c310 2020-01-16T05:47:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7b0415700 1 --2- 172.21.15.84:0/1222099649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7a813c310 0x7fd7a813e750 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7fd79c002700 tx=0x7fd7a00019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7a77fe700 1 -- 172.21.15.84:0/1222099649 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7a0011870 con 0x7fd7a813c310 2020-01-16T05:47:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7af1b3700 1 -- 172.21.15.84:0/1222099649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a813eca0 con 0x7fd7a813c310 2020-01-16T05:47:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.764+0000 7fd7b0415700 1 --2- 172.21.15.84:0/1222099649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7a813c310 0x7fd7a813e750 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7fd79c002700 tx=0x7fd7a00019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.768+0000 7fd7af1b3700 1 -- 172.21.15.84:0/1222099649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a805e1c0 con 0x7fd7a813c310 2020-01-16T05:47:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.768+0000 7fd7a77fe700 1 -- 172.21.15.84:0/1222099649 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fd7a0011b10 con 0x7fd7a813c310 2020-01-16T05:47:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.768+0000 7fd7b0415700 1 --2- 172.21.15.84:0/1222099649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7a813c310 0x7fd7a813e750 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7fd79c002700 tx=0x7fd7a00019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.768+0000 7fd7a77fe700 1 --2- 172.21.15.84:0/1222099649 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd78803c780 0x7fd78803ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.768+0000 7fd7a77fe700 1 -- 172.21.15.84:0/1222099649 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fd7a004c5c0 con 0x7fd7a813c310 2020-01-16T05:47:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.768+0000 7fd7ae9b2700 1 --2- 172.21.15.84:0/1222099649 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd78803c780 0x7fd78803ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.768+0000 7fd7ae9b2700 1 --2- 172.21.15.84:0/1222099649 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd78803c780 0x7fd78803ec90 crc :-1 s=READY pgs=154 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.772+0000 7fd7b0415700 1 --2- 172.21.15.84:0/1222099649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7a813c310 0x7fd7a813e750 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7fd79c002700 tx=0x7fd7a00019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.772+0000 7fd7a77fe700 1 -- 172.21.15.84:0/1222099649 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fd7a0032bc0 con 0x7fd7a813c310 2020-01-16T05:47:01.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.920+0000 7fd7af1b3700 1 -- 172.21.15.84:0/1222099649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7a809fcd0 con 0x7fd7a813c310 2020-01-16T05:47:01.922 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.920+0000 7fd7b0415700 1 --2- 172.21.15.84:0/1222099649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7a813c310 0x7fd7a813e750 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7fd79c002700 tx=0x7fd7a00019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:01.922 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.920+0000 7fd7a77fe700 1 -- 172.21.15.84:0/1222099649 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fd7a0032e20 con 0x7fd7a813c310 2020-01-16T05:47:01.922 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:01.923 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:01.923 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.924+0000 7fd7af1b3700 1 -- 172.21.15.84:0/1222099649 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd78803c780 msgr2=0x7fd78803ec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:01.923 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.924+0000 7fd7af1b3700 1 --2- 172.21.15.84:0/1222099649 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd78803c780 0x7fd78803ec90 crc :-1 s=READY pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:01.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.924+0000 7fd7af1b3700 1 -- 172.21.15.84:0/1222099649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7a813c310 msgr2=0x7fd7a813e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:01.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.924+0000 7fd7af1b3700 1 --2- 172.21.15.84:0/1222099649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7a813c310 0x7fd7a813e750 secure :-1 s=READY pgs=385 cs=0 l=1 rx=0x7fd79c002700 tx=0x7fd7a00019d0).stop 2020-01-16T05:47:01.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.924+0000 7fd7af1b3700 1 -- 172.21.15.84:0/1222099649 shutdown_connections 2020-01-16T05:47:01.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.924+0000 7fd7af1b3700 1 --2- 172.21.15.84:0/1222099649 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd78803c780 0x7fd78803ec90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:01.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.924+0000 7fd7af1b3700 1 --2- 172.21.15.84:0/1222099649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7a813c310 0x7fd7a813e750 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:01.925 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.924+0000 7fd7af1b3700 1 -- 172.21.15.84:0/1222099649 shutdown_connections 2020-01-16T05:47:01.925 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.924+0000 7fd7af1b3700 1 -- 172.21.15.84:0/1222099649 wait complete. 2020-01-16T05:47:01.926 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:01.924+0000 7fd7af1b3700 1 -- 172.21.15.84:0/1222099649 >> 172.21.15.84:0/1222099649 conn(0x7fd7a80ab750 msgr2=0x7fd7a8066730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:01.926 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:01.936 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:03.937 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:04.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.056+0000 7fe5a5ace700 1 Processor -- start 2020-01-16T05:47:04.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.056+0000 7fe5a5ace700 1 -- start start 2020-01-16T05:47:04.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe5a5ace700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5a00a2f60 0x7fe5a005b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:04.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe5a5ace700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe5a00a8ff0 0x7fe5a008fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:04.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe5a5ace700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe5a007c560 0x7fe5a007c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:04.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe5a5ace700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a00a3390 con 0x7fe5a00a8ff0 2020-01-16T05:47:04.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe5a5ace700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a00905b0 con 0x7fe5a007c560 2020-01-16T05:47:04.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe5a5ace700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a00a2a20 con 0x7fe5a00a2f60 2020-01-16T05:47:04.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe59f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe5a00a8ff0 0x7fe5a008fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:04.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe59f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe5a00a8ff0 0x7fe5a008fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35888/0 (socket says 172.21.15.84:35888) 2020-01-16T05:47:04.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe59f7fe700 1 -- 172.21.15.84:0/2084441707 learned_addr learned my addr 172.21.15.84:0/2084441707 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:47:04.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe59ffff700 1 --2- 172.21.15.84:0/2084441707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5a00a2f60 0x7fe5a005b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:04.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe5a486c700 1 --2- 172.21.15.84:0/2084441707 >> v2:172.21.15.142:3300/0 conn(0x7fe5a007c560 0x7fe5a007c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:04.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe59f7fe700 1 -- 172.21.15.84:0/2084441707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5a00a2f60 msgr2=0x7fe5a005b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:04.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe59f7fe700 1 --2- 172.21.15.84:0/2084441707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5a00a2f60 0x7fe5a005b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:04.072 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe59f7fe700 1 -- 172.21.15.84:0/2084441707 >> v2:172.21.15.142:3300/0 conn(0x7fe5a007c560 msgr2=0x7fe5a007c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:04.072 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe59f7fe700 1 --2- 172.21.15.84:0/2084441707 >> v2:172.21.15.142:3300/0 conn(0x7fe5a007c560 0x7fe5a007c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:04.072 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe59f7fe700 1 -- 172.21.15.84:0/2084441707 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a00902d0 con 0x7fe5a00a8ff0 2020-01-16T05:47:04.073 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe59f7fe700 1 --2- 172.21.15.84:0/2084441707 >> v2:172.21.15.84:3300/0 conn(0x7fe5a00a8ff0 0x7fe5a008fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe5a0090770 tx=0x7fe59000ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:04.073 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe59f7fe700 1 --2- 172.21.15.84:0/2084441707 >> v2:172.21.15.84:3300/0 conn(0x7fe5a00a8ff0 0x7fe5a008fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe5a0090770 tx=0x7fe59000ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:04.073 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe59f7fe700 1 --2- 172.21.15.84:0/2084441707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a00a8ff0 0x7fe5a008fd80 secure :-1 s=READY pgs=387 cs=0 l=1 rx=0x7fe5a0090770 tx=0x7fe59000ff30).ready entity=mon.0 client_cookie=424bba3e6a32da85 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:04.073 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe59f7fe700 1 --2- 172.21.15.84:0/2084441707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a00a8ff0 0x7fe5a008fd80 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7fe5a0090770 tx=0x7fe59000ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:04.073 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe59f7fe700 1 --2- 172.21.15.84:0/2084441707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a00a8ff0 0x7fe5a008fd80 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7fe5a0090770 tx=0x7fe59000ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe59effd700 1 -- 172.21.15.84:0/2084441707 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe590011760 con 0x7fe5a00a8ff0 2020-01-16T05:47:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe59f7fe700 1 --2- 172.21.15.84:0/2084441707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a00a8ff0 0x7fe5a008fd80 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7fe5a0090770 tx=0x7fe59000ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe59effd700 1 -- 172.21.15.84:0/2084441707 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe590008d30 con 0x7fe5a00a8ff0 2020-01-16T05:47:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe59effd700 1 -- 172.21.15.84:0/2084441707 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe590011d40 con 0x7fe5a00a8ff0 2020-01-16T05:47:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe5a5ace700 1 -- 172.21.15.84:0/2084441707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a00a8ff0 msgr2=0x7fe5a008fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe5a5ace700 1 --2- 172.21.15.84:0/2084441707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a00a8ff0 0x7fe5a008fd80 secure :-1 s=READY pgs=387 cs=0 l=1 rx=0x7fe5a0090770 tx=0x7fe59000ff30).stop 2020-01-16T05:47:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe5a5ace700 1 -- 172.21.15.84:0/2084441707 shutdown_connections 2020-01-16T05:47:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe5a5ace700 1 --2- 172.21.15.84:0/2084441707 >> v2:172.21.15.142:3300/0 conn(0x7fe5a007c560 0x7fe5a007c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe5a5ace700 1 --2- 172.21.15.84:0/2084441707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5a00a2f60 0x7fe5a005b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe5a5ace700 1 --2- 172.21.15.84:0/2084441707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a00a8ff0 0x7fe5a008fd80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe5a5ace700 1 -- 172.21.15.84:0/2084441707 shutdown_connections 2020-01-16T05:47:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe5a5ace700 1 -- 172.21.15.84:0/2084441707 wait complete. 2020-01-16T05:47:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.060+0000 7fe5a5ace700 1 -- 172.21.15.84:0/2084441707 >> 172.21.15.84:0/2084441707 conn(0x7fe5a00abc10 msgr2=0x7fe5a005a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:04.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a5ace700 1 Processor -- start 2020-01-16T05:47:04.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a5ace700 1 -- start start 2020-01-16T05:47:04.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a5ace700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5a007ce50 0x7fe5a007ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:04.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a5ace700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe5a007f210 0x7fe5a013c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:04.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a5ace700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a007d280 con 0x7fe5a01295b0 2020-01-16T05:47:04.079 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a5ace700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a009e440 con 0x7fe5a007f210 2020-01-16T05:47:04.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a5ace700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a007a9c0 con 0x7fe5a007ce50 2020-01-16T05:47:04.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a486c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe5a007f210 0x7fe5a013c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:04.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a486c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe5a007f210 0x7fe5a013c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.84:45876/0 (socket says 172.21.15.84:45876) 2020-01-16T05:47:04.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe59f7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5a007ce50 0x7fe5a007ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:04.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a486c700 1 -- 172.21.15.84:0/221812305 learned_addr learned my addr 172.21.15.84:0/221812305 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:47:04.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a486c700 1 -- 172.21.15.84:0/221812305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5a007ce50 msgr2=0x7fe5a007ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:04.080 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a486c700 1 --2- 172.21.15.84:0/221812305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5a007ce50 0x7fe5a007ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:04.081 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a486c700 1 -- 172.21.15.84:0/221812305 >> v1:172.21.15.142:6789/0 conn(0x7fe5a01295b0 legacy=0x7fe5a009dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:04.081 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a486c700 1 -- 172.21.15.84:0/221812305 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a007d730 con 0x7fe5a007f210 2020-01-16T05:47:04.081 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a486c700 1 --2- 172.21.15.84:0/221812305 >> v2:172.21.15.142:3300/0 conn(0x7fe5a007f210 0x7fe5a013c2e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5a0066c50 tx=0x7fe588010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:04.081 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a486c700 1 --2- 172.21.15.84:0/221812305 >> v2:172.21.15.142:3300/0 conn(0x7fe5a007f210 0x7fe5a013c2e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5a0066c50 tx=0x7fe588010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:04.081 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a486c700 1 --2- 172.21.15.84:0/221812305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5a007f210 0x7fe5a013c2e0 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7fe5a0066c50 tx=0x7fe588010b80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:04.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a486c700 1 --2- 172.21.15.84:0/221812305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5a007f210 0x7fe5a013c2e0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7fe5a0066c50 tx=0x7fe588010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:04.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe59cff9700 1 -- 172.21.15.84:0/221812305 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe588007530 con 0x7fe5a007f210 2020-01-16T05:47:04.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a486c700 1 --2- 172.21.15.84:0/221812305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5a007f210 0x7fe5a013c2e0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7fe5a0066c50 tx=0x7fe588010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:04.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a5ace700 1 -- 172.21.15.84:0/221812305 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a007f640 con 0x7fe5a007f210 2020-01-16T05:47:04.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe59cff9700 1 -- 172.21.15.84:0/221812305 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe588007150 con 0x7fe5a007f210 2020-01-16T05:47:04.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a486c700 1 --2- 172.21.15.84:0/221812305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5a007f210 0x7fe5a013c2e0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7fe5a0066c50 tx=0x7fe588010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe59cff9700 1 -- 172.21.15.84:0/221812305 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe588005b20 con 0x7fe5a007f210 2020-01-16T05:47:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.064+0000 7fe5a5ace700 1 -- 172.21.15.84:0/221812305 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a013c830 con 0x7fe5a007f210 2020-01-16T05:47:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.068+0000 7fe5a486c700 1 --2- 172.21.15.84:0/221812305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5a007f210 0x7fe5a013c2e0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7fe5a0066c50 tx=0x7fe588010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.068+0000 7fe5a5ace700 1 -- 172.21.15.84:0/221812305 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a005e1c0 con 0x7fe5a007f210 2020-01-16T05:47:04.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.068+0000 7fe59cff9700 1 -- 172.21.15.84:0/221812305 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fe5880125f0 con 0x7fe5a007f210 2020-01-16T05:47:04.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.068+0000 7fe5a486c700 1 --2- 172.21.15.84:0/221812305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5a007f210 0x7fe5a013c2e0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7fe5a0066c50 tx=0x7fe588010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:04.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.068+0000 7fe59cff9700 1 --2- 172.21.15.84:0/221812305 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe57803c250 0x7fe57803e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:04.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.068+0000 7fe59cff9700 1 -- 172.21.15.84:0/221812305 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fe58804ca60 con 0x7fe5a007f210 2020-01-16T05:47:04.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.068+0000 7fe59ffff700 1 --2- 172.21.15.84:0/221812305 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe57803c250 0x7fe57803e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:04.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.068+0000 7fe59ffff700 1 --2- 172.21.15.84:0/221812305 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe57803c250 0x7fe57803e760 crc :-1 s=READY pgs=155 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:04.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.076+0000 7fe5a486c700 1 --2- 172.21.15.84:0/221812305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5a007f210 0x7fe5a013c2e0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7fe5a0066c50 tx=0x7fe588010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:04.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.076+0000 7fe59cff9700 1 -- 172.21.15.84:0/221812305 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fe588005d70 con 0x7fe5a007f210 2020-01-16T05:47:04.228 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.228+0000 7fe5a5ace700 1 -- 172.21.15.84:0/221812305 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5a007d510 con 0x7fe5a007f210 2020-01-16T05:47:04.229 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.228+0000 7fe5a486c700 1 --2- 172.21.15.84:0/221812305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5a007f210 0x7fe5a013c2e0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7fe5a0066c50 tx=0x7fe588010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:04.230 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.228+0000 7fe59cff9700 1 -- 172.21.15.84:0/221812305 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fe588030610 con 0x7fe5a007f210 2020-01-16T05:47:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:04.230 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:04.231 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.232+0000 7fe5a5ace700 1 -- 172.21.15.84:0/221812305 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe57803c250 msgr2=0x7fe57803e760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:04.232 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.232+0000 7fe5a5ace700 1 --2- 172.21.15.84:0/221812305 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe57803c250 0x7fe57803e760 crc :-1 s=READY pgs=155 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:04.232 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.232+0000 7fe5a5ace700 1 -- 172.21.15.84:0/221812305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5a007f210 msgr2=0x7fe5a013c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:04.232 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.232+0000 7fe5a5ace700 1 --2- 172.21.15.84:0/221812305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5a007f210 0x7fe5a013c2e0 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7fe5a0066c50 tx=0x7fe588010b80).stop 2020-01-16T05:47:04.232 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.232+0000 7fe5a5ace700 1 -- 172.21.15.84:0/221812305 shutdown_connections 2020-01-16T05:47:04.233 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.232+0000 7fe5a5ace700 1 --2- 172.21.15.84:0/221812305 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe57803c250 0x7fe57803e760 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:04.233 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.232+0000 7fe5a5ace700 1 --2- 172.21.15.84:0/221812305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5a007f210 0x7fe5a013c2e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:04.233 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.232+0000 7fe5a5ace700 1 --2- 172.21.15.84:0/221812305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5a007ce50 0x7fe5a007ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:04.233 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.232+0000 7fe5a5ace700 1 -- 172.21.15.84:0/221812305 shutdown_connections 2020-01-16T05:47:04.233 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.232+0000 7fe5a5ace700 1 -- 172.21.15.84:0/221812305 wait complete. 2020-01-16T05:47:04.234 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:04.232+0000 7fe5a5ace700 1 -- 172.21.15.84:0/221812305 >> 172.21.15.84:0/221812305 conn(0x7fe5a00a58a0 msgr2=0x7fe5a007ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:04.234 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:04.243 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:05.893 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~159s 2020-01-16T05:47:06.244 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:06.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a0a0e0700 1 Processor -- start 2020-01-16T05:47:06.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a0a0e0700 1 -- start start 2020-01-16T05:47:06.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a0a0e0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a040a9b30 0x7f4a040abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:06.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a0a0e0700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4a0407ff10 0x7f4a04066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:06.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a0a0e0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a04066dd0 con 0x7f4a040a4250 2020-01-16T05:47:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a0a0e0700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a040a4830 con 0x7f4a0407ff10 2020-01-16T05:47:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a0a0e0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0407f9d0 con 0x7f4a040a9b30 2020-01-16T05:47:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a0b342700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4a040a4250 0x7f4a040a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53104/0 (socket says 172.21.15.84:53104) 2020-01-16T05:47:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a0b342700 1 -- 172.21.15.84:0/1824143750 learned_addr learned my addr 172.21.15.84:0/1824143750 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a098df700 1 --2- 172.21.15.84:0/1824143750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a040a9b30 0x7f4a040abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a090de700 1 --2- 172.21.15.84:0/1824143750 >> v2:172.21.15.142:3300/0 conn(0x7f4a0407ff10 0x7f4a04066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a088dd700 1 -- 172.21.15.84:0/1824143750 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793777249 0 0) 0x7f4a04066dd0 con 0x7f4a040a4250 2020-01-16T05:47:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a088dd700 1 -- 172.21.15.84:0/1824143750 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49f0003230 con 0x7f4a040a4250 2020-01-16T05:47:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a098df700 1 -- 172.21.15.84:0/1824143750 >> v2:172.21.15.142:3300/0 conn(0x7f4a0407ff10 msgr2=0x7f4a04066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a098df700 1 --2- 172.21.15.84:0/1824143750 >> v2:172.21.15.142:3300/0 conn(0x7f4a0407ff10 0x7f4a04066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a098df700 1 -- 172.21.15.84:0/1824143750 >> v1:172.21.15.84:6789/0 conn(0x7f4a040a4250 legacy=0x7f4a040a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a098df700 1 -- 172.21.15.84:0/1824143750 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a04150ce0 con 0x7f4a040a9b30 2020-01-16T05:47:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a098df700 1 --2- 172.21.15.84:0/1824143750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a040a9b30 0x7f4a040abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4a00008910 tx=0x7f4a0000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a098df700 1 --2- 172.21.15.84:0/1824143750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a040a9b30 0x7f4a040abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4a00008910 tx=0x7f4a0000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a098df700 1 --2- 172.21.15.84:0/1824143750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a040a9b30 0x7f4a040abdd0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f4a00008910 tx=0x7f4a0000fdf0).ready entity=mon.2 client_cookie=ddda37d6cbacaa7 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a098df700 1 --2- 172.21.15.84:0/1824143750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a040a9b30 0x7f4a040abdd0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f4a00008910 tx=0x7f4a0000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a088dd700 1 -- 172.21.15.84:0/1824143750 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a00011660 con 0x7f4a040a9b30 2020-01-16T05:47:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.364+0000 7f4a098df700 1 --2- 172.21.15.84:0/1824143750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a040a9b30 0x7f4a040abdd0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f4a00008910 tx=0x7f4a0000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.368+0000 7f4a088dd700 1 -- 172.21.15.84:0/1824143750 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a00008c50 con 0x7f4a040a9b30 2020-01-16T05:47:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.368+0000 7f4a098df700 1 --2- 172.21.15.84:0/1824143750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a040a9b30 0x7f4a040abdd0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f4a00008910 tx=0x7f4a0000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.368+0000 7f4a088dd700 1 -- 172.21.15.84:0/1824143750 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a00011c40 con 0x7f4a040a9b30 2020-01-16T05:47:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.368+0000 7f4a0a0e0700 1 -- 172.21.15.84:0/1824143750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a040a9b30 msgr2=0x7f4a040abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.368+0000 7f4a0a0e0700 1 --2- 172.21.15.84:0/1824143750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a040a9b30 0x7f4a040abdd0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f4a00008910 tx=0x7f4a0000fdf0).stop 2020-01-16T05:47:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.368+0000 7f4a0a0e0700 1 -- 172.21.15.84:0/1824143750 shutdown_connections 2020-01-16T05:47:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.368+0000 7f4a0a0e0700 1 --2- 172.21.15.84:0/1824143750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a040a9b30 0x7f4a040abdd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.368+0000 7f4a0a0e0700 1 --2- 172.21.15.84:0/1824143750 >> v2:172.21.15.142:3300/0 conn(0x7f4a0407ff10 0x7f4a04066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.368+0000 7f4a0a0e0700 1 -- 172.21.15.84:0/1824143750 shutdown_connections 2020-01-16T05:47:06.375 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.368+0000 7f4a0a0e0700 1 -- 172.21.15.84:0/1824143750 wait complete. 2020-01-16T05:47:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.368+0000 7f4a0a0e0700 1 -- 172.21.15.84:0/1824143750 >> 172.21.15.84:0/1824143750 conn(0x7f4a040acfc0 msgr2=0x7f4a040a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a0a0e0700 1 Processor -- start 2020-01-16T05:47:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a0a0e0700 1 -- start start 2020-01-16T05:47:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a0a0e0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4a04126930 0x7f4a0408fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a0a0e0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a040a9030 0x7f4a0409f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a0a0e0700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a0409fca0 con 0x7f4a0409f870 2020-01-16T05:47:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a0a0e0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a040904f0 con 0x7f4a04126930 2020-01-16T05:47:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a0a0e0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a04134bd0 con 0x7f4a040a9030 2020-01-16T05:47:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a098df700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4a04126930 0x7f4a0408fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a098df700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4a04126930 0x7f4a0408fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35906/0 (socket says 172.21.15.84:35906) 2020-01-16T05:47:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a098df700 1 -- 172.21.15.84:0/3467598347 learned_addr learned my addr 172.21.15.84:0/3467598347 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:47:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a090de700 1 --2- 172.21.15.84:0/3467598347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a040a9030 0x7f4a0409f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a098df700 1 -- 172.21.15.84:0/3467598347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a040a9030 msgr2=0x7f4a0409f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a098df700 1 --2- 172.21.15.84:0/3467598347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a040a9030 0x7f4a0409f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a098df700 1 -- 172.21.15.84:0/3467598347 >> v1:172.21.15.142:6789/0 conn(0x7f4a0409f870 legacy=0x7f4a04134e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f49fa7fc700 1 -- 172.21.15.84:0/3467598347 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992907982 0 0) 0x7f4a0409fca0 con 0x7f4a0409f870 2020-01-16T05:47:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a098df700 1 -- 172.21.15.84:0/3467598347 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a04135670 con 0x7f4a04126930 2020-01-16T05:47:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a098df700 1 --2- 172.21.15.84:0/3467598347 >> v2:172.21.15.84:3300/0 conn(0x7f4a04126930 0x7f4a0408fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a00008910 tx=0x7f4a00008f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a098df700 1 --2- 172.21.15.84:0/3467598347 >> v2:172.21.15.84:3300/0 conn(0x7f4a04126930 0x7f4a0408fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a00008910 tx=0x7f4a00008f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a098df700 1 --2- 172.21.15.84:0/3467598347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a04126930 0x7f4a0408fd70 secure :-1 s=READY pgs=389 cs=0 l=1 rx=0x7f4a00008910 tx=0x7f4a00008f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a098df700 1 --2- 172.21.15.84:0/3467598347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a04126930 0x7f4a0408fd70 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f4a00008910 tx=0x7f4a00008f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f49fa7fc700 1 -- 172.21.15.84:0/3467598347 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a00007340 con 0x7f4a04126930 2020-01-16T05:47:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a098df700 1 --2- 172.21.15.84:0/3467598347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a04126930 0x7f4a0408fd70 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f4a00008910 tx=0x7f4a00008f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f49fa7fc700 1 -- 172.21.15.84:0/3467598347 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a00011860 con 0x7f4a04126930 2020-01-16T05:47:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a0a0e0700 1 -- 172.21.15.84:0/3467598347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a0413bf10 con 0x7f4a04126930 2020-01-16T05:47:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a098df700 1 --2- 172.21.15.84:0/3467598347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a04126930 0x7f4a0408fd70 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f4a00008910 tx=0x7f4a00008f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f49fa7fc700 1 -- 172.21.15.84:0/3467598347 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a0000f740 con 0x7f4a04126930 2020-01-16T05:47:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.372+0000 7f4a0a0e0700 1 -- 172.21.15.84:0/3467598347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a0413c4c0 con 0x7f4a04126930 2020-01-16T05:47:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.376+0000 7f4a098df700 1 --2- 172.21.15.84:0/3467598347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a04126930 0x7f4a0408fd70 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f4a00008910 tx=0x7f4a00008f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.376+0000 7f4a0a0e0700 1 -- 172.21.15.84:0/3467598347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a0405e1c0 con 0x7f4a04126930 2020-01-16T05:47:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.376+0000 7f49fa7fc700 1 -- 172.21.15.84:0/3467598347 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f4a000056c0 con 0x7f4a04126930 2020-01-16T05:47:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.376+0000 7f4a098df700 1 --2- 172.21.15.84:0/3467598347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a04126930 0x7f4a0408fd70 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f4a00008910 tx=0x7f4a00008f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.376+0000 7f49fa7fc700 1 --2- 172.21.15.84:0/3467598347 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f49ec03c1c0 0x7f49ec03e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.376+0000 7f49fa7fc700 1 -- 172.21.15.84:0/3467598347 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f4a0004cde0 con 0x7f4a04126930 2020-01-16T05:47:06.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.376+0000 7f4a090de700 1 --2- 172.21.15.84:0/3467598347 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f49ec03c1c0 0x7f49ec03e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:06.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.376+0000 7f4a090de700 1 --2- 172.21.15.84:0/3467598347 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f49ec03c1c0 0x7f49ec03e6d0 crc :-1 s=READY pgs=156 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:06.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.384+0000 7f4a098df700 1 --2- 172.21.15.84:0/3467598347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a04126930 0x7f4a0408fd70 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f4a00008910 tx=0x7f4a00008f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:06.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.384+0000 7f49fa7fc700 1 -- 172.21.15.84:0/3467598347 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f4a000333e0 con 0x7f4a04126930 2020-01-16T05:47:06.536 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.536+0000 7f4a0a0e0700 1 -- 172.21.15.84:0/3467598347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a04066370 con 0x7f4a04126930 2020-01-16T05:47:06.537 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.536+0000 7f4a098df700 1 --2- 172.21.15.84:0/3467598347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a04126930 0x7f4a0408fd70 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f4a00008910 tx=0x7f4a00008f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:06.537 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.536+0000 7f49fa7fc700 1 -- 172.21.15.84:0/3467598347 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f4a00033640 con 0x7f4a04126930 2020-01-16T05:47:06.538 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:06.538 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:06.539 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.540+0000 7f4a0a0e0700 1 -- 172.21.15.84:0/3467598347 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f49ec03c1c0 msgr2=0x7f49ec03e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:06.539 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.540+0000 7f4a0a0e0700 1 --2- 172.21.15.84:0/3467598347 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f49ec03c1c0 0x7f49ec03e6d0 crc :-1 s=READY pgs=156 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:06.540 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.540+0000 7f4a0a0e0700 1 -- 172.21.15.84:0/3467598347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a04126930 msgr2=0x7f4a0408fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:06.540 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.540+0000 7f4a0a0e0700 1 --2- 172.21.15.84:0/3467598347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a04126930 0x7f4a0408fd70 secure :-1 s=READY pgs=389 cs=0 l=1 rx=0x7f4a00008910 tx=0x7f4a00008f00).stop 2020-01-16T05:47:06.540 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.540+0000 7f4a0a0e0700 1 -- 172.21.15.84:0/3467598347 shutdown_connections 2020-01-16T05:47:06.540 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.540+0000 7f4a0a0e0700 1 --2- 172.21.15.84:0/3467598347 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f49ec03c1c0 0x7f49ec03e6d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:06.540 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.540+0000 7f4a0a0e0700 1 --2- 172.21.15.84:0/3467598347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a04126930 0x7f4a0408fd70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:06.540 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.540+0000 7f4a0a0e0700 1 --2- 172.21.15.84:0/3467598347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a040a9030 0x7f4a0409f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:06.540 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.540+0000 7f4a0a0e0700 1 -- 172.21.15.84:0/3467598347 shutdown_connections 2020-01-16T05:47:06.541 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.540+0000 7f4a0a0e0700 1 -- 172.21.15.84:0/3467598347 wait complete. 2020-01-16T05:47:06.541 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:06.540+0000 7f4a0a0e0700 1 -- 172.21.15.84:0/3467598347 >> 172.21.15.84:0/3467598347 conn(0x7f4a040a9b30 msgr2=0x7f4a04127170 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:06.541 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:06.551 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:08.552 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:08.672 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.668+0000 7f3b7359e700 1 Processor -- start 2020-01-16T05:47:08.673 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.668+0000 7f3b7359e700 1 -- start start 2020-01-16T05:47:08.673 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.668+0000 7f3b7359e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3b740a9b30 0x7f3b740abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:08.673 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.668+0000 7f3b7359e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b74066880 con 0x7f3b740a4250 2020-01-16T05:47:08.673 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.668+0000 7f3b7359e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b74066ab0 con 0x7f3b7407ff10 2020-01-16T05:47:08.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.668+0000 7f3b7359e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b740a4830 con 0x7f3b740a9b30 2020-01-16T05:47:08.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.668+0000 7f3b72d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3b740a9b30 0x7f3b740abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:08.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.668+0000 7f3b788ea700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3b740a4250 0x7f3b7414fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53118/0 (socket says 172.21.15.84:53118) 2020-01-16T05:47:08.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.668+0000 7f3b788ea700 1 -- 172.21.15.84:0/2833971942 learned_addr learned my addr 172.21.15.84:0/2833971942 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:08.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.668+0000 7f3b72d9d700 1 -- 172.21.15.84:0/2833971942 >> v1:172.21.15.142:6789/0 conn(0x7f3b7407ff10 legacy=0x7f3b740a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:08.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.668+0000 7f3b72d9d700 1 -- 172.21.15.84:0/2833971942 >> v1:172.21.15.84:6789/0 conn(0x7f3b740a4250 legacy=0x7f3b7414fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:08.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.668+0000 7f3b72d9d700 1 -- 172.21.15.84:0/2833971942 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b74066ce0 con 0x7f3b740a9b30 2020-01-16T05:47:08.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.668+0000 7f3b71d9b700 1 -- 172.21.15.84:0/2833971942 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86447382 0 0) 0x7f3b74066880 con 0x7f3b740a4250 2020-01-16T05:47:08.675 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.668+0000 7f3b72d9d700 1 --2- 172.21.15.84:0/2833971942 >> v2:172.21.15.84:3300/0 conn(0x7f3b740a9b30 0x7f3b740abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3b64008910 tx=0x7f3b6400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.672+0000 7f3b72d9d700 1 --2- 172.21.15.84:0/2833971942 >> v2:172.21.15.84:3300/0 conn(0x7f3b740a9b30 0x7f3b740abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3b64008910 tx=0x7f3b6400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.672+0000 7f3b72d9d700 1 --2- 172.21.15.84:0/2833971942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b740a9b30 0x7f3b740abdd0 secure :-1 s=READY pgs=391 cs=0 l=1 rx=0x7f3b64008910 tx=0x7f3b6400fd70).ready entity=mon.0 client_cookie=5f684c0df3128e82 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.672+0000 7f3b72d9d700 1 --2- 172.21.15.84:0/2833971942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b740a9b30 0x7f3b740abdd0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f3b64008910 tx=0x7f3b6400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.672+0000 7f3b71d9b700 1 -- 172.21.15.84:0/2833971942 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b640115e0 con 0x7f3b740a9b30 2020-01-16T05:47:08.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.672+0000 7f3b72d9d700 1 --2- 172.21.15.84:0/2833971942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b740a9b30 0x7f3b740abdd0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f3b64008910 tx=0x7f3b6400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:08.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.672+0000 7f3b72d9d700 1 --2- 172.21.15.84:0/2833971942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b740a9b30 0x7f3b740abdd0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f3b64008910 tx=0x7f3b6400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:08.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.672+0000 7f3b71d9b700 1 -- 172.21.15.84:0/2833971942 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b64008d40 con 0x7f3b740a9b30 2020-01-16T05:47:08.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.672+0000 7f3b71d9b700 1 -- 172.21.15.84:0/2833971942 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b64011bc0 con 0x7f3b740a9b30 2020-01-16T05:47:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.672+0000 7f3b7359e700 1 -- 172.21.15.84:0/2833971942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b740a9b30 msgr2=0x7f3b740abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.672+0000 7f3b7359e700 1 --2- 172.21.15.84:0/2833971942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b740a9b30 0x7f3b740abdd0 secure :-1 s=READY pgs=391 cs=0 l=1 rx=0x7f3b64008910 tx=0x7f3b6400fd70).stop 2020-01-16T05:47:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.672+0000 7f3b7359e700 1 -- 172.21.15.84:0/2833971942 shutdown_connections 2020-01-16T05:47:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.672+0000 7f3b7359e700 1 --2- 172.21.15.84:0/2833971942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b740a9b30 0x7f3b740abdd0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.672+0000 7f3b7359e700 1 -- 172.21.15.84:0/2833971942 shutdown_connections 2020-01-16T05:47:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.672+0000 7f3b7359e700 1 -- 172.21.15.84:0/2833971942 wait complete. 2020-01-16T05:47:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.672+0000 7f3b7359e700 1 -- 172.21.15.84:0/2833971942 >> 172.21.15.84:0/2833971942 conn(0x7f3b740acfc0 msgr2=0x7f3b740a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:08.701 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.672+0000 7f3b7359e700 1 Processor -- start 2020-01-16T05:47:08.701 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.672+0000 7f3b7359e700 1 -- start start 2020-01-16T05:47:08.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b7359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b740a1f20 0x7f3b74061140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:08.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b7359e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b740a1440 con 0x7f3b740a0470 2020-01-16T05:47:08.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b7359e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b740a1760 con 0x7f3b74131720 2020-01-16T05:47:08.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b7359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b740ab090 con 0x7f3b740a1f20 2020-01-16T05:47:08.703 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b72d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3b740a0470 0x7f3b74131f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53122/0 (socket says 172.21.15.84:53122) 2020-01-16T05:47:08.703 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b72d9d700 1 -- 172.21.15.84:0/653205976 learned_addr learned my addr 172.21.15.84:0/653205976 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:08.703 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b7259c700 1 --2- 172.21.15.84:0/653205976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b740a1f20 0x7f3b74061140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:08.703 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b637fe700 1 -- 172.21.15.84:0/653205976 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615640505 0 0) 0x7f3b740a1440 con 0x7f3b740a0470 2020-01-16T05:47:08.704 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b637fe700 1 -- 172.21.15.84:0/653205976 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b58003230 con 0x7f3b740a0470 2020-01-16T05:47:08.704 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b637fe700 1 -- 172.21.15.84:0/653205976 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2963156952 0 0) 0x7f3b740a1760 con 0x7f3b74131720 2020-01-16T05:47:08.704 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b637fe700 1 -- 172.21.15.84:0/653205976 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b740a1440 con 0x7f3b74131720 2020-01-16T05:47:08.704 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b637fe700 1 -- 172.21.15.84:0/653205976 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4113175240 0 0) 0x7f3b58003230 con 0x7f3b740a0470 2020-01-16T05:47:08.705 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b637fe700 1 -- 172.21.15.84:0/653205976 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3b740a1760 con 0x7f3b740a0470 2020-01-16T05:47:08.705 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b637fe700 1 -- 172.21.15.84:0/653205976 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f3b64008d40 con 0x7f3b740a0470 2020-01-16T05:47:08.705 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b7259c700 1 -- 172.21.15.84:0/653205976 >> v1:172.21.15.142:6789/0 conn(0x7f3b74131720 legacy=0x7f3b740a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:08.705 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b7259c700 1 -- 172.21.15.84:0/653205976 >> v1:172.21.15.84:6789/0 conn(0x7f3b740a0470 legacy=0x7f3b74131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:08.705 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b7259c700 1 -- 172.21.15.84:0/653205976 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7413f080 con 0x7f3b740a1f20 2020-01-16T05:47:08.706 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b7259c700 1 --2- 172.21.15.84:0/653205976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b740a1f20 0x7f3b74061140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b68000e90 tx=0x7f3b6c0013c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:08.706 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b7259c700 1 --2- 172.21.15.84:0/653205976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b740a1f20 0x7f3b74061140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b68000e90 tx=0x7f3b6c0013c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:08.706 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b7259c700 1 --2- 172.21.15.84:0/653205976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b740a1f20 0x7f3b74061140 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f3b68000e90 tx=0x7f3b6c0013c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:08.706 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b7259c700 1 --2- 172.21.15.84:0/653205976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b740a1f20 0x7f3b74061140 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f3b68000e90 tx=0x7f3b6c0013c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:08.707 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b637fe700 1 -- 172.21.15.84:0/653205976 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b6800cae0 con 0x7f3b740a1f20 2020-01-16T05:47:08.707 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b7259c700 1 --2- 172.21.15.84:0/653205976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b740a1f20 0x7f3b74061140 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f3b68000e90 tx=0x7f3b6c0013c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:08.707 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b7359e700 1 -- 172.21.15.84:0/653205976 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7413d060 con 0x7f3b740a1f20 2020-01-16T05:47:08.707 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b637fe700 1 -- 172.21.15.84:0/653205976 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6800c700 con 0x7f3b740a1f20 2020-01-16T05:47:08.708 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b7259c700 1 --2- 172.21.15.84:0/653205976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b740a1f20 0x7f3b74061140 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f3b68000e90 tx=0x7f3b6c0013c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:08.708 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b637fe700 1 -- 172.21.15.84:0/653205976 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b68012220 con 0x7f3b740a1f20 2020-01-16T05:47:08.708 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.676+0000 7f3b7359e700 1 -- 172.21.15.84:0/653205976 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7413d440 con 0x7f3b740a1f20 2020-01-16T05:47:08.708 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.680+0000 7f3b7259c700 1 --2- 172.21.15.84:0/653205976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b740a1f20 0x7f3b74061140 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f3b68000e90 tx=0x7f3b6c0013c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:08.709 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.680+0000 7f3b7359e700 1 -- 172.21.15.84:0/653205976 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7405e1c0 con 0x7f3b740a1f20 2020-01-16T05:47:08.709 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.680+0000 7f3b637fe700 1 -- 172.21.15.84:0/653205976 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f3b68012540 con 0x7f3b740a1f20 2020-01-16T05:47:08.709 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.680+0000 7f3b7259c700 1 --2- 172.21.15.84:0/653205976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b740a1f20 0x7f3b74061140 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f3b68000e90 tx=0x7f3b6c0013c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:08.709 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.680+0000 7f3b637fe700 1 --2- 172.21.15.84:0/653205976 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3b5803cdd0 0x7f3b5803f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:08.710 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.680+0000 7f3b637fe700 1 -- 172.21.15.84:0/653205976 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f3b6804c2e0 con 0x7f3b740a1f20 2020-01-16T05:47:08.710 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.680+0000 7f3b72d9d700 1 --2- 172.21.15.84:0/653205976 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3b5803cdd0 0x7f3b5803f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:08.710 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.680+0000 7f3b72d9d700 1 --2- 172.21.15.84:0/653205976 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3b5803cdd0 0x7f3b5803f2e0 crc :-1 s=READY pgs=157 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:08.710 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.688+0000 7f3b7259c700 1 --2- 172.21.15.84:0/653205976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b740a1f20 0x7f3b74061140 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f3b68000e90 tx=0x7f3b6c0013c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:08.711 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.688+0000 7f3b637fe700 1 -- 172.21.15.84:0/653205976 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f3b680328e0 con 0x7f3b740a1f20 2020-01-16T05:47:08.841 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.840+0000 7f3b7359e700 1 -- 172.21.15.84:0/653205976 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b7405cbc0 con 0x7f3b740a1f20 2020-01-16T05:47:08.842 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.840+0000 7f3b7259c700 1 --2- 172.21.15.84:0/653205976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b740a1f20 0x7f3b74061140 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f3b68000e90 tx=0x7f3b6c0013c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:08.842 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.840+0000 7f3b637fe700 1 -- 172.21.15.84:0/653205976 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f3b68032b40 con 0x7f3b740a1f20 2020-01-16T05:47:08.842 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:08.843 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:08.844 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.844+0000 7f3b7359e700 1 -- 172.21.15.84:0/653205976 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3b5803cdd0 msgr2=0x7f3b5803f2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:08.844 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.844+0000 7f3b7359e700 1 --2- 172.21.15.84:0/653205976 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3b5803cdd0 0x7f3b5803f2e0 crc :-1 s=READY pgs=157 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:08.844 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.844+0000 7f3b7359e700 1 -- 172.21.15.84:0/653205976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b740a1f20 msgr2=0x7f3b74061140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:08.845 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.844+0000 7f3b7359e700 1 --2- 172.21.15.84:0/653205976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b740a1f20 0x7f3b74061140 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f3b68000e90 tx=0x7f3b6c0013c0).stop 2020-01-16T05:47:08.845 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.844+0000 7f3b7359e700 1 -- 172.21.15.84:0/653205976 shutdown_connections 2020-01-16T05:47:08.845 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.844+0000 7f3b7359e700 1 --2- 172.21.15.84:0/653205976 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f3b5803cdd0 0x7f3b5803f2e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:08.845 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.844+0000 7f3b7359e700 1 --2- 172.21.15.84:0/653205976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b740a1f20 0x7f3b74061140 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:08.846 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.844+0000 7f3b7359e700 1 -- 172.21.15.84:0/653205976 shutdown_connections 2020-01-16T05:47:08.846 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.844+0000 7f3b7359e700 1 -- 172.21.15.84:0/653205976 wait complete. 2020-01-16T05:47:08.846 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:08.844+0000 7f3b7359e700 1 -- 172.21.15.84:0/653205976 >> 172.21.15.84:0/653205976 conn(0x7f3b740a4bf0 msgr2=0x7f3b740246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:08.847 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:08.856 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:10.857 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:10.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383cb7e700 1 Processor -- start 2020-01-16T05:47:10.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383cb7e700 1 -- start start 2020-01-16T05:47:10.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383cb7e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807ff10 0x7f38380abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:10.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383cb7e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f38380a4250 0x7f3838066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:10.986 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383cb7e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3838066dd0 con 0x7f38380a9b30 2020-01-16T05:47:10.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383cb7e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38380a4830 con 0x7f38380a4250 2020-01-16T05:47:10.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383cb7e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383807f9d0 con 0x7f383807ff10 2020-01-16T05:47:10.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383dde0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f38380a4250 0x7f3838066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:10.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f3837fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f38380a9b30 0x7f38380a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53132/0 (socket says 172.21.15.84:53132) 2020-01-16T05:47:10.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f3837fff700 1 -- 172.21.15.84:0/2097784593 learned_addr learned my addr 172.21.15.84:0/2097784593 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:10.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f382f7fe700 1 --2- 172.21.15.84:0/2097784593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807ff10 0x7f38380abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:10.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f38377fe700 1 -- 172.21.15.84:0/2097784593 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338014934 0 0) 0x7f3838066dd0 con 0x7f38380a9b30 2020-01-16T05:47:10.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f38377fe700 1 -- 172.21.15.84:0/2097784593 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3824003230 con 0x7f38380a9b30 2020-01-16T05:47:10.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383dde0700 1 -- 172.21.15.84:0/2097784593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807ff10 msgr2=0x7f38380abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:10.990 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383dde0700 1 --2- 172.21.15.84:0/2097784593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807ff10 0x7f38380abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:10.990 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383dde0700 1 -- 172.21.15.84:0/2097784593 >> v1:172.21.15.84:6789/0 conn(0x7f38380a9b30 legacy=0x7f38380a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:10.993 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383dde0700 1 -- 172.21.15.84:0/2097784593 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3838150ce0 con 0x7f38380a4250 2020-01-16T05:47:10.993 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383dde0700 1 --2- 172.21.15.84:0/2097784593 >> v2:172.21.15.84:3300/0 conn(0x7f38380a4250 0x7f3838066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3830008c90 tx=0x7f3830010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:10.994 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383dde0700 1 --2- 172.21.15.84:0/2097784593 >> v2:172.21.15.84:3300/0 conn(0x7f38380a4250 0x7f3838066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3830008c90 tx=0x7f3830010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:10.994 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383dde0700 1 --2- 172.21.15.84:0/2097784593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38380a4250 0x7f3838066880 secure :-1 s=READY pgs=394 cs=0 l=1 rx=0x7f3830008c90 tx=0x7f3830010170).ready entity=mon.0 client_cookie=3a71e1e42b83f8cd server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:10.994 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383dde0700 1 --2- 172.21.15.84:0/2097784593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38380a4250 0x7f3838066880 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f3830008c90 tx=0x7f3830010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:10.994 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f38377fe700 1 -- 172.21.15.84:0/2097784593 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f383000a160 con 0x7f38380a4250 2020-01-16T05:47:10.995 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383dde0700 1 --2- 172.21.15.84:0/2097784593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38380a4250 0x7f3838066880 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f3830008c90 tx=0x7f3830010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:10.995 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f38377fe700 1 -- 172.21.15.84:0/2097784593 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3830011af0 con 0x7f38380a4250 2020-01-16T05:47:10.995 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383dde0700 1 --2- 172.21.15.84:0/2097784593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38380a4250 0x7f3838066880 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f3830008c90 tx=0x7f3830010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:10.995 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383cb7e700 1 -- 172.21.15.84:0/2097784593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38380a4250 msgr2=0x7f3838066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:10.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f38377fe700 1 -- 172.21.15.84:0/2097784593 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f383000a740 con 0x7f38380a4250 2020-01-16T05:47:10.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383cb7e700 1 --2- 172.21.15.84:0/2097784593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38380a4250 0x7f3838066880 secure :-1 s=READY pgs=394 cs=0 l=1 rx=0x7f3830008c90 tx=0x7f3830010170).stop 2020-01-16T05:47:10.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383cb7e700 1 -- 172.21.15.84:0/2097784593 shutdown_connections 2020-01-16T05:47:10.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383cb7e700 1 --2- 172.21.15.84:0/2097784593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38380a4250 0x7f3838066880 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:10.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383cb7e700 1 --2- 172.21.15.84:0/2097784593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807ff10 0x7f38380abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:10.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383cb7e700 1 -- 172.21.15.84:0/2097784593 shutdown_connections 2020-01-16T05:47:10.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383cb7e700 1 -- 172.21.15.84:0/2097784593 wait complete. 2020-01-16T05:47:10.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.976+0000 7f383cb7e700 1 -- 172.21.15.84:0/2097784593 >> 172.21.15.84:0/2097784593 conn(0x7f38380acfc0 msgr2=0x7f38380a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:10.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.980+0000 7f383cb7e700 1 Processor -- start 2020-01-16T05:47:10.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.980+0000 7f383cb7e700 1 -- start start 2020-01-16T05:47:10.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.980+0000 7f383cb7e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dca0 0x7f383813e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:10.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.980+0000 7f383cb7e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38380a24e0 con 0x7f38380a5e00 2020-01-16T05:47:10.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.980+0000 7f383cb7e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3838091e20 con 0x7f38380a20b0 2020-01-16T05:47:10.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.980+0000 7f383cb7e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3838091a40 con 0x7f383807dca0 2020-01-16T05:47:10.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.980+0000 7f3837fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f38380a5e00 0x7f38380a0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53136/0 (socket says 172.21.15.84:53136) 2020-01-16T05:47:10.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.980+0000 7f3837fff700 1 -- 172.21.15.84:0/2099987971 learned_addr learned my addr 172.21.15.84:0/2099987971 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:10.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.980+0000 7f383dde0700 1 --2- 172.21.15.84:0/2099987971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dca0 0x7f383813e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:10.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.980+0000 7f38357fa700 1 -- 172.21.15.84:0/2099987971 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621609515 0 0) 0x7f3824003230 con 0x7f38380a5e00 2020-01-16T05:47:10.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.980+0000 7f38357fa700 1 -- 172.21.15.84:0/2099987971 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f381c003230 con 0x7f38380a5e00 2020-01-16T05:47:10.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.980+0000 7f38357fa700 1 -- 172.21.15.84:0/2099987971 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294622150 0 0) 0x7f3838091e20 con 0x7f38380a20b0 2020-01-16T05:47:10.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.980+0000 7f38357fa700 1 -- 172.21.15.84:0/2099987971 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3824003230 con 0x7f38380a20b0 2020-01-16T05:47:11.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.980+0000 7f383dde0700 1 -- 172.21.15.84:0/2099987971 >> v1:172.21.15.142:6789/0 conn(0x7f38380a20b0 legacy=0x7f383807d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:11.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.980+0000 7f383dde0700 1 -- 172.21.15.84:0/2099987971 >> v1:172.21.15.84:6789/0 conn(0x7f38380a5e00 legacy=0x7f38380a0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:11.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.980+0000 7f383dde0700 1 -- 172.21.15.84:0/2099987971 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38380a0d10 con 0x7f383807dca0 2020-01-16T05:47:11.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.980+0000 7f383dde0700 1 --2- 172.21.15.84:0/2099987971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dca0 0x7f383813e680 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3830008c90 tx=0x7f3830011d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:11.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.984+0000 7f383dde0700 1 --2- 172.21.15.84:0/2099987971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dca0 0x7f383813e680 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3830008c90 tx=0x7f3830011d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:11.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.984+0000 7f383dde0700 1 --2- 172.21.15.84:0/2099987971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dca0 0x7f383813e680 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f3830008c90 tx=0x7f3830011d20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:11.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.984+0000 7f383dde0700 1 --2- 172.21.15.84:0/2099987971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dca0 0x7f383813e680 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f3830008c90 tx=0x7f3830011d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:11.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.984+0000 7f38357fa700 1 -- 172.21.15.84:0/2099987971 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3830005a40 con 0x7f383807dca0 2020-01-16T05:47:11.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.984+0000 7f383dde0700 1 --2- 172.21.15.84:0/2099987971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dca0 0x7f383813e680 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f3830008c90 tx=0x7f3830011d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:11.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.984+0000 7f38357fa700 1 -- 172.21.15.84:0/2099987971 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383000a360 con 0x7f383807dca0 2020-01-16T05:47:11.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.984+0000 7f383cb7e700 1 -- 172.21.15.84:0/2099987971 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383807e0d0 con 0x7f383807dca0 2020-01-16T05:47:11.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.984+0000 7f383dde0700 1 --2- 172.21.15.84:0/2099987971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dca0 0x7f383813e680 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f3830008c90 tx=0x7f3830011d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:11.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.984+0000 7f38357fa700 1 -- 172.21.15.84:0/2099987971 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3830007340 con 0x7f383807dca0 2020-01-16T05:47:11.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.984+0000 7f383cb7e700 1 -- 172.21.15.84:0/2099987971 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383813ebd0 con 0x7f383807dca0 2020-01-16T05:47:11.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.984+0000 7f383dde0700 1 --2- 172.21.15.84:0/2099987971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dca0 0x7f383813e680 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f3830008c90 tx=0x7f3830011d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:11.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.984+0000 7f38357fa700 1 -- 172.21.15.84:0/2099987971 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f3830007590 con 0x7f383807dca0 2020-01-16T05:47:11.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.984+0000 7f383dde0700 1 --2- 172.21.15.84:0/2099987971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dca0 0x7f383813e680 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f3830008c90 tx=0x7f3830011d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:11.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.984+0000 7f383cb7e700 1 -- 172.21.15.84:0/2099987971 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383805e1c0 con 0x7f383807dca0 2020-01-16T05:47:11.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.984+0000 7f38357fa700 1 --2- 172.21.15.84:0/2099987971 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f381c03c9f0 0x7f381c03ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:11.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.984+0000 7f38357fa700 1 -- 172.21.15.84:0/2099987971 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f383004d3e0 con 0x7f383807dca0 2020-01-16T05:47:11.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.984+0000 7f3837fff700 1 --2- 172.21.15.84:0/2099987971 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f381c03c9f0 0x7f381c03ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:11.003 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.984+0000 7f3837fff700 1 --2- 172.21.15.84:0/2099987971 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f381c03c9f0 0x7f381c03ef00 crc :-1 s=READY pgs=158 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:11.004 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.992+0000 7f383dde0700 1 --2- 172.21.15.84:0/2099987971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dca0 0x7f383813e680 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f3830008c90 tx=0x7f3830011d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:11.004 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:10.992+0000 7f38357fa700 1 -- 172.21.15.84:0/2099987971 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f38300339e0 con 0x7f383807dca0 2020-01-16T05:47:11.149 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:11.148+0000 7f383cb7e700 1 -- 172.21.15.84:0/2099987971 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38380662e0 con 0x7f383807dca0 2020-01-16T05:47:11.150 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:11.148+0000 7f383dde0700 1 --2- 172.21.15.84:0/2099987971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dca0 0x7f383813e680 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f3830008c90 tx=0x7f3830011d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:11.150 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:11.148+0000 7f38357fa700 1 -- 172.21.15.84:0/2099987971 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f38300078a0 con 0x7f383807dca0 2020-01-16T05:47:11.151 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:11.151 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:11.153 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:11.152+0000 7f383cb7e700 1 -- 172.21.15.84:0/2099987971 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f381c03c9f0 msgr2=0x7f381c03ef00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:11.154 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:11.152+0000 7f383cb7e700 1 --2- 172.21.15.84:0/2099987971 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f381c03c9f0 0x7f381c03ef00 crc :-1 s=READY pgs=158 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:11.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:11.152+0000 7f383cb7e700 1 -- 172.21.15.84:0/2099987971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dca0 msgr2=0x7f383813e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:11.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:11.152+0000 7f383cb7e700 1 --2- 172.21.15.84:0/2099987971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dca0 0x7f383813e680 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f3830008c90 tx=0x7f3830011d20).stop 2020-01-16T05:47:11.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:11.152+0000 7f383cb7e700 1 -- 172.21.15.84:0/2099987971 shutdown_connections 2020-01-16T05:47:11.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:11.152+0000 7f383cb7e700 1 --2- 172.21.15.84:0/2099987971 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f381c03c9f0 0x7f381c03ef00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:11.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:11.152+0000 7f383cb7e700 1 --2- 172.21.15.84:0/2099987971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f383807dca0 0x7f383813e680 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:11.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:11.152+0000 7f383cb7e700 1 -- 172.21.15.84:0/2099987971 shutdown_connections 2020-01-16T05:47:11.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:11.152+0000 7f383cb7e700 1 -- 172.21.15.84:0/2099987971 wait complete. 2020-01-16T05:47:11.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:11.152+0000 7f383cb7e700 1 -- 172.21.15.84:0/2099987971 >> 172.21.15.84:0/2099987971 conn(0x7f383805ee80 msgr2=0x7f38380a8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:11.172 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:47:12.214 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~165s 2020-01-16T05:47:13.173 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:13.304 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.292+0000 7f5349ce6700 1 Processor -- start 2020-01-16T05:47:13.305 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.292+0000 7f5349ce6700 1 -- start start 2020-01-16T05:47:13.305 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.292+0000 7f5349ce6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f534407ff10 0x7f53440abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:13.305 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.292+0000 7f5349ce6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53440a4250 0x7f5344066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:13.305 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.292+0000 7f5349ce6700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5344066dd0 con 0x7f53440a9b30 2020-01-16T05:47:13.306 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.292+0000 7f5349ce6700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53440a4830 con 0x7f534407ff10 2020-01-16T05:47:13.306 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.292+0000 7f5349ce6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534407f9d0 con 0x7f53440a4250 2020-01-16T05:47:13.306 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.292+0000 7f53494e5700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f53440a9b30 0x7f53440a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53152/0 (socket says 172.21.15.84:53152) 2020-01-16T05:47:13.306 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.292+0000 7f53494e5700 1 -- 172.21.15.84:0/86179874 learned_addr learned my addr 172.21.15.84:0/86179874 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:13.307 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.292+0000 7f5348ce4700 1 --2- 172.21.15.84:0/86179874 >> v2:172.21.15.84:3300/0 conn(0x7f534407ff10 0x7f53440abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:13.307 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.292+0000 7f534af48700 1 --2- 172.21.15.84:0/86179874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53440a4250 0x7f5344066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:13.307 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.292+0000 7f5348ce4700 1 -- 172.21.15.84:0/86179874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53440a4250 msgr2=0x7f5344066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:13.307 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.292+0000 7f5348ce4700 1 --2- 172.21.15.84:0/86179874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53440a4250 0x7f5344066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:13.307 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.292+0000 7f5348ce4700 1 -- 172.21.15.84:0/86179874 >> v1:172.21.15.84:6789/0 conn(0x7f53440a9b30 legacy=0x7f53440a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:13.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.292+0000 7f533bfff700 1 -- 172.21.15.84:0/86179874 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466105025 0 0) 0x7f5344066dd0 con 0x7f53440a9b30 2020-01-16T05:47:13.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.292+0000 7f5348ce4700 1 -- 172.21.15.84:0/86179874 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5344150ce0 con 0x7f534407ff10 2020-01-16T05:47:13.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.292+0000 7f534af48700 1 --2- 172.21.15.84:0/86179874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53440a4250 0x7f5344066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:47:13.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f5348ce4700 1 --2- 172.21.15.84:0/86179874 >> v2:172.21.15.84:3300/0 conn(0x7f534407ff10 0x7f53440abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f53440a49f0 tx=0x7f533400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:13.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f5348ce4700 1 --2- 172.21.15.84:0/86179874 >> v2:172.21.15.84:3300/0 conn(0x7f534407ff10 0x7f53440abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f53440a49f0 tx=0x7f533400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:13.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f5348ce4700 1 --2- 172.21.15.84:0/86179874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f534407ff10 0x7f53440abdd0 secure :-1 s=READY pgs=398 cs=0 l=1 rx=0x7f53440a49f0 tx=0x7f533400fdf0).ready entity=mon.0 client_cookie=969821ff6161f85f server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:13.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f5348ce4700 1 --2- 172.21.15.84:0/86179874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f534407ff10 0x7f53440abdd0 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f53440a49f0 tx=0x7f533400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:13.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f5348ce4700 1 --2- 172.21.15.84:0/86179874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f534407ff10 0x7f53440abdd0 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f53440a49f0 tx=0x7f533400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:13.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f5348ce4700 1 --2- 172.21.15.84:0/86179874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f534407ff10 0x7f53440abdd0 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f53440a49f0 tx=0x7f533400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:13.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f533bfff700 1 -- 172.21.15.84:0/86179874 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5334011660 con 0x7f534407ff10 2020-01-16T05:47:13.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f533bfff700 1 -- 172.21.15.84:0/86179874 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5334008c50 con 0x7f534407ff10 2020-01-16T05:47:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f533bfff700 1 -- 172.21.15.84:0/86179874 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5334011c40 con 0x7f534407ff10 2020-01-16T05:47:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f5349ce6700 1 -- 172.21.15.84:0/86179874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f534407ff10 msgr2=0x7f53440abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f5349ce6700 1 --2- 172.21.15.84:0/86179874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f534407ff10 0x7f53440abdd0 secure :-1 s=READY pgs=398 cs=0 l=1 rx=0x7f53440a49f0 tx=0x7f533400fdf0).stop 2020-01-16T05:47:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f5349ce6700 1 -- 172.21.15.84:0/86179874 shutdown_connections 2020-01-16T05:47:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f5349ce6700 1 --2- 172.21.15.84:0/86179874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53440a4250 0x7f5344066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f5349ce6700 1 --2- 172.21.15.84:0/86179874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f534407ff10 0x7f53440abdd0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f5349ce6700 1 -- 172.21.15.84:0/86179874 shutdown_connections 2020-01-16T05:47:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f5349ce6700 1 -- 172.21.15.84:0/86179874 wait complete. 2020-01-16T05:47:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f5349ce6700 1 -- 172.21.15.84:0/86179874 >> 172.21.15.84:0/86179874 conn(0x7f53440acfc0 msgr2=0x7f53440a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f5349ce6700 1 Processor -- start 2020-01-16T05:47:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.296+0000 7f5349ce6700 1 -- start start 2020-01-16T05:47:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5349ce6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5344128540 0x7f5344125ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5349ce6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5344123610 0x7f5344126540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5349ce6700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5344124f10 con 0x7f5344123150 2020-01-16T05:47:13.315 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5349ce6700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5344127bc0 con 0x7f5344128540 2020-01-16T05:47:13.315 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5349ce6700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5344127e60 con 0x7f5344123610 2020-01-16T05:47:13.315 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5348ce4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5344128540 0x7f5344125ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:13.315 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5348ce4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5344128540 0x7f5344125ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35960/0 (socket says 172.21.15.84:35960) 2020-01-16T05:47:13.316 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5348ce4700 1 -- 172.21.15.84:0/1369296093 learned_addr learned my addr 172.21.15.84:0/1369296093 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:47:13.316 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f534af48700 1 --2- 172.21.15.84:0/1369296093 >> v2:172.21.15.142:3300/0 conn(0x7f5344123610 0x7f5344126540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:13.316 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5348ce4700 1 -- 172.21.15.84:0/1369296093 >> v2:172.21.15.142:3300/0 conn(0x7f5344123610 msgr2=0x7f5344126540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:13.316 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5348ce4700 1 --2- 172.21.15.84:0/1369296093 >> v2:172.21.15.142:3300/0 conn(0x7f5344123610 0x7f5344126540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:13.316 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5348ce4700 1 -- 172.21.15.84:0/1369296093 >> v1:172.21.15.142:6789/0 conn(0x7f5344123150 legacy=0x7f5344125300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:13.317 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5348ce4700 1 -- 172.21.15.84:0/1369296093 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5344127720 con 0x7f5344128540 2020-01-16T05:47:13.317 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5348ce4700 1 --2- 172.21.15.84:0/1369296093 >> v2:172.21.15.84:3300/0 conn(0x7f5344128540 0x7f5344125ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5344133940 tx=0x7f5334011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:13.317 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5348ce4700 1 --2- 172.21.15.84:0/1369296093 >> v2:172.21.15.84:3300/0 conn(0x7f5344128540 0x7f5344125ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5344133940 tx=0x7f5334011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:13.317 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5348ce4700 1 --2- 172.21.15.84:0/1369296093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5344128540 0x7f5344125ff0 secure :-1 s=READY pgs=399 cs=0 l=1 rx=0x7f5344133940 tx=0x7f5334011470).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:13.317 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5348ce4700 1 --2- 172.21.15.84:0/1369296093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5344128540 0x7f5344125ff0 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7f5344133940 tx=0x7f5334011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:13.318 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5348ce4700 1 --2- 172.21.15.84:0/1369296093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5344128540 0x7f5344125ff0 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7f5344133940 tx=0x7f5334011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:13.318 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5339ffb700 1 -- 172.21.15.84:0/1369296093 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f533400f760 con 0x7f5344128540 2020-01-16T05:47:13.318 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5348ce4700 1 --2- 172.21.15.84:0/1369296093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5344128540 0x7f5344125ff0 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7f5344133940 tx=0x7f5334011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:13.318 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5339ffb700 1 -- 172.21.15.84:0/1369296093 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5334011860 con 0x7f5344128540 2020-01-16T05:47:13.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5349ce6700 1 -- 172.21.15.84:0/1369296093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5344126a90 con 0x7f5344128540 2020-01-16T05:47:13.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5339ffb700 1 -- 172.21.15.84:0/1369296093 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53340056c0 con 0x7f5344128540 2020-01-16T05:47:13.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5349ce6700 1 -- 172.21.15.84:0/1369296093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534413d450 con 0x7f5344128540 2020-01-16T05:47:13.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5348ce4700 1 --2- 172.21.15.84:0/1369296093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5344128540 0x7f5344125ff0 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7f5344133940 tx=0x7f5334011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:13.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5339ffb700 1 -- 172.21.15.84:0/1369296093 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f53340059d0 con 0x7f5344128540 2020-01-16T05:47:13.319 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5348ce4700 1 --2- 172.21.15.84:0/1369296093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5344128540 0x7f5344125ff0 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7f5344133940 tx=0x7f5334011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:13.320 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5339ffb700 1 --2- 172.21.15.84:0/1369296093 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f532403c3e0 0x7f532403e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:13.320 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5339ffb700 1 -- 172.21.15.84:0/1369296093 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f533404cd80 con 0x7f5344128540 2020-01-16T05:47:13.320 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f53494e5700 1 --2- 172.21.15.84:0/1369296093 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f532403c3e0 0x7f532403e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:13.320 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f5349ce6700 1 -- 172.21.15.84:0/1369296093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534405e1c0 con 0x7f5344128540 2020-01-16T05:47:13.320 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.300+0000 7f53494e5700 1 --2- 172.21.15.84:0/1369296093 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f532403c3e0 0x7f532403e8f0 crc :-1 s=READY pgs=159 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:13.321 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.308+0000 7f5348ce4700 1 --2- 172.21.15.84:0/1369296093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5344128540 0x7f5344125ff0 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7f5344133940 tx=0x7f5334011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:13.321 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.308+0000 7f5339ffb700 1 -- 172.21.15.84:0/1369296093 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f53340333a0 con 0x7f5344128540 2020-01-16T05:47:13.460 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.460+0000 7f5349ce6700 1 -- 172.21.15.84:0/1369296093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f534405cbc0 con 0x7f5344128540 2020-01-16T05:47:13.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.460+0000 7f5348ce4700 1 --2- 172.21.15.84:0/1369296093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5344128540 0x7f5344125ff0 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7f5344133940 tx=0x7f5334011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:13.461 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.460+0000 7f5339ffb700 1 -- 172.21.15.84:0/1369296093 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f53340080d0 con 0x7f5344128540 2020-01-16T05:47:13.462 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:13.462 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:13.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.464+0000 7f5349ce6700 1 -- 172.21.15.84:0/1369296093 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f532403c3e0 msgr2=0x7f532403e8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:13.463 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.464+0000 7f5349ce6700 1 --2- 172.21.15.84:0/1369296093 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f532403c3e0 0x7f532403e8f0 crc :-1 s=READY pgs=159 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:13.464 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.464+0000 7f5349ce6700 1 -- 172.21.15.84:0/1369296093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5344128540 msgr2=0x7f5344125ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:13.464 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.464+0000 7f5349ce6700 1 --2- 172.21.15.84:0/1369296093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5344128540 0x7f5344125ff0 secure :-1 s=READY pgs=399 cs=0 l=1 rx=0x7f5344133940 tx=0x7f5334011470).stop 2020-01-16T05:47:13.464 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.464+0000 7f5349ce6700 1 -- 172.21.15.84:0/1369296093 shutdown_connections 2020-01-16T05:47:13.464 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.464+0000 7f5349ce6700 1 --2- 172.21.15.84:0/1369296093 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f532403c3e0 0x7f532403e8f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:13.464 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.464+0000 7f5349ce6700 1 --2- 172.21.15.84:0/1369296093 >> v2:172.21.15.142:3300/0 conn(0x7f5344123610 0x7f5344126540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:13.464 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.464+0000 7f5349ce6700 1 --2- 172.21.15.84:0/1369296093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5344128540 0x7f5344125ff0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:13.464 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.464+0000 7f5349ce6700 1 -- 172.21.15.84:0/1369296093 shutdown_connections 2020-01-16T05:47:13.465 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.464+0000 7f5349ce6700 1 -- 172.21.15.84:0/1369296093 wait complete. 2020-01-16T05:47:13.465 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:13.464+0000 7f5349ce6700 1 -- 172.21.15.84:0/1369296093 >> 172.21.15.84:0/1369296093 conn(0x7f53440a4b40 msgr2=0x7f5344066650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:13.465 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:13.475 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:14.442 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:47:14.444 INFO:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:47:15.476 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:15.599 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f7374ce4700 1 Processor -- start 2020-01-16T05:47:15.600 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f7374ce4700 1 -- start start 2020-01-16T05:47:15.600 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f7374ce4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73700a2f60 0x7f737005b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:15.600 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f7374ce4700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f73700a8ff0 0x7f737008fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:15.600 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f7374ce4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73700902d0 con 0x7f737007c560 2020-01-16T05:47:15.601 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f7374ce4700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73700a3390 con 0x7f73700a8ff0 2020-01-16T05:47:15.601 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f7374ce4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73700905b0 con 0x7f73700a2f60 2020-01-16T05:47:15.601 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736f59e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f737007c560 0x7f7370149000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53166/0 (socket says 172.21.15.84:53166) 2020-01-16T05:47:15.601 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736f59e700 1 -- 172.21.15.84:0/3803781277 learned_addr learned my addr 172.21.15.84:0/3803781277 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:15.602 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736ed9d700 1 --2- 172.21.15.84:0/3803781277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73700a2f60 0x7f737005b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:15.602 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736e59c700 1 --2- 172.21.15.84:0/3803781277 >> v2:172.21.15.142:3300/0 conn(0x7f73700a8ff0 0x7f737008fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:15.602 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736dd9b700 1 -- 172.21.15.84:0/3803781277 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231260568 0 0) 0x7f7368001450 con 0x7f737007c560 2020-01-16T05:47:15.602 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736dd9b700 1 -- 172.21.15.84:0/3803781277 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f735c003230 con 0x7f737007c560 2020-01-16T05:47:15.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736e59c700 1 -- 172.21.15.84:0/3803781277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73700a2f60 msgr2=0x7f737005b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:15.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736e59c700 1 --2- 172.21.15.84:0/3803781277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73700a2f60 0x7f737005b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:15.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736e59c700 1 -- 172.21.15.84:0/3803781277 >> v1:172.21.15.84:6789/0 conn(0x7f737007c560 legacy=0x7f7370149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:15.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736dd9b700 1 -- 172.21.15.84:0/3803781277 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3179105817 0 0) 0x7f735c003230 con 0x7f737007c560 2020-01-16T05:47:15.604 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736e59c700 1 -- 172.21.15.84:0/3803781277 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73700a9420 con 0x7f73700a8ff0 2020-01-16T05:47:15.604 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736e59c700 1 --2- 172.21.15.84:0/3803781277 >> v2:172.21.15.142:3300/0 conn(0x7f73700a8ff0 0x7f737008fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7370090770 tx=0x7f736000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:15.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736e59c700 1 --2- 172.21.15.84:0/3803781277 >> v2:172.21.15.142:3300/0 conn(0x7f73700a8ff0 0x7f737008fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7370090770 tx=0x7f736000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:15.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736e59c700 1 --2- 172.21.15.84:0/3803781277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73700a8ff0 0x7f737008fd80 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7f7370090770 tx=0x7f736000fdf0).ready entity=mon.1 client_cookie=3104543de25cc980 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:15.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736e59c700 1 --2- 172.21.15.84:0/3803781277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73700a8ff0 0x7f737008fd80 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f7370090770 tx=0x7f736000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:15.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736dd9b700 1 -- 172.21.15.84:0/3803781277 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7360011660 con 0x7f73700a8ff0 2020-01-16T05:47:15.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736e59c700 1 --2- 172.21.15.84:0/3803781277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73700a8ff0 0x7f737008fd80 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f7370090770 tx=0x7f736000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:15.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736dd9b700 1 -- 172.21.15.84:0/3803781277 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7360008c50 con 0x7f73700a8ff0 2020-01-16T05:47:15.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736e59c700 1 --2- 172.21.15.84:0/3803781277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73700a8ff0 0x7f737008fd80 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f7370090770 tx=0x7f736000fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:15.607 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f7374ce4700 1 -- 172.21.15.84:0/3803781277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73700a8ff0 msgr2=0x7f737008fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:15.607 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f736dd9b700 1 -- 172.21.15.84:0/3803781277 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7360011c40 con 0x7f73700a8ff0 2020-01-16T05:47:15.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f7374ce4700 1 --2- 172.21.15.84:0/3803781277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73700a8ff0 0x7f737008fd80 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7f7370090770 tx=0x7f736000fdf0).stop 2020-01-16T05:47:15.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f7374ce4700 1 -- 172.21.15.84:0/3803781277 shutdown_connections 2020-01-16T05:47:15.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f7374ce4700 1 --2- 172.21.15.84:0/3803781277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73700a2f60 0x7f737005b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:15.608 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f7374ce4700 1 --2- 172.21.15.84:0/3803781277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73700a8ff0 0x7f737008fd80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:15.609 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f7374ce4700 1 -- 172.21.15.84:0/3803781277 shutdown_connections 2020-01-16T05:47:15.609 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f7374ce4700 1 -- 172.21.15.84:0/3803781277 wait complete. 2020-01-16T05:47:15.609 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.596+0000 7f7374ce4700 1 -- 172.21.15.84:0/3803781277 >> 172.21.15.84:0/3803781277 conn(0x7f73700abc10 msgr2=0x7f737005a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:15.622 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f7374ce4700 1 Processor -- start 2020-01-16T05:47:15.624 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f7374ce4700 1 -- start start 2020-01-16T05:47:15.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f7374ce4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73700a1370 0x7f7370149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:15.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f7374ce4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f73700a6b40 0x7f737013a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:15.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f7374ce4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7370123ad0 con 0x7f73700a4db0 2020-01-16T05:47:15.626 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f7374ce4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7370146c70 con 0x7f73700a6b40 2020-01-16T05:47:15.627 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f7374ce4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73701256c0 con 0x7f73700a1370 2020-01-16T05:47:15.628 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f736f59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f73700a6b40 0x7f737013a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:15.628 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f736ed9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f73700a4db0 0x7f73700a6340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53174/0 (socket says 172.21.15.84:53174) 2020-01-16T05:47:15.628 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f736ed9d700 1 -- 172.21.15.84:0/2743055556 learned_addr learned my addr 172.21.15.84:0/2743055556 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:15.629 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f736e59c700 1 --2- 172.21.15.84:0/2743055556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73700a1370 0x7f7370149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f736f59e700 1 -- 172.21.15.84:0/2743055556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73700a1370 msgr2=0x7f7370149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f73677fe700 1 -- 172.21.15.84:0/2743055556 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451865152 0 0) 0x7f7370123ad0 con 0x7f73700a4db0 2020-01-16T05:47:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f736f59e700 1 --2- 172.21.15.84:0/2743055556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73700a1370 0x7f7370149680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f736f59e700 1 -- 172.21.15.84:0/2743055556 >> v1:172.21.15.84:6789/0 conn(0x7f73700a4db0 legacy=0x7f73700a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f736f59e700 1 -- 172.21.15.84:0/2743055556 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73700a17a0 con 0x7f73700a6b40 2020-01-16T05:47:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f736f59e700 1 --2- 172.21.15.84:0/2743055556 >> v2:172.21.15.84:3300/0 conn(0x7f73700a6b40 0x7f737013a640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7370125880 tx=0x7f7368010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f736f59e700 1 --2- 172.21.15.84:0/2743055556 >> v2:172.21.15.84:3300/0 conn(0x7f73700a6b40 0x7f737013a640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7370125880 tx=0x7f7368010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f736f59e700 1 --2- 172.21.15.84:0/2743055556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73700a6b40 0x7f737013a640 secure :-1 s=READY pgs=402 cs=0 l=1 rx=0x7f7370125880 tx=0x7f7368010d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f736f59e700 1 --2- 172.21.15.84:0/2743055556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73700a6b40 0x7f737013a640 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7f7370125880 tx=0x7f7368010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f73677fe700 1 -- 172.21.15.84:0/2743055556 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73680125b0 con 0x7f73700a6b40 2020-01-16T05:47:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f736f59e700 1 --2- 172.21.15.84:0/2743055556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73700a6b40 0x7f737013a640 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7f7370125880 tx=0x7f7368010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f736f59e700 1 --2- 172.21.15.84:0/2743055556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73700a6b40 0x7f737013a640 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7f7370125880 tx=0x7f7368010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:15.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f73677fe700 1 -- 172.21.15.84:0/2743055556 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7368005c60 con 0x7f73700a6b40 2020-01-16T05:47:15.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f73677fe700 1 -- 172.21.15.84:0/2743055556 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7368012b90 con 0x7f73700a6b40 2020-01-16T05:47:15.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.600+0000 7f7374ce4700 1 -- 172.21.15.84:0/2743055556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73701252d0 con 0x7f73700a6b40 2020-01-16T05:47:15.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.604+0000 7f7374ce4700 1 -- 172.21.15.84:0/2743055556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73700a0f80 con 0x7f73700a6b40 2020-01-16T05:47:15.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.604+0000 7f736f59e700 1 --2- 172.21.15.84:0/2743055556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73700a6b40 0x7f737013a640 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7f7370125880 tx=0x7f7368010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:15.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.604+0000 7f7374ce4700 1 -- 172.21.15.84:0/2743055556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f737005e1c0 con 0x7f73700a6b40 2020-01-16T05:47:15.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.604+0000 7f736f59e700 1 --2- 172.21.15.84:0/2743055556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73700a6b40 0x7f737013a640 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7f7370125880 tx=0x7f7368010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:15.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.604+0000 7f73677fe700 1 -- 172.21.15.84:0/2743055556 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f736800a320 con 0x7f73700a6b40 2020-01-16T05:47:15.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.604+0000 7f73677fe700 1 --2- 172.21.15.84:0/2743055556 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f735403c1f0 0x7f735403e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:15.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.604+0000 7f73677fe700 1 -- 172.21.15.84:0/2743055556 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f73700902d0 con 0x7f73700a6b40 2020-01-16T05:47:15.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.604+0000 7f736ed9d700 1 --2- 172.21.15.84:0/2743055556 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f735403c1f0 0x7f735403e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:15.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.604+0000 7f736ed9d700 1 --2- 172.21.15.84:0/2743055556 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f735403c1f0 0x7f735403e700 crc :-1 s=READY pgs=161 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:15.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.612+0000 7f736f59e700 1 --2- 172.21.15.84:0/2743055556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73700a6b40 0x7f737013a640 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7f7370125880 tx=0x7f7368010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:15.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.612+0000 7f73677fe700 1 -- 172.21.15.84:0/2743055556 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f7368033600 con 0x7f73700a6b40 2020-01-16T05:47:15.767 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.768+0000 7f7374ce4700 1 -- 172.21.15.84:0/2743055556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f737008f350 con 0x7f73700a6b40 2020-01-16T05:47:15.767 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.768+0000 7f736f59e700 1 --2- 172.21.15.84:0/2743055556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73700a6b40 0x7f737013a640 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7f7370125880 tx=0x7f7368010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:15.768 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.768+0000 7f73677fe700 1 -- 172.21.15.84:0/2743055556 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f7368012d90 con 0x7f73700a6b40 2020-01-16T05:47:15.768 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:15.768 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:15.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.768+0000 7f7374ce4700 1 -- 172.21.15.84:0/2743055556 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f735403c1f0 msgr2=0x7f735403e700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:15.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.768+0000 7f7374ce4700 1 --2- 172.21.15.84:0/2743055556 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f735403c1f0 0x7f735403e700 crc :-1 s=READY pgs=161 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:15.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.768+0000 7f7374ce4700 1 -- 172.21.15.84:0/2743055556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73700a6b40 msgr2=0x7f737013a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:15.770 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.768+0000 7f7374ce4700 1 --2- 172.21.15.84:0/2743055556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73700a6b40 0x7f737013a640 secure :-1 s=READY pgs=402 cs=0 l=1 rx=0x7f7370125880 tx=0x7f7368010d40).stop 2020-01-16T05:47:15.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.768+0000 7f7374ce4700 1 -- 172.21.15.84:0/2743055556 shutdown_connections 2020-01-16T05:47:15.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.768+0000 7f7374ce4700 1 --2- 172.21.15.84:0/2743055556 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f735403c1f0 0x7f735403e700 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:15.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.768+0000 7f7374ce4700 1 --2- 172.21.15.84:0/2743055556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73700a6b40 0x7f737013a640 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:15.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.768+0000 7f7374ce4700 1 --2- 172.21.15.84:0/2743055556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73700a1370 0x7f7370149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:15.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.768+0000 7f7374ce4700 1 -- 172.21.15.84:0/2743055556 shutdown_connections 2020-01-16T05:47:15.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.768+0000 7f7374ce4700 1 -- 172.21.15.84:0/2743055556 wait complete. 2020-01-16T05:47:15.771 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:15.768+0000 7f7374ce4700 1 -- 172.21.15.84:0/2743055556 >> 172.21.15.84:0/2743055556 conn(0x7f7370090880 msgr2=0x7f737009d360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:15.772 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:15.782 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:17.783 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:17.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd809ce700 1 Processor -- start 2020-01-16T05:47:17.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd809ce700 1 -- start start 2020-01-16T05:47:17.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd809ce700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcd7c0a9b30 0x7fcd7c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:17.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd809ce700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c0a4250 0x7fcd7c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:17.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd809ce700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c066dd0 con 0x7fcd7c07ff10 2020-01-16T05:47:17.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd809ce700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c0a4830 con 0x7fcd7c0a9b30 2020-01-16T05:47:17.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd809ce700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c07f9d0 con 0x7fcd7c0a4250 2020-01-16T05:47:17.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd7bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcd7c0a9b30 0x7fcd7c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:17.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd7bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcd7c0a9b30 0x7fcd7c0abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35980/0 (socket says 172.21.15.84:35980) 2020-01-16T05:47:17.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd7bfff700 1 -- 172.21.15.84:0/2130768085 learned_addr learned my addr 172.21.15.84:0/2130768085 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:47:17.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd7b7fe700 1 --1- 172.21.15.84:0/2130768085 >> v1:172.21.15.84:6789/0 conn(0x7fcd7c07ff10 0x7fcd7c0a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53182/0 (socket says 172.21.15.84:53182) 2020-01-16T05:47:17.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd81c30700 1 --2- 172.21.15.84:0/2130768085 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c0a4250 0x7fcd7c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:17.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd7bfff700 1 -- 172.21.15.84:0/2130768085 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c0a4250 msgr2=0x7fcd7c066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:17.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/2130768085 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c0a4250 0x7fcd7c066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:17.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd7bfff700 1 -- 172.21.15.84:0/2130768085 >> v1:172.21.15.84:6789/0 conn(0x7fcd7c07ff10 legacy=0x7fcd7c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:17.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd7bfff700 1 -- 172.21.15.84:0/2130768085 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c150ce0 con 0x7fcd7c0a9b30 2020-01-16T05:47:17.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd7affd700 1 -- 172.21.15.84:0/2130768085 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576052377 0 0) 0x7fcd7c066dd0 con 0x7fcd7c07ff10 2020-01-16T05:47:17.906 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/2130768085 >> v2:172.21.15.84:3300/0 conn(0x7fcd7c0a9b30 0x7fcd7c0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcd7c0a49f0 tx=0x7fcd6c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:17.907 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/2130768085 >> v2:172.21.15.84:3300/0 conn(0x7fcd7c0a9b30 0x7fcd7c0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcd7c0a49f0 tx=0x7fcd6c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:17.907 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/2130768085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7c0a9b30 0x7fcd7c0abdd0 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7fcd7c0a49f0 tx=0x7fcd6c010230).ready entity=mon.0 client_cookie=98139a307d93cb0e server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:17.907 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/2130768085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7c0a9b30 0x7fcd7c0abdd0 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7fcd7c0a49f0 tx=0x7fcd6c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:17.907 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd7affd700 1 -- 172.21.15.84:0/2130768085 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd6c00a160 con 0x7fcd7c0a9b30 2020-01-16T05:47:17.907 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/2130768085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7c0a9b30 0x7fcd7c0abdd0 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7fcd7c0a49f0 tx=0x7fcd6c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:17.907 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/2130768085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7c0a9b30 0x7fcd7c0abdd0 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7fcd7c0a49f0 tx=0x7fcd6c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:17.907 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd7affd700 1 -- 172.21.15.84:0/2130768085 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c011bb0 con 0x7fcd7c0a9b30 2020-01-16T05:47:17.908 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd7affd700 1 -- 172.21.15.84:0/2130768085 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd6c00a740 con 0x7fcd7c0a9b30 2020-01-16T05:47:17.908 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd809ce700 1 -- 172.21.15.84:0/2130768085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7c0a9b30 msgr2=0x7fcd7c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:17.908 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.900+0000 7fcd809ce700 1 --2- 172.21.15.84:0/2130768085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7c0a9b30 0x7fcd7c0abdd0 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7fcd7c0a49f0 tx=0x7fcd6c010230).stop 2020-01-16T05:47:17.908 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.904+0000 7fcd809ce700 1 -- 172.21.15.84:0/2130768085 shutdown_connections 2020-01-16T05:47:17.908 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.904+0000 7fcd809ce700 1 --2- 172.21.15.84:0/2130768085 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c0a4250 0x7fcd7c066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:17.908 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.904+0000 7fcd809ce700 1 --2- 172.21.15.84:0/2130768085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7c0a9b30 0x7fcd7c0abdd0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:17.908 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.904+0000 7fcd809ce700 1 -- 172.21.15.84:0/2130768085 shutdown_connections 2020-01-16T05:47:17.909 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.904+0000 7fcd809ce700 1 -- 172.21.15.84:0/2130768085 wait complete. 2020-01-16T05:47:17.909 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.904+0000 7fcd809ce700 1 -- 172.21.15.84:0/2130768085 >> 172.21.15.84:0/2130768085 conn(0x7fcd7c0acfc0 msgr2=0x7fcd7c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.904+0000 7fcd809ce700 1 Processor -- start 2020-01-16T05:47:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.904+0000 7fcd809ce700 1 -- start start 2020-01-16T05:47:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.904+0000 7fcd809ce700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c07c2f0 0x7fcd7c125850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.904+0000 7fcd809ce700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd7c0a5b20 0x7fcd7c1305c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.904+0000 7fcd809ce700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c0a83c0 con 0x7fcd7c125da0 2020-01-16T05:47:17.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.904+0000 7fcd809ce700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c0a7e80 con 0x7fcd7c0a5b20 2020-01-16T05:47:17.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.904+0000 7fcd809ce700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0a8120 con 0x7fcd7c07c2f0 2020-01-16T05:47:17.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.904+0000 7fcd7b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcd7c125da0 0x7fcd7c0a5320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53190/0 (socket says 172.21.15.84:53190) 2020-01-16T05:47:17.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.904+0000 7fcd7b7fe700 1 -- 172.21.15.84:0/263073154 learned_addr learned my addr 172.21.15.84:0/263073154 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:17.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.904+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/263073154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c07c2f0 0x7fcd7c125850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:17.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.904+0000 7fcd81c30700 1 --2- 172.21.15.84:0/263073154 >> v2:172.21.15.142:3300/0 conn(0x7fcd7c0a5b20 0x7fcd7c1305c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:17.920 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd78ff9700 1 -- 172.21.15.84:0/263073154 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1561184759 0 0) 0x7fcd7c0a83c0 con 0x7fcd7c125da0 2020-01-16T05:47:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd78ff9700 1 -- 172.21.15.84:0/263073154 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd60003230 con 0x7fcd7c125da0 2020-01-16T05:47:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd7bfff700 1 -- 172.21.15.84:0/263073154 >> v2:172.21.15.142:3300/0 conn(0x7fcd7c0a5b20 msgr2=0x7fcd7c1305c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/263073154 >> v2:172.21.15.142:3300/0 conn(0x7fcd7c0a5b20 0x7fcd7c1305c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd7bfff700 1 -- 172.21.15.84:0/263073154 >> v1:172.21.15.84:6789/0 conn(0x7fcd7c125da0 legacy=0x7fcd7c0a5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd7bfff700 1 -- 172.21.15.84:0/263073154 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c07d5e0 con 0x7fcd7c07c2f0 2020-01-16T05:47:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/263073154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c07c2f0 0x7fcd7c125850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcd7c0a49f0 tx=0x7fcd6c011e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/263073154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c07c2f0 0x7fcd7c125850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcd7c0a49f0 tx=0x7fcd6c011e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/263073154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c07c2f0 0x7fcd7c125850 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fcd7c0a49f0 tx=0x7fcd6c011e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/263073154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c07c2f0 0x7fcd7c125850 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fcd7c0a49f0 tx=0x7fcd6c011e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd78ff9700 1 -- 172.21.15.84:0/263073154 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd6c005a40 con 0x7fcd7c07c2f0 2020-01-16T05:47:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/263073154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c07c2f0 0x7fcd7c125850 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fcd7c0a49f0 tx=0x7fcd6c011e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd78ff9700 1 -- 172.21.15.84:0/263073154 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c00a360 con 0x7fcd7c07c2f0 2020-01-16T05:47:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/263073154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c07c2f0 0x7fcd7c125850 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fcd7c0a49f0 tx=0x7fcd6c011e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd809ce700 1 -- 172.21.15.84:0/263073154 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c0a5f50 con 0x7fcd7c07c2f0 2020-01-16T05:47:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd78ff9700 1 -- 172.21.15.84:0/263073154 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd6c007340 con 0x7fcd7c07c2f0 2020-01-16T05:47:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd809ce700 1 -- 172.21.15.84:0/263073154 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c125380 con 0x7fcd7c07c2f0 2020-01-16T05:47:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/263073154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c07c2f0 0x7fcd7c125850 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fcd7c0a49f0 tx=0x7fcd6c011e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd809ce700 1 -- 172.21.15.84:0/263073154 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c05e1c0 con 0x7fcd7c07c2f0 2020-01-16T05:47:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd78ff9700 1 -- 172.21.15.84:0/263073154 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fcd6c0075e0 con 0x7fcd7c07c2f0 2020-01-16T05:47:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/263073154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c07c2f0 0x7fcd7c125850 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fcd7c0a49f0 tx=0x7fcd6c011e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd78ff9700 1 --2- 172.21.15.84:0/263073154 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fcd6003c800 0x7fcd6003ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:17.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd78ff9700 1 -- 172.21.15.84:0/263073154 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fcd6c04d4e0 con 0x7fcd7c07c2f0 2020-01-16T05:47:17.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd7b7fe700 1 --2- 172.21.15.84:0/263073154 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fcd6003c800 0x7fcd6003ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:17.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.908+0000 7fcd7b7fe700 1 --2- 172.21.15.84:0/263073154 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fcd6003c800 0x7fcd6003ed10 crc :-1 s=READY pgs=162 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:17.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.916+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/263073154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c07c2f0 0x7fcd7c125850 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fcd7c0a49f0 tx=0x7fcd6c011e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:17.924 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:17.916+0000 7fcd78ff9700 1 -- 172.21.15.84:0/263073154 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fcd6c033ae0 con 0x7fcd7c07c2f0 2020-01-16T05:47:18.070 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:18.068+0000 7fcd809ce700 1 -- 172.21.15.84:0/263073154 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd7c05f1e0 con 0x7fcd7c07c2f0 2020-01-16T05:47:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:18.072+0000 7fcd7bfff700 1 --2- 172.21.15.84:0/263073154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c07c2f0 0x7fcd7c125850 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fcd7c0a49f0 tx=0x7fcd6c011e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:18.072+0000 7fcd78ff9700 1 -- 172.21.15.84:0/263073154 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fcd6c0078f0 con 0x7fcd7c07c2f0 2020-01-16T05:47:18.072 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:18.072 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:18.073 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:18.072+0000 7fcd809ce700 1 -- 172.21.15.84:0/263073154 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fcd6003c800 msgr2=0x7fcd6003ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:18.073 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:18.072+0000 7fcd809ce700 1 --2- 172.21.15.84:0/263073154 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fcd6003c800 0x7fcd6003ed10 crc :-1 s=READY pgs=162 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:18.073 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:18.072+0000 7fcd809ce700 1 -- 172.21.15.84:0/263073154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c07c2f0 msgr2=0x7fcd7c125850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:18.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:18.072+0000 7fcd809ce700 1 --2- 172.21.15.84:0/263073154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c07c2f0 0x7fcd7c125850 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fcd7c0a49f0 tx=0x7fcd6c011e60).stop 2020-01-16T05:47:18.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:18.072+0000 7fcd809ce700 1 -- 172.21.15.84:0/263073154 shutdown_connections 2020-01-16T05:47:18.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:18.072+0000 7fcd809ce700 1 --2- 172.21.15.84:0/263073154 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fcd6003c800 0x7fcd6003ed10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:18.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:18.072+0000 7fcd809ce700 1 --2- 172.21.15.84:0/263073154 >> v2:172.21.15.142:3300/0 conn(0x7fcd7c0a5b20 0x7fcd7c1305c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:18.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:18.072+0000 7fcd809ce700 1 --2- 172.21.15.84:0/263073154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd7c07c2f0 0x7fcd7c125850 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:18.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:18.072+0000 7fcd809ce700 1 -- 172.21.15.84:0/263073154 shutdown_connections 2020-01-16T05:47:18.074 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:18.072+0000 7fcd809ce700 1 -- 172.21.15.84:0/263073154 wait complete. 2020-01-16T05:47:18.075 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:18.072+0000 7fcd809ce700 1 -- 172.21.15.84:0/263073154 >> 172.21.15.84:0/263073154 conn(0x7fcd7c0a6430 msgr2=0x7fcd7c0a3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:18.075 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:18.085 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:18.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~171s 2020-01-16T05:47:20.086 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:20.211 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.204+0000 7fa430c8f700 1 Processor -- start 2020-01-16T05:47:20.211 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.204+0000 7fa430c8f700 1 -- start start 2020-01-16T05:47:20.211 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa430c8f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa42c07ff10 0x7fa42c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:20.211 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa430c8f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa42c0a4250 0x7fa42c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:20.212 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa430c8f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c066dd0 con 0x7fa42c0a9b30 2020-01-16T05:47:20.212 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa430c8f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0a4830 con 0x7fa42c0a4250 2020-01-16T05:47:20.212 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa430c8f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c07f9d0 con 0x7fa42c07ff10 2020-01-16T05:47:20.212 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa42bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa42c0a9b30 0x7fa42c0a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53200/0 (socket says 172.21.15.84:53200) 2020-01-16T05:47:20.212 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa42bfff700 1 -- 172.21.15.84:0/568249073 learned_addr learned my addr 172.21.15.84:0/568249073 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:20.212 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa4237fe700 1 --2- 172.21.15.84:0/568249073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa42c07ff10 0x7fa42c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:20.212 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa431ef1700 1 --2- 172.21.15.84:0/568249073 >> v2:172.21.15.142:3300/0 conn(0x7fa42c0a4250 0x7fa42c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa42b7fe700 1 -- 172.21.15.84:0/568249073 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427870181 0 0) 0x7fa42c066dd0 con 0x7fa42c0a9b30 2020-01-16T05:47:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa42b7fe700 1 -- 172.21.15.84:0/568249073 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa418003230 con 0x7fa42c0a9b30 2020-01-16T05:47:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa4237fe700 1 -- 172.21.15.84:0/568249073 >> v2:172.21.15.142:3300/0 conn(0x7fa42c0a4250 msgr2=0x7fa42c066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa4237fe700 1 --2- 172.21.15.84:0/568249073 >> v2:172.21.15.142:3300/0 conn(0x7fa42c0a4250 0x7fa42c066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa4237fe700 1 -- 172.21.15.84:0/568249073 >> v1:172.21.15.84:6789/0 conn(0x7fa42c0a9b30 legacy=0x7fa42c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa42b7fe700 1 -- 172.21.15.84:0/568249073 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3625173435 0 0) 0x7fa418003230 con 0x7fa42c0a9b30 2020-01-16T05:47:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa4237fe700 1 -- 172.21.15.84:0/568249073 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c150ce0 con 0x7fa42c07ff10 2020-01-16T05:47:20.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa4237fe700 1 --2- 172.21.15.84:0/568249073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa42c07ff10 0x7fa42c0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa414008910 tx=0x7fa41c0014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:20.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa4237fe700 1 --2- 172.21.15.84:0/568249073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa42c07ff10 0x7fa42c0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa414008910 tx=0x7fa41c0014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:20.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa4237fe700 1 --2- 172.21.15.84:0/568249073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa42c07ff10 0x7fa42c0abdd0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fa414008910 tx=0x7fa41c0014a0).ready entity=mon.2 client_cookie=7dbc1e3b1bdaf8eb server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:20.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa4237fe700 1 --2- 172.21.15.84:0/568249073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa42c07ff10 0x7fa42c0abdd0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fa414008910 tx=0x7fa41c0014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:20.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa42b7fe700 1 -- 172.21.15.84:0/568249073 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa41c001750 con 0x7fa42c07ff10 2020-01-16T05:47:20.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa4237fe700 1 --2- 172.21.15.84:0/568249073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa42c07ff10 0x7fa42c0abdd0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fa414008910 tx=0x7fa41c0014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:20.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa4237fe700 1 --2- 172.21.15.84:0/568249073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa42c07ff10 0x7fa42c0abdd0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fa414008910 tx=0x7fa41c0014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:20.215 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa42b7fe700 1 -- 172.21.15.84:0/568249073 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41c001560 con 0x7fa42c07ff10 2020-01-16T05:47:20.215 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa42b7fe700 1 -- 172.21.15.84:0/568249073 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa414011750 con 0x7fa42c07ff10 2020-01-16T05:47:20.215 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa430c8f700 1 -- 172.21.15.84:0/568249073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa42c07ff10 msgr2=0x7fa42c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:20.215 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa430c8f700 1 --2- 172.21.15.84:0/568249073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa42c07ff10 0x7fa42c0abdd0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fa414008910 tx=0x7fa41c0014a0).stop 2020-01-16T05:47:20.216 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa430c8f700 1 -- 172.21.15.84:0/568249073 shutdown_connections 2020-01-16T05:47:20.216 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa430c8f700 1 --2- 172.21.15.84:0/568249073 >> v2:172.21.15.142:3300/0 conn(0x7fa42c0a4250 0x7fa42c066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:20.216 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa430c8f700 1 --2- 172.21.15.84:0/568249073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa42c07ff10 0x7fa42c0abdd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:20.216 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa430c8f700 1 -- 172.21.15.84:0/568249073 shutdown_connections 2020-01-16T05:47:20.216 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa430c8f700 1 -- 172.21.15.84:0/568249073 wait complete. 2020-01-16T05:47:20.216 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.208+0000 7fa430c8f700 1 -- 172.21.15.84:0/568249073 >> 172.21.15.84:0/568249073 conn(0x7fa42c0acfc0 msgr2=0x7fa42c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:20.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.212+0000 7fa430c8f700 1 Processor -- start 2020-01-16T05:47:20.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.212+0000 7fa430c8f700 1 -- start start 2020-01-16T05:47:20.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.212+0000 7fa430c8f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa42c0a40f0 0x7fa42c07e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:20.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.212+0000 7fa430c8f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa42c134de0 0x7fa42c0a8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:20.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.212+0000 7fa430c8f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c0a90a0 con 0x7fa42c1349b0 2020-01-16T05:47:20.220 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.212+0000 7fa430c8f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0a0700 con 0x7fa42c0a40f0 2020-01-16T05:47:20.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.212+0000 7fa430c8f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0a09a0 con 0x7fa42c134de0 2020-01-16T05:47:20.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa42bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa42c0a40f0 0x7fa42c07e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:20.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa42bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa42c0a40f0 0x7fa42c07e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36006/0 (socket says 172.21.15.84:36006) 2020-01-16T05:47:20.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa42bfff700 1 -- 172.21.15.84:0/1196393479 learned_addr learned my addr 172.21.15.84:0/1196393479 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:47:20.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa431ef1700 1 --2- 172.21.15.84:0/1196393479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa42c134de0 0x7fa42c0a8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:20.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa42bfff700 1 -- 172.21.15.84:0/1196393479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa42c134de0 msgr2=0x7fa42c0a8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:20.221 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa42bfff700 1 --2- 172.21.15.84:0/1196393479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa42c134de0 0x7fa42c0a8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:20.222 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa42bfff700 1 -- 172.21.15.84:0/1196393479 >> v1:172.21.15.142:6789/0 conn(0x7fa42c1349b0 legacy=0x7fa42c0a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:20.222 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa42bfff700 1 -- 172.21.15.84:0/1196393479 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c07e5e0 con 0x7fa42c0a40f0 2020-01-16T05:47:20.222 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa42bfff700 1 --2- 172.21.15.84:0/1196393479 >> v2:172.21.15.84:3300/0 conn(0x7fa42c0a40f0 0x7fa42c07e090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa42c0a08c0 tx=0x7fa41c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:20.222 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa42bfff700 1 --2- 172.21.15.84:0/1196393479 >> v2:172.21.15.84:3300/0 conn(0x7fa42c0a40f0 0x7fa42c07e090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa42c0a08c0 tx=0x7fa41c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:20.222 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa42bfff700 1 --2- 172.21.15.84:0/1196393479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa42c0a40f0 0x7fa42c07e090 secure :-1 s=READY pgs=409 cs=0 l=1 rx=0x7fa42c0a08c0 tx=0x7fa41c010c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:20.222 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa42bfff700 1 --2- 172.21.15.84:0/1196393479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa42c0a40f0 0x7fa42c07e090 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fa42c0a08c0 tx=0x7fa41c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:20.222 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa42bfff700 1 --2- 172.21.15.84:0/1196393479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa42c0a40f0 0x7fa42c07e090 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fa42c0a08c0 tx=0x7fa41c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:20.223 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa4297fa700 1 -- 172.21.15.84:0/1196393479 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa41c00cd10 con 0x7fa42c0a40f0 2020-01-16T05:47:20.223 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa42bfff700 1 --2- 172.21.15.84:0/1196393479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa42c0a40f0 0x7fa42c07e090 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fa42c0a08c0 tx=0x7fa41c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:20.223 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa4297fa700 1 -- 172.21.15.84:0/1196393479 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41c00c930 con 0x7fa42c0a40f0 2020-01-16T05:47:20.223 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa430c8f700 1 -- 172.21.15.84:0/1196393479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c0a03c0 con 0x7fa42c0a40f0 2020-01-16T05:47:20.223 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa4297fa700 1 -- 172.21.15.84:0/1196393479 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa41c004990 con 0x7fa42c0a40f0 2020-01-16T05:47:20.223 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa430c8f700 1 -- 172.21.15.84:0/1196393479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c090cc0 con 0x7fa42c0a40f0 2020-01-16T05:47:20.223 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa42bfff700 1 --2- 172.21.15.84:0/1196393479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa42c0a40f0 0x7fa42c07e090 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fa42c0a08c0 tx=0x7fa41c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:20.223 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa430c8f700 1 -- 172.21.15.84:0/1196393479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c05e1c0 con 0x7fa42c0a40f0 2020-01-16T05:47:20.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa4297fa700 1 -- 172.21.15.84:0/1196393479 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fa41c004ca0 con 0x7fa42c0a40f0 2020-01-16T05:47:20.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa42bfff700 1 --2- 172.21.15.84:0/1196393479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa42c0a40f0 0x7fa42c07e090 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fa42c0a08c0 tx=0x7fa41c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:20.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa4297fa700 1 --2- 172.21.15.84:0/1196393479 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa41003c2a0 0x7fa41003e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:20.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa4297fa700 1 -- 172.21.15.84:0/1196393479 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fa41c04ca30 con 0x7fa42c0a40f0 2020-01-16T05:47:20.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.216+0000 7fa4237fe700 1 --2- 172.21.15.84:0/1196393479 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa41003c2a0 0x7fa41003e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:20.224 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.220+0000 7fa4237fe700 1 --2- 172.21.15.84:0/1196393479 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa41003c2a0 0x7fa41003e7b0 crc :-1 s=READY pgs=163 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:20.225 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.220+0000 7fa42bfff700 1 --2- 172.21.15.84:0/1196393479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa42c0a40f0 0x7fa42c07e090 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fa42c0a08c0 tx=0x7fa41c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:20.225 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.220+0000 7fa4297fa700 1 -- 172.21.15.84:0/1196393479 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fa41c013060 con 0x7fa42c0a40f0 2020-01-16T05:47:20.375 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.376+0000 7fa430c8f700 1 -- 172.21.15.84:0/1196393479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa42c07f370 con 0x7fa42c0a40f0 2020-01-16T05:47:20.376 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.376+0000 7fa42bfff700 1 --2- 172.21.15.84:0/1196393479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa42c0a40f0 0x7fa42c07e090 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fa42c0a08c0 tx=0x7fa41c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:20.376 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.376+0000 7fa4297fa700 1 -- 172.21.15.84:0/1196393479 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fa41c033050 con 0x7fa42c0a40f0 2020-01-16T05:47:20.376 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:20.376 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:20.378 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.376+0000 7fa430c8f700 1 -- 172.21.15.84:0/1196393479 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa41003c2a0 msgr2=0x7fa41003e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:20.378 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.376+0000 7fa430c8f700 1 --2- 172.21.15.84:0/1196393479 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa41003c2a0 0x7fa41003e7b0 crc :-1 s=READY pgs=163 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:20.378 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.376+0000 7fa430c8f700 1 -- 172.21.15.84:0/1196393479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa42c0a40f0 msgr2=0x7fa42c07e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:20.378 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.376+0000 7fa430c8f700 1 --2- 172.21.15.84:0/1196393479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa42c0a40f0 0x7fa42c07e090 secure :-1 s=READY pgs=409 cs=0 l=1 rx=0x7fa42c0a08c0 tx=0x7fa41c010c10).stop 2020-01-16T05:47:20.378 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.376+0000 7fa430c8f700 1 -- 172.21.15.84:0/1196393479 shutdown_connections 2020-01-16T05:47:20.378 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.376+0000 7fa430c8f700 1 --2- 172.21.15.84:0/1196393479 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa41003c2a0 0x7fa41003e7b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.376+0000 7fa430c8f700 1 --2- 172.21.15.84:0/1196393479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa42c134de0 0x7fa42c0a8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.376+0000 7fa430c8f700 1 --2- 172.21.15.84:0/1196393479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa42c0a40f0 0x7fa42c07e090 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.376+0000 7fa430c8f700 1 -- 172.21.15.84:0/1196393479 shutdown_connections 2020-01-16T05:47:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.376+0000 7fa430c8f700 1 -- 172.21.15.84:0/1196393479 wait complete. 2020-01-16T05:47:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:20.376+0000 7fa430c8f700 1 -- 172.21.15.84:0/1196393479 >> 172.21.15.84:0/1196393479 conn(0x7fa42c0a92e0 msgr2=0x7fa42c0a4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:20.389 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:22.390 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:22.524 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5bb537d700 1 Processor -- start 2020-01-16T05:47:22.525 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5bb537d700 1 -- start start 2020-01-16T05:47:22.525 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5bb537d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb007ff10 0x7f5bb00abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:22.525 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5bb537d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb0066880 con 0x7f5bb00a4250 2020-01-16T05:47:22.525 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5bb537d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb0066ab0 con 0x7f5bb00a9b30 2020-01-16T05:47:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5bb537d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb00a4830 con 0x7f5bb007ff10 2020-01-16T05:47:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5bb65df700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5bb00a4250 0x7f5bb014fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53220/0 (socket says 172.21.15.84:53220) 2020-01-16T05:47:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5bb65df700 1 -- 172.21.15.84:0/503038367 learned_addr learned my addr 172.21.15.84:0/503038367 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baffff700 1 --2- 172.21.15.84:0/503038367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb007ff10 0x7f5bb00abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baf7fe700 1 -- 172.21.15.84:0/503038367 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759135554 0 0) 0x7f5bb0066880 con 0x7f5bb00a4250 2020-01-16T05:47:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baf7fe700 1 -- 172.21.15.84:0/503038367 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b9c003230 con 0x7f5bb00a4250 2020-01-16T05:47:22.526 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baf7fe700 1 -- 172.21.15.84:0/503038367 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1769571990 0 0) 0x7f5b9c003230 con 0x7f5bb00a4250 2020-01-16T05:47:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baf7fe700 1 -- 172.21.15.84:0/503038367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb007ff10 msgr2=0x7f5bb00abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baf7fe700 1 --2- 172.21.15.84:0/503038367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb007ff10 0x7f5bb00abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baf7fe700 1 -- 172.21.15.84:0/503038367 >> v1:172.21.15.142:6789/0 conn(0x7f5bb00a9b30 legacy=0x7f5bb00a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baf7fe700 1 -- 172.21.15.84:0/503038367 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb0066ce0 con 0x7f5bb00a4250 2020-01-16T05:47:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baf7fe700 1 -- 172.21.15.84:0/503038367 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f5ba8001ad0 con 0x7f5bb00a4250 2020-01-16T05:47:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baffff700 1 --2- 172.21.15.84:0/503038367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb007ff10 0x7f5bb00abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:47:22.527 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baf7fe700 1 -- 172.21.15.84:0/503038367 >> v1:172.21.15.84:6789/0 conn(0x7f5bb00a4250 legacy=0x7f5bb014fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:22.528 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baf7fe700 1 --2- 172.21.15.84:0/503038367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b9c003890 0x7f5b9c003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:22.528 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baf7fe700 1 --2- 172.21.15.84:0/503038367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b9c0045a0 0x7f5b9c0049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:22.528 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baf7fe700 1 --2- 172.21.15.84:0/503038367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b9c004f20 0x7f5b9c00b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:22.528 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baffff700 1 --2- 172.21.15.84:0/503038367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b9c0045a0 0x7f5b9c0049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:22.528 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baf7fe700 1 -- 172.21.15.84:0/503038367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb00a4830 con 0x7f5b9c0045a0 2020-01-16T05:47:22.529 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baf7fe700 1 -- 172.21.15.84:0/503038367 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c04fd50 con 0x7f5b9c004f20 2020-01-16T05:47:22.529 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baf7fe700 1 -- 172.21.15.84:0/503038367 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c04ff10 con 0x7f5b9c003890 2020-01-16T05:47:22.529 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5bb65df700 1 --2- 172.21.15.84:0/503038367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b9c004f20 0x7f5b9c00b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:22.529 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5bb4b7c700 1 --2- 172.21.15.84:0/503038367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b9c003890 0x7f5b9c003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:22.529 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baffff700 1 -- 172.21.15.84:0/503038367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b9c003890 msgr2=0x7f5b9c003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:22.530 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baffff700 1 --2- 172.21.15.84:0/503038367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b9c003890 0x7f5b9c003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:22.530 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baffff700 1 -- 172.21.15.84:0/503038367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b9c004f20 msgr2=0x7f5b9c00b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:22.530 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baffff700 1 --2- 172.21.15.84:0/503038367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b9c004f20 0x7f5b9c00b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:22.530 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baffff700 1 -- 172.21.15.84:0/503038367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9c050130 con 0x7f5b9c0045a0 2020-01-16T05:47:22.530 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baffff700 1 --2- 172.21.15.84:0/503038367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b9c0045a0 0x7f5b9c0049d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5ba0002f30 tx=0x7f5ba000c050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:22.530 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baffff700 1 --2- 172.21.15.84:0/503038367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b9c0045a0 0x7f5b9c0049d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5ba0002f30 tx=0x7f5ba000c050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:22.530 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baffff700 1 --2- 172.21.15.84:0/503038367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b9c0045a0 0x7f5b9c0049d0 secure :-1 s=READY pgs=411 cs=0 l=1 rx=0x7f5ba0002f30 tx=0x7f5ba000c050).ready entity=mon.0 client_cookie=c2564554d26d9fc1 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:22.531 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baffff700 1 --2- 172.21.15.84:0/503038367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b9c0045a0 0x7f5b9c0049d0 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f5ba0002f30 tx=0x7f5ba000c050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:22.531 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baf7fe700 1 -- 172.21.15.84:0/503038367 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ba0007350 con 0x7f5b9c0045a0 2020-01-16T05:47:22.531 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baffff700 1 --2- 172.21.15.84:0/503038367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b9c0045a0 0x7f5b9c0049d0 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f5ba0002f30 tx=0x7f5ba000c050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:22.531 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baffff700 1 --2- 172.21.15.84:0/503038367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b9c0045a0 0x7f5b9c0049d0 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f5ba0002f30 tx=0x7f5ba000c050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:22.531 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baf7fe700 1 -- 172.21.15.84:0/503038367 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba0011c60 con 0x7f5b9c0045a0 2020-01-16T05:47:22.531 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5baf7fe700 1 -- 172.21.15.84:0/503038367 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ba00058b0 con 0x7f5b9c0045a0 2020-01-16T05:47:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5bb537d700 1 -- 172.21.15.84:0/503038367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b9c0045a0 msgr2=0x7f5b9c0049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5bb537d700 1 --2- 172.21.15.84:0/503038367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b9c0045a0 0x7f5b9c0049d0 secure :-1 s=READY pgs=411 cs=0 l=1 rx=0x7f5ba0002f30 tx=0x7f5ba000c050).stop 2020-01-16T05:47:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.512+0000 7f5bb65df700 1 -- 172.21.15.84:0/503038367 reap_dead start 2020-01-16T05:47:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.516+0000 7f5bb537d700 1 -- 172.21.15.84:0/503038367 shutdown_connections 2020-01-16T05:47:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.516+0000 7f5bb537d700 1 -- 172.21.15.84:0/503038367 shutdown_connections 2020-01-16T05:47:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.516+0000 7f5bb537d700 1 -- 172.21.15.84:0/503038367 wait complete. 2020-01-16T05:47:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.516+0000 7f5bb537d700 1 -- 172.21.15.84:0/503038367 >> 172.21.15.84:0/503038367 conn(0x7f5bb00acfc0 msgr2=0x7f5bb00a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:22.532 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.516+0000 7f5bb537d700 1 Processor -- start 2020-01-16T05:47:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.516+0000 7f5bb537d700 1 -- start start 2020-01-16T05:47:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.516+0000 7f5bb537d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5bb008f420 0x7f5bb009f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.516+0000 7f5bb537d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb00911b0 0x7f5bb009f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.516+0000 7f5bb537d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb00a6d50 con 0x7f5bb01263b0 2020-01-16T05:47:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.516+0000 7f5bb537d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb008f930 con 0x7f5bb008f420 2020-01-16T05:47:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.516+0000 7f5bb537d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb0090470 con 0x7f5bb00911b0 2020-01-16T05:47:22.533 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb4b7c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5bb008f420 0x7f5bb009f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:22.534 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb4b7c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5bb008f420 0x7f5bb009f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36030/0 (socket says 172.21.15.84:36030) 2020-01-16T05:47:22.534 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb4b7c700 1 -- 172.21.15.84:0/3610894420 learned_addr learned my addr 172.21.15.84:0/3610894420 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:47:22.534 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb65df700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb00911b0 0x7f5bb009f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:22.534 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bad7fa700 1 -- 172.21.15.84:0/3610894420 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600514935 0 0) 0x7f5bb00a6d50 con 0x7f5bb01263b0 2020-01-16T05:47:22.534 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bad7fa700 1 -- 172.21.15.84:0/3610894420 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b94003230 con 0x7f5bb01263b0 2020-01-16T05:47:22.534 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb4b7c700 1 -- 172.21.15.84:0/3610894420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb00911b0 msgr2=0x7f5bb009f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:22.534 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb4b7c700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb00911b0 0x7f5bb009f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:22.535 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb4b7c700 1 -- 172.21.15.84:0/3610894420 >> v1:172.21.15.142:6789/0 conn(0x7f5bb01263b0 legacy=0x7f5bb00909b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:22.535 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb4b7c700 1 -- 172.21.15.84:0/3610894420 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb00a8d70 con 0x7f5bb008f420 2020-01-16T05:47:22.535 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb65df700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb00911b0 0x7f5bb009f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:47:22.535 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb4b7c700 1 --2- 172.21.15.84:0/3610894420 >> v2:172.21.15.84:3300/0 conn(0x7f5bb008f420 0x7f5bb009f1b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5b98000fe0 tx=0x7f5b98010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:22.535 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb4b7c700 1 --2- 172.21.15.84:0/3610894420 >> v2:172.21.15.84:3300/0 conn(0x7f5bb008f420 0x7f5bb009f1b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5b98000fe0 tx=0x7f5b98010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:22.536 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb4b7c700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb008f420 0x7f5bb009f1b0 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7f5b98000fe0 tx=0x7f5b98010c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:22.536 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb4b7c700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb008f420 0x7f5bb009f1b0 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f5b98000fe0 tx=0x7f5b98010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:22.536 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bad7fa700 1 -- 172.21.15.84:0/3610894420 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b98012700 con 0x7f5bb008f420 2020-01-16T05:47:22.536 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb4b7c700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb008f420 0x7f5bb009f1b0 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f5b98000fe0 tx=0x7f5b98010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:22.536 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb537d700 1 -- 172.21.15.84:0/3610894420 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb00a84f0 con 0x7f5bb008f420 2020-01-16T05:47:22.536 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bad7fa700 1 -- 172.21.15.84:0/3610894420 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b98012320 con 0x7f5bb008f420 2020-01-16T05:47:22.536 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb4b7c700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb008f420 0x7f5bb009f1b0 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f5b98000fe0 tx=0x7f5b98010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:22.536 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bad7fa700 1 -- 172.21.15.84:0/3610894420 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b98012ce0 con 0x7f5bb008f420 2020-01-16T05:47:22.537 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb537d700 1 -- 172.21.15.84:0/3610894420 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb00a4ad0 con 0x7f5bb008f420 2020-01-16T05:47:22.537 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb4b7c700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb008f420 0x7f5bb009f1b0 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f5b98000fe0 tx=0x7f5b98010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:22.537 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bad7fa700 1 -- 172.21.15.84:0/3610894420 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f5b980064e0 con 0x7f5bb008f420 2020-01-16T05:47:22.537 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb4b7c700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb008f420 0x7f5bb009f1b0 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f5b98000fe0 tx=0x7f5b98010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:22.537 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bad7fa700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5b9403c760 0x7f5b9403ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:22.537 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bad7fa700 1 -- 172.21.15.84:0/3610894420 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f5b9804ca90 con 0x7f5bb008f420 2020-01-16T05:47:22.537 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5bb537d700 1 -- 172.21.15.84:0/3610894420 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb005e1c0 con 0x7f5bb008f420 2020-01-16T05:47:22.538 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5baffff700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5b9403c760 0x7f5b9403ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:22.538 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.520+0000 7f5baffff700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5b9403c760 0x7f5b9403ec70 crc :-1 s=READY pgs=164 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:22.539 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.528+0000 7f5bb4b7c700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb008f420 0x7f5bb009f1b0 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f5b98000fe0 tx=0x7f5b98010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:22.539 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.528+0000 7f5bad7fa700 1 -- 172.21.15.84:0/3610894420 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f5b98033090 con 0x7f5bb008f420 2020-01-16T05:47:22.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.672+0000 7f5bb537d700 1 -- 172.21.15.84:0/3610894420 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5bb005cbc0 con 0x7f5bb008f420 2020-01-16T05:47:22.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.672+0000 7f5bb4b7c700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb008f420 0x7f5bb009f1b0 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f5b98000fe0 tx=0x7f5b98010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:22.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.672+0000 7f5bad7fa700 1 -- 172.21.15.84:0/3610894420 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f5b980332f0 con 0x7f5bb008f420 2020-01-16T05:47:22.675 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:22.675 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:22.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.676+0000 7f5bb537d700 1 -- 172.21.15.84:0/3610894420 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5b9403c760 msgr2=0x7f5b9403ec70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:22.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.676+0000 7f5bb537d700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5b9403c760 0x7f5b9403ec70 crc :-1 s=READY pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:22.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.676+0000 7f5bb537d700 1 -- 172.21.15.84:0/3610894420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb008f420 msgr2=0x7f5bb009f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:22.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.676+0000 7f5bb537d700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb008f420 0x7f5bb009f1b0 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7f5b98000fe0 tx=0x7f5b98010c70).stop 2020-01-16T05:47:22.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.676+0000 7f5bb537d700 1 -- 172.21.15.84:0/3610894420 shutdown_connections 2020-01-16T05:47:22.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.676+0000 7f5bb537d700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5b9403c760 0x7f5b9403ec70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:22.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.676+0000 7f5bb537d700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb00911b0 0x7f5bb009f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:22.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.676+0000 7f5bb537d700 1 --2- 172.21.15.84:0/3610894420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb008f420 0x7f5bb009f1b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:22.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.676+0000 7f5bb537d700 1 -- 172.21.15.84:0/3610894420 shutdown_connections 2020-01-16T05:47:22.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.676+0000 7f5bb537d700 1 -- 172.21.15.84:0/3610894420 wait complete. 2020-01-16T05:47:22.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:22.676+0000 7f5bb537d700 1 -- 172.21.15.84:0/3610894420 >> 172.21.15.84:0/3610894420 conn(0x7f5bb00a9b30 msgr2=0x7f5bb007dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:22.678 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:22.688 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:47:24.689 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:24.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1de512b700 1 Processor -- start 2020-01-16T05:47:24.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1de512b700 1 -- start start 2020-01-16T05:47:24.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1de512b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1de007ff10 0x7f1de00abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:24.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1de512b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de00a4250 0x7f1de0066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:24.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1de512b700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de0066dd0 con 0x7f1de00a9b30 2020-01-16T05:47:24.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1de512b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de00a4830 con 0x7f1de007ff10 2020-01-16T05:47:24.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1de512b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de007f9d0 con 0x7f1de00a4250 2020-01-16T05:47:24.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1de638d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de00a4250 0x7f1de0066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:24.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1de492a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1de00a9b30 0x7f1de00a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:51466/0 (socket says 172.21.15.84:51466) 2020-01-16T05:47:24.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1ddffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1de007ff10 0x7f1de00abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:24.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1de492a700 1 -- 172.21.15.84:0/2558169591 learned_addr learned my addr 172.21.15.84:0/2558169591 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:24.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1ddffff700 1 -- 172.21.15.84:0/2558169591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de00a4250 msgr2=0x7f1de0066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:24.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1ddffff700 1 --2- 172.21.15.84:0/2558169591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de00a4250 0x7f1de0066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:24.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1ddffff700 1 -- 172.21.15.84:0/2558169591 >> v1:172.21.15.142:6789/0 conn(0x7f1de00a9b30 legacy=0x7f1de00a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:24.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1ddf7fe700 1 -- 172.21.15.84:0/2558169591 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667964332 0 0) 0x7f1de0066dd0 con 0x7f1de00a9b30 2020-01-16T05:47:24.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1ddffff700 1 -- 172.21.15.84:0/2558169591 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de0150ce0 con 0x7f1de007ff10 2020-01-16T05:47:24.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1de638d700 1 --2- 172.21.15.84:0/2558169591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de00a4250 0x7f1de0066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:47:24.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1ddffff700 1 --2- 172.21.15.84:0/2558169591 >> v2:172.21.15.142:3300/0 conn(0x7f1de007ff10 0x7f1de00abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1de00a49f0 tx=0x7f1dd400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:24.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1ddffff700 1 --2- 172.21.15.84:0/2558169591 >> v2:172.21.15.142:3300/0 conn(0x7f1de007ff10 0x7f1de00abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1de00a49f0 tx=0x7f1dd400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:24.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1ddffff700 1 --2- 172.21.15.84:0/2558169591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de007ff10 0x7f1de00abdd0 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7f1de00a49f0 tx=0x7f1dd400fdf0).ready entity=mon.1 client_cookie=41ddf6c79f8eab server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:24.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1ddffff700 1 --2- 172.21.15.84:0/2558169591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de007ff10 0x7f1de00abdd0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f1de00a49f0 tx=0x7f1dd400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:24.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1ddf7fe700 1 -- 172.21.15.84:0/2558169591 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dd4011660 con 0x7f1de007ff10 2020-01-16T05:47:24.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1ddffff700 1 --2- 172.21.15.84:0/2558169591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de007ff10 0x7f1de00abdd0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f1de00a49f0 tx=0x7f1dd400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:24.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1ddf7fe700 1 -- 172.21.15.84:0/2558169591 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd4008c50 con 0x7f1de007ff10 2020-01-16T05:47:24.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1ddffff700 1 --2- 172.21.15.84:0/2558169591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de007ff10 0x7f1de00abdd0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f1de00a49f0 tx=0x7f1dd400fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:24.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1de512b700 1 -- 172.21.15.84:0/2558169591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de007ff10 msgr2=0x7f1de00abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:24.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1ddf7fe700 1 -- 172.21.15.84:0/2558169591 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dd4011c40 con 0x7f1de007ff10 2020-01-16T05:47:24.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.808+0000 7f1de512b700 1 --2- 172.21.15.84:0/2558169591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de007ff10 0x7f1de00abdd0 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7f1de00a49f0 tx=0x7f1dd400fdf0).stop 2020-01-16T05:47:24.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.812+0000 7f1de512b700 1 -- 172.21.15.84:0/2558169591 shutdown_connections 2020-01-16T05:47:24.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.812+0000 7f1de512b700 1 --2- 172.21.15.84:0/2558169591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de00a4250 0x7f1de0066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:24.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.812+0000 7f1de512b700 1 --2- 172.21.15.84:0/2558169591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de007ff10 0x7f1de00abdd0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:24.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.812+0000 7f1de512b700 1 -- 172.21.15.84:0/2558169591 shutdown_connections 2020-01-16T05:47:24.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.812+0000 7f1de512b700 1 -- 172.21.15.84:0/2558169591 wait complete. 2020-01-16T05:47:24.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.812+0000 7f1de512b700 1 -- 172.21.15.84:0/2558169591 >> 172.21.15.84:0/2558169591 conn(0x7f1de00acfc0 msgr2=0x7f1de00a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:24.820 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.812+0000 7f1de512b700 1 Processor -- start 2020-01-16T05:47:24.820 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.812+0000 7f1de512b700 1 -- start start 2020-01-16T05:47:24.820 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1de512b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1de01262a0 0x7f1de00a8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:24.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1de512b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de0066340 con 0x7f1de00a9170 2020-01-16T05:47:24.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1de512b700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de00a6f40 con 0x7f1de013a0d0 2020-01-16T05:47:24.822 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1de512b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de00a8c60 con 0x7f1de01262a0 2020-01-16T05:47:24.822 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1de01262a0 0x7f1de00a8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:24.822 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1de492a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1de00a9170 0x7f1de009f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53244/0 (socket says 172.21.15.84:53244) 2020-01-16T05:47:24.822 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1de492a700 1 -- 172.21.15.84:0/1129320280 learned_addr learned my addr 172.21.15.84:0/1129320280 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:24.822 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddd7fa700 1 -- 172.21.15.84:0/1129320280 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759578051 0 0) 0x7f1de0066340 con 0x7f1de00a9170 2020-01-16T05:47:24.822 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddd7fa700 1 -- 172.21.15.84:0/1129320280 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dc0003230 con 0x7f1de00a9170 2020-01-16T05:47:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddd7fa700 1 -- 172.21.15.84:0/1129320280 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1417548636 0 0) 0x7f1de00a6f40 con 0x7f1de013a0d0 2020-01-16T05:47:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddffff700 1 -- 172.21.15.84:0/1129320280 >> v1:172.21.15.142:6789/0 conn(0x7f1de013a0d0 legacy=0x7f1de013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddffff700 1 -- 172.21.15.84:0/1129320280 >> v1:172.21.15.84:6789/0 conn(0x7f1de00a9170 legacy=0x7f1de009f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddffff700 1 -- 172.21.15.84:0/1129320280 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de00ab090 con 0x7f1de01262a0 2020-01-16T05:47:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddffff700 1 --2- 172.21.15.84:0/1129320280 >> v2:172.21.15.84:3300/0 conn(0x7f1de01262a0 0x7f1de00a8710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1de00a49f0 tx=0x7f1dd4008ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddffff700 1 --2- 172.21.15.84:0/1129320280 >> v2:172.21.15.84:3300/0 conn(0x7f1de01262a0 0x7f1de00a8710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1de00a49f0 tx=0x7f1dd4008ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddffff700 1 --2- 172.21.15.84:0/1129320280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de01262a0 0x7f1de00a8710 secure :-1 s=READY pgs=414 cs=0 l=1 rx=0x7f1de00a49f0 tx=0x7f1dd4008ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddffff700 1 --2- 172.21.15.84:0/1129320280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de01262a0 0x7f1de00a8710 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f1de00a49f0 tx=0x7f1dd4008ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddd7fa700 1 -- 172.21.15.84:0/1129320280 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dd4007340 con 0x7f1de01262a0 2020-01-16T05:47:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddffff700 1 --2- 172.21.15.84:0/1129320280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de01262a0 0x7f1de00a8710 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f1de00a49f0 tx=0x7f1dd4008ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1de512b700 1 -- 172.21.15.84:0/1129320280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de00a3630 con 0x7f1de01262a0 2020-01-16T05:47:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddd7fa700 1 -- 172.21.15.84:0/1129320280 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd4011860 con 0x7f1de01262a0 2020-01-16T05:47:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddffff700 1 --2- 172.21.15.84:0/1129320280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de01262a0 0x7f1de00a8710 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f1de00a49f0 tx=0x7f1dd4008ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:24.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddd7fa700 1 -- 172.21.15.84:0/1129320280 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dd400f740 con 0x7f1de01262a0 2020-01-16T05:47:24.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1de512b700 1 -- 172.21.15.84:0/1129320280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de013dd20 con 0x7f1de01262a0 2020-01-16T05:47:24.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddffff700 1 --2- 172.21.15.84:0/1129320280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de01262a0 0x7f1de00a8710 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f1de00a49f0 tx=0x7f1dd4008ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:24.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1de512b700 1 -- 172.21.15.84:0/1129320280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de005e1c0 con 0x7f1de01262a0 2020-01-16T05:47:24.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddd7fa700 1 -- 172.21.15.84:0/1129320280 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f1dd40056c0 con 0x7f1de01262a0 2020-01-16T05:47:24.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.816+0000 7f1ddffff700 1 --2- 172.21.15.84:0/1129320280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de01262a0 0x7f1de00a8710 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f1de00a49f0 tx=0x7f1dd4008ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:24.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.820+0000 7f1ddd7fa700 1 --2- 172.21.15.84:0/1129320280 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1dc003c740 0x7f1dc003ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:24.826 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.820+0000 7f1ddd7fa700 1 -- 172.21.15.84:0/1129320280 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f1dd404cc20 con 0x7f1de01262a0 2020-01-16T05:47:24.826 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.820+0000 7f1de492a700 1 --2- 172.21.15.84:0/1129320280 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1dc003c740 0x7f1dc003ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:24.826 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.820+0000 7f1de492a700 1 --2- 172.21.15.84:0/1129320280 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1dc003c740 0x7f1dc003ec50 crc :-1 s=READY pgs=165 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:24.826 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.824+0000 7f1ddffff700 1 --2- 172.21.15.84:0/1129320280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de01262a0 0x7f1de00a8710 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f1de00a49f0 tx=0x7f1dd4008ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:24.826 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.824+0000 7f1ddd7fa700 1 -- 172.21.15.84:0/1129320280 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f1dd4033220 con 0x7f1de01262a0 2020-01-16T05:47:24.843 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~178s 2020-01-16T05:47:24.975 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.976+0000 7f1de512b700 1 -- 172.21.15.84:0/1129320280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1de005f1e0 con 0x7f1de01262a0 2020-01-16T05:47:24.976 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.976+0000 7f1ddffff700 1 --2- 172.21.15.84:0/1129320280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de01262a0 0x7f1de00a8710 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f1de00a49f0 tx=0x7f1dd4008ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:24.976 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.976+0000 7f1ddd7fa700 1 -- 172.21.15.84:0/1129320280 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f1dd40080d0 con 0x7f1de01262a0 2020-01-16T05:47:24.976 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:24.976 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.976+0000 7f1de512b700 1 -- 172.21.15.84:0/1129320280 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1dc003c740 msgr2=0x7f1dc003ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.976+0000 7f1de512b700 1 --2- 172.21.15.84:0/1129320280 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1dc003c740 0x7f1dc003ec50 crc :-1 s=READY pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.976+0000 7f1de512b700 1 -- 172.21.15.84:0/1129320280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de01262a0 msgr2=0x7f1de00a8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.976+0000 7f1de512b700 1 --2- 172.21.15.84:0/1129320280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de01262a0 0x7f1de00a8710 secure :-1 s=READY pgs=414 cs=0 l=1 rx=0x7f1de00a49f0 tx=0x7f1dd4008ee0).stop 2020-01-16T05:47:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.976+0000 7f1de512b700 1 -- 172.21.15.84:0/1129320280 shutdown_connections 2020-01-16T05:47:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.976+0000 7f1de512b700 1 --2- 172.21.15.84:0/1129320280 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1dc003c740 0x7f1dc003ec50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.976+0000 7f1de512b700 1 --2- 172.21.15.84:0/1129320280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de01262a0 0x7f1de00a8710 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.976+0000 7f1de512b700 1 -- 172.21.15.84:0/1129320280 shutdown_connections 2020-01-16T05:47:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.976+0000 7f1de512b700 1 -- 172.21.15.84:0/1129320280 wait complete. 2020-01-16T05:47:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:24.976+0000 7f1de512b700 1 -- 172.21.15.84:0/1129320280 >> 172.21.15.84:0/1129320280 conn(0x7f1de0066650 msgr2=0x7f1de00a4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:24.980 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:24.989 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:26.991 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:27.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9188c47700 1 Processor -- start 2020-01-16T05:47:27.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9188c47700 1 -- start start 2020-01-16T05:47:27.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9188c47700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91840a9b30 0x7f91840abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:27.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9188c47700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9184066880 con 0x7f91840a4250 2020-01-16T05:47:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9188c47700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9184066ab0 con 0x7f918407ff10 2020-01-16T05:47:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9188c47700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91840a4830 con 0x7f91840a9b30 2020-01-16T05:47:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9183fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91840a9b30 0x7f91840abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9183fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91840a9b30 0x7f91840abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36052/0 (socket says 172.21.15.84:36052) 2020-01-16T05:47:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9189ea9700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f91840a4250 0x7f918414fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53254/0 (socket says 172.21.15.84:53254) 2020-01-16T05:47:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9183fff700 1 -- 172.21.15.84:0/3696846200 learned_addr learned my addr 172.21.15.84:0/3696846200 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:47:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9183fff700 1 -- 172.21.15.84:0/3696846200 >> v1:172.21.15.142:6789/0 conn(0x7f918407ff10 legacy=0x7f91840a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:27.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9183fff700 1 -- 172.21.15.84:0/3696846200 >> v1:172.21.15.84:6789/0 conn(0x7f91840a4250 legacy=0x7f918414fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:27.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9183fff700 1 -- 172.21.15.84:0/3696846200 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9184066ce0 con 0x7f91840a9b30 2020-01-16T05:47:27.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9183fff700 1 --2- 172.21.15.84:0/3696846200 >> v2:172.21.15.84:3300/0 conn(0x7f91840a9b30 0x7f91840abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9174008c90 tx=0x7f91740101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:27.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9183fff700 1 --2- 172.21.15.84:0/3696846200 >> v2:172.21.15.84:3300/0 conn(0x7f91840a9b30 0x7f91840abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9174008c90 tx=0x7f91740101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:27.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9183fff700 1 --2- 172.21.15.84:0/3696846200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91840a9b30 0x7f91840abdd0 secure :-1 s=READY pgs=416 cs=0 l=1 rx=0x7f9174008c90 tx=0x7f91740101b0).ready entity=mon.0 client_cookie=e346fa3a8493ffad server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:27.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9183fff700 1 --2- 172.21.15.84:0/3696846200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91840a9b30 0x7f91840abdd0 secure :-1 s=THROTTLE_DONE pgs=416 cs=0 l=1 rx=0x7f9174008c90 tx=0x7f91740101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:27.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9182ffd700 1 -- 172.21.15.84:0/3696846200 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f917400a160 con 0x7f91840a9b30 2020-01-16T05:47:27.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9183fff700 1 --2- 172.21.15.84:0/3696846200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91840a9b30 0x7f91840abdd0 secure :-1 s=THROTTLE_DONE pgs=416 cs=0 l=1 rx=0x7f9174008c90 tx=0x7f91740101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:27.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9182ffd700 1 -- 172.21.15.84:0/3696846200 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9174011c20 con 0x7f91840a9b30 2020-01-16T05:47:27.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9183fff700 1 --2- 172.21.15.84:0/3696846200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91840a9b30 0x7f91840abdd0 secure :-1 s=THROTTLE_DONE pgs=416 cs=0 l=1 rx=0x7f9174008c90 tx=0x7f91740101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:27.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9182ffd700 1 -- 172.21.15.84:0/3696846200 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f917400a740 con 0x7f91840a9b30 2020-01-16T05:47:27.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9188c47700 1 -- 172.21.15.84:0/3696846200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91840a9b30 msgr2=0x7f91840abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:27.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.112+0000 7f9188c47700 1 --2- 172.21.15.84:0/3696846200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91840a9b30 0x7f91840abdd0 secure :-1 s=READY pgs=416 cs=0 l=1 rx=0x7f9174008c90 tx=0x7f91740101b0).stop 2020-01-16T05:47:27.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.116+0000 7f9188c47700 1 -- 172.21.15.84:0/3696846200 shutdown_connections 2020-01-16T05:47:27.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.116+0000 7f9188c47700 1 --2- 172.21.15.84:0/3696846200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91840a9b30 0x7f91840abdd0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:27.122 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.116+0000 7f9188c47700 1 -- 172.21.15.84:0/3696846200 shutdown_connections 2020-01-16T05:47:27.122 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.116+0000 7f9188c47700 1 -- 172.21.15.84:0/3696846200 wait complete. 2020-01-16T05:47:27.122 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.116+0000 7f9188c47700 1 -- 172.21.15.84:0/3696846200 >> 172.21.15.84:0/3696846200 conn(0x7f91840acfc0 msgr2=0x7f91840a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:27.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.116+0000 7f9188c47700 1 Processor -- start 2020-01-16T05:47:27.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.116+0000 7f9188c47700 1 -- start start 2020-01-16T05:47:27.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f9188c47700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f918409f350 0x7f918409f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:27.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f9188c47700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9184091670 0x7f9184091aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:27.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f9188c47700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9184090040 con 0x7f91840a5660 2020-01-16T05:47:27.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f9188c47700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9184066380 con 0x7f918409f350 2020-01-16T05:47:27.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f9188c47700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91840a1820 con 0x7f9184091670 2020-01-16T05:47:27.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f91837fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f918409f350 0x7f918409f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:27.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f91837fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f918409f350 0x7f918409f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36060/0 (socket says 172.21.15.84:36060) 2020-01-16T05:47:27.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f91837fe700 1 -- 172.21.15.84:0/25000304 learned_addr learned my addr 172.21.15.84:0/25000304 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:47:27.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f9189ea9700 1 --2- 172.21.15.84:0/25000304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9184091670 0x7f9184091aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:27.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f91837fe700 1 -- 172.21.15.84:0/25000304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9184091670 msgr2=0x7f9184091aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:27.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f91837fe700 1 --2- 172.21.15.84:0/25000304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9184091670 0x7f9184091aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:27.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f91837fe700 1 -- 172.21.15.84:0/25000304 >> v1:172.21.15.142:6789/0 conn(0x7f91840a5660 legacy=0x7f91840a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:27.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f9180ff9700 1 -- 172.21.15.84:0/25000304 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744762108 0 0) 0x7f9184090040 con 0x7f91840a5660 2020-01-16T05:47:27.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f91837fe700 1 -- 172.21.15.84:0/25000304 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91840a34e0 con 0x7f918409f350 2020-01-16T05:47:27.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f91837fe700 1 --2- 172.21.15.84:0/25000304 >> v2:172.21.15.84:3300/0 conn(0x7f918409f350 0x7f918409f780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f916c000e90 tx=0x7f916c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:27.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f91837fe700 1 --2- 172.21.15.84:0/25000304 >> v2:172.21.15.84:3300/0 conn(0x7f918409f350 0x7f918409f780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f916c000e90 tx=0x7f916c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:27.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f91837fe700 1 --2- 172.21.15.84:0/25000304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f918409f350 0x7f918409f780 secure :-1 s=READY pgs=417 cs=0 l=1 rx=0x7f916c000e90 tx=0x7f916c010b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:27.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f91837fe700 1 --2- 172.21.15.84:0/25000304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f918409f350 0x7f918409f780 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f916c000e90 tx=0x7f916c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:27.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f9180ff9700 1 -- 172.21.15.84:0/25000304 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f916c0125b0 con 0x7f918409f350 2020-01-16T05:47:27.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f91837fe700 1 --2- 172.21.15.84:0/25000304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f918409f350 0x7f918409f780 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f916c000e90 tx=0x7f916c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:27.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f91837fe700 1 --2- 172.21.15.84:0/25000304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f918409f350 0x7f918409f780 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f916c000e90 tx=0x7f916c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:27.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f9180ff9700 1 -- 172.21.15.84:0/25000304 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c0121d0 con 0x7f918409f350 2020-01-16T05:47:27.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f9180ff9700 1 -- 172.21.15.84:0/25000304 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f916c012b90 con 0x7f918409f350 2020-01-16T05:47:27.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f9188c47700 1 -- 172.21.15.84:0/25000304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f918413d7b0 con 0x7f918409f350 2020-01-16T05:47:27.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f9188c47700 1 -- 172.21.15.84:0/25000304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918413dd60 con 0x7f918409f350 2020-01-16T05:47:27.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f91837fe700 1 --2- 172.21.15.84:0/25000304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f918409f350 0x7f918409f780 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f916c000e90 tx=0x7f916c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:27.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f9180ff9700 1 -- 172.21.15.84:0/25000304 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f916c0064e0 con 0x7f918409f350 2020-01-16T05:47:27.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.120+0000 7f91837fe700 1 --2- 172.21.15.84:0/25000304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f918409f350 0x7f918409f780 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f916c000e90 tx=0x7f916c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:27.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.124+0000 7f9180ff9700 1 --2- 172.21.15.84:0/25000304 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f916803c180 0x7f916803e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:27.130 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.124+0000 7f9188c47700 1 -- 172.21.15.84:0/25000304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f918405e1c0 con 0x7f918409f350 2020-01-16T05:47:27.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.124+0000 7f9180ff9700 1 -- 172.21.15.84:0/25000304 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f916c04c7a0 con 0x7f918409f350 2020-01-16T05:47:27.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.124+0000 7f9183fff700 1 --2- 172.21.15.84:0/25000304 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f916803c180 0x7f916803e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:27.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.124+0000 7f9183fff700 1 --2- 172.21.15.84:0/25000304 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f916803c180 0x7f916803e690 crc :-1 s=READY pgs=166 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:27.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.128+0000 7f91837fe700 1 --2- 172.21.15.84:0/25000304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f918409f350 0x7f918409f780 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f916c000e90 tx=0x7f916c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:27.132 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.128+0000 7f9180ff9700 1 -- 172.21.15.84:0/25000304 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f916c032dc0 con 0x7f918409f350 2020-01-16T05:47:27.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.276+0000 7f9188c47700 1 -- 172.21.15.84:0/25000304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91840a4570 con 0x7f918409f350 2020-01-16T05:47:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.280+0000 7f91837fe700 1 --2- 172.21.15.84:0/25000304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f918409f350 0x7f918409f780 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f916c000e90 tx=0x7f916c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.280+0000 7f9180ff9700 1 -- 172.21.15.84:0/25000304 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f916c012d90 con 0x7f918409f350 2020-01-16T05:47:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.280+0000 7f9188c47700 1 -- 172.21.15.84:0/25000304 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f916803c180 msgr2=0x7f916803e690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.280+0000 7f9188c47700 1 --2- 172.21.15.84:0/25000304 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f916803c180 0x7f916803e690 crc :-1 s=READY pgs=166 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:27.288 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.280+0000 7f9188c47700 1 -- 172.21.15.84:0/25000304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f918409f350 msgr2=0x7f918409f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:27.288 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.280+0000 7f9188c47700 1 --2- 172.21.15.84:0/25000304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f918409f350 0x7f918409f780 secure :-1 s=READY pgs=417 cs=0 l=1 rx=0x7f916c000e90 tx=0x7f916c010b20).stop 2020-01-16T05:47:27.288 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.280+0000 7f9188c47700 1 -- 172.21.15.84:0/25000304 shutdown_connections 2020-01-16T05:47:27.288 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.280+0000 7f9188c47700 1 --2- 172.21.15.84:0/25000304 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f916803c180 0x7f916803e690 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:27.288 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.280+0000 7f9188c47700 1 --2- 172.21.15.84:0/25000304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9184091670 0x7f9184091aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:27.288 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.280+0000 7f9188c47700 1 --2- 172.21.15.84:0/25000304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f918409f350 0x7f918409f780 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:27.288 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.280+0000 7f9188c47700 1 -- 172.21.15.84:0/25000304 shutdown_connections 2020-01-16T05:47:27.289 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.280+0000 7f9188c47700 1 -- 172.21.15.84:0/25000304 wait complete. 2020-01-16T05:47:27.289 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:27.280+0000 7f9188c47700 1 -- 172.21.15.84:0/25000304 >> 172.21.15.84:0/25000304 conn(0x7f91840a9110 msgr2=0x7f91840a4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:27.289 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:27.289 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:27.289 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:27.291 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:29.292 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:29.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc029b4c700 1 Processor -- start 2020-01-16T05:47:29.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc029b4c700 1 -- start start 2020-01-16T05:47:29.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc029b4c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc0240a9b30 0x7fc0240abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:29.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc029b4c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc02407ff10 0x7fc024066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:29.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc029b4c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0240a4250 0x7fc0240a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:29.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc029b4c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0240a4830 con 0x7fc02407ff10 2020-01-16T05:47:29.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc029b4c700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02407f9d0 con 0x7fc0240a9b30 2020-01-16T05:47:29.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc029b4c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02407fc70 con 0x7fc0240a4250 2020-01-16T05:47:29.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc028b4a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc02407ff10 0x7fc024066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:29.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc028b4a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc02407ff10 0x7fc024066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36076/0 (socket says 172.21.15.84:36076) 2020-01-16T05:47:29.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc02adae700 1 --2- 172.21.15.84:0/4278301636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0240a4250 0x7fc0240a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:29.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc028b4a700 1 -- 172.21.15.84:0/4278301636 learned_addr learned my addr 172.21.15.84:0/4278301636 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:47:29.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc02934b700 1 --2- 172.21.15.84:0/4278301636 >> v2:172.21.15.142:3300/0 conn(0x7fc0240a9b30 0x7fc0240abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:29.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc028b4a700 1 -- 172.21.15.84:0/4278301636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0240a4250 msgr2=0x7fc0240a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:29.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc028b4a700 1 --2- 172.21.15.84:0/4278301636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0240a4250 0x7fc0240a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:29.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc028b4a700 1 -- 172.21.15.84:0/4278301636 >> v2:172.21.15.142:3300/0 conn(0x7fc0240a9b30 msgr2=0x7fc0240abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:29.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc028b4a700 1 --2- 172.21.15.84:0/4278301636 >> v2:172.21.15.142:3300/0 conn(0x7fc0240a9b30 0x7fc0240abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:29.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc028b4a700 1 -- 172.21.15.84:0/4278301636 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc024066dd0 con 0x7fc02407ff10 2020-01-16T05:47:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc028b4a700 1 --2- 172.21.15.84:0/4278301636 >> v2:172.21.15.84:3300/0 conn(0x7fc02407ff10 0x7fc024066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc0240a49f0 tx=0x7fc01800ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc028b4a700 1 --2- 172.21.15.84:0/4278301636 >> v2:172.21.15.84:3300/0 conn(0x7fc02407ff10 0x7fc024066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc0240a49f0 tx=0x7fc01800ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc028b4a700 1 --2- 172.21.15.84:0/4278301636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc02407ff10 0x7fc024066880 secure :-1 s=READY pgs=420 cs=0 l=1 rx=0x7fc0240a49f0 tx=0x7fc01800ff30).ready entity=mon.0 client_cookie=dbfe7fe9d30929ca server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc028b4a700 1 --2- 172.21.15.84:0/4278301636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc02407ff10 0x7fc024066880 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7fc0240a49f0 tx=0x7fc01800ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc023fff700 1 -- 172.21.15.84:0/4278301636 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc018011760 con 0x7fc02407ff10 2020-01-16T05:47:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc028b4a700 1 --2- 172.21.15.84:0/4278301636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc02407ff10 0x7fc024066880 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7fc0240a49f0 tx=0x7fc01800ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc023fff700 1 -- 172.21.15.84:0/4278301636 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc018008d30 con 0x7fc02407ff10 2020-01-16T05:47:29.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc028b4a700 1 --2- 172.21.15.84:0/4278301636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc02407ff10 0x7fc024066880 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7fc0240a49f0 tx=0x7fc01800ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:29.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc029b4c700 1 -- 172.21.15.84:0/4278301636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc02407ff10 msgr2=0x7fc024066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:29.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc023fff700 1 -- 172.21.15.84:0/4278301636 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc018011d40 con 0x7fc02407ff10 2020-01-16T05:47:29.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc029b4c700 1 --2- 172.21.15.84:0/4278301636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc02407ff10 0x7fc024066880 secure :-1 s=READY pgs=420 cs=0 l=1 rx=0x7fc0240a49f0 tx=0x7fc01800ff30).stop 2020-01-16T05:47:29.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc029b4c700 1 -- 172.21.15.84:0/4278301636 shutdown_connections 2020-01-16T05:47:29.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc029b4c700 1 --2- 172.21.15.84:0/4278301636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0240a4250 0x7fc0240a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:29.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc029b4c700 1 --2- 172.21.15.84:0/4278301636 >> v2:172.21.15.142:3300/0 conn(0x7fc0240a9b30 0x7fc0240abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:29.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.412+0000 7fc029b4c700 1 --2- 172.21.15.84:0/4278301636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc02407ff10 0x7fc024066880 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:29.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc029b4c700 1 -- 172.21.15.84:0/4278301636 shutdown_connections 2020-01-16T05:47:29.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc029b4c700 1 -- 172.21.15.84:0/4278301636 wait complete. 2020-01-16T05:47:29.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc029b4c700 1 -- 172.21.15.84:0/4278301636 >> 172.21.15.84:0/4278301636 conn(0x7fc0240acfc0 msgr2=0x7fc0240a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:29.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc029b4c700 1 Processor -- start 2020-01-16T05:47:29.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc029b4c700 1 -- start start 2020-01-16T05:47:29.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc029b4c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc0240a3370 0x7fc024090440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:29.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc029b4c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc024090990 0x7fc02413f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:29.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc029b4c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc024090dc0 con 0x7fc024065810 2020-01-16T05:47:29.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc029b4c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0240a1dc0 con 0x7fc0240a3370 2020-01-16T05:47:29.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc029b4c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0240a2fe0 con 0x7fc024090990 2020-01-16T05:47:29.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc028b4a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc0240a3370 0x7fc024090440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:29.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc028b4a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc0240a3370 0x7fc024090440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36082/0 (socket says 172.21.15.84:36082) 2020-01-16T05:47:29.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc02934b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc024065810 0x7fc02407d200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53280/0 (socket says 172.21.15.84:53280) 2020-01-16T05:47:29.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc028b4a700 1 -- 172.21.15.84:0/1681990662 learned_addr learned my addr 172.21.15.84:0/1681990662 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:47:29.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc02adae700 1 --2- 172.21.15.84:0/1681990662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc024090990 0x7fc02413f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:29.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc028b4a700 1 -- 172.21.15.84:0/1681990662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc024090990 msgr2=0x7fc02413f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:29.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc028b4a700 1 --2- 172.21.15.84:0/1681990662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc024090990 0x7fc02413f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:29.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc028b4a700 1 -- 172.21.15.84:0/1681990662 >> v1:172.21.15.84:6789/0 conn(0x7fc024065810 legacy=0x7fc02407d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:29.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc028b4a700 1 -- 172.21.15.84:0/1681990662 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0240a37a0 con 0x7fc0240a3370 2020-01-16T05:47:29.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc021ffb700 1 -- 172.21.15.84:0/1681990662 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200675337 0 0) 0x7fc024090dc0 con 0x7fc024065810 2020-01-16T05:47:29.433 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc028b4a700 1 --2- 172.21.15.84:0/1681990662 >> v2:172.21.15.84:3300/0 conn(0x7fc0240a3370 0x7fc024090440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc0240663d0 tx=0x7fc018011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc028b4a700 1 --2- 172.21.15.84:0/1681990662 >> v2:172.21.15.84:3300/0 conn(0x7fc0240a3370 0x7fc024090440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc0240663d0 tx=0x7fc018011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc028b4a700 1 --2- 172.21.15.84:0/1681990662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0240a3370 0x7fc024090440 secure :-1 s=READY pgs=422 cs=0 l=1 rx=0x7fc0240663d0 tx=0x7fc018011880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc028b4a700 1 --2- 172.21.15.84:0/1681990662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0240a3370 0x7fc024090440 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7fc0240663d0 tx=0x7fc018011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc021ffb700 1 -- 172.21.15.84:0/1681990662 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc01800f700 con 0x7fc0240a3370 2020-01-16T05:47:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc028b4a700 1 --2- 172.21.15.84:0/1681990662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0240a3370 0x7fc024090440 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7fc0240663d0 tx=0x7fc018011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc021ffb700 1 -- 172.21.15.84:0/1681990662 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc018011960 con 0x7fc0240a3370 2020-01-16T05:47:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc028b4a700 1 --2- 172.21.15.84:0/1681990662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0240a3370 0x7fc024090440 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7fc0240663d0 tx=0x7fc018011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:29.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc029b4c700 1 -- 172.21.15.84:0/1681990662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0240a1380 con 0x7fc0240a3370 2020-01-16T05:47:29.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc021ffb700 1 -- 172.21.15.84:0/1681990662 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc018007530 con 0x7fc0240a3370 2020-01-16T05:47:29.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.416+0000 7fc029b4c700 1 -- 172.21.15.84:0/1681990662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02413f880 con 0x7fc0240a3370 2020-01-16T05:47:29.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.420+0000 7fc028b4a700 1 --2- 172.21.15.84:0/1681990662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0240a3370 0x7fc024090440 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7fc0240663d0 tx=0x7fc018011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:29.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.420+0000 7fc029b4c700 1 -- 172.21.15.84:0/1681990662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc02405e1c0 con 0x7fc0240a3370 2020-01-16T05:47:29.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.420+0000 7fc021ffb700 1 -- 172.21.15.84:0/1681990662 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fc0180056c0 con 0x7fc0240a3370 2020-01-16T05:47:29.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.420+0000 7fc028b4a700 1 --2- 172.21.15.84:0/1681990662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0240a3370 0x7fc024090440 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7fc0240663d0 tx=0x7fc018011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:29.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.420+0000 7fc021ffb700 1 --2- 172.21.15.84:0/1681990662 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc00403c190 0x7fc00403e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.420+0000 7fc021ffb700 1 -- 172.21.15.84:0/1681990662 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fc018090e10 con 0x7fc0240a3370 2020-01-16T05:47:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.420+0000 7fc02934b700 1 --2- 172.21.15.84:0/1681990662 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc00403c190 0x7fc00403e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.420+0000 7fc02934b700 1 --2- 172.21.15.84:0/1681990662 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc00403c190 0x7fc00403e6a0 crc :-1 s=READY pgs=167 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.428+0000 7fc028b4a700 1 --2- 172.21.15.84:0/1681990662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0240a3370 0x7fc024090440 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7fc0240663d0 tx=0x7fc018011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.428+0000 7fc021ffb700 1 -- 172.21.15.84:0/1681990662 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fc018077410 con 0x7fc0240a3370 2020-01-16T05:47:29.582 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.580+0000 7fc029b4c700 1 -- 172.21.15.84:0/1681990662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0240a2700 con 0x7fc0240a3370 2020-01-16T05:47:29.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.584+0000 7fc028b4a700 1 --2- 172.21.15.84:0/1681990662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0240a3370 0x7fc024090440 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7fc0240663d0 tx=0x7fc018011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:29.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.584+0000 7fc021ffb700 1 -- 172.21.15.84:0/1681990662 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fc018077670 con 0x7fc0240a3370 2020-01-16T05:47:29.583 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:29.583 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:29.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.584+0000 7fc029b4c700 1 -- 172.21.15.84:0/1681990662 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc00403c190 msgr2=0x7fc00403e6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:29.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.584+0000 7fc029b4c700 1 --2- 172.21.15.84:0/1681990662 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc00403c190 0x7fc00403e6a0 crc :-1 s=READY pgs=167 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:29.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.584+0000 7fc029b4c700 1 -- 172.21.15.84:0/1681990662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0240a3370 msgr2=0x7fc024090440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:29.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.584+0000 7fc029b4c700 1 --2- 172.21.15.84:0/1681990662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0240a3370 0x7fc024090440 secure :-1 s=READY pgs=422 cs=0 l=1 rx=0x7fc0240663d0 tx=0x7fc018011880).stop 2020-01-16T05:47:29.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.584+0000 7fc029b4c700 1 -- 172.21.15.84:0/1681990662 shutdown_connections 2020-01-16T05:47:29.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.584+0000 7fc029b4c700 1 --2- 172.21.15.84:0/1681990662 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc00403c190 0x7fc00403e6a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:29.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.584+0000 7fc029b4c700 1 --2- 172.21.15.84:0/1681990662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc024090990 0x7fc02413f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:29.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.584+0000 7fc029b4c700 1 --2- 172.21.15.84:0/1681990662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0240a3370 0x7fc024090440 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:29.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.584+0000 7fc029b4c700 1 -- 172.21.15.84:0/1681990662 shutdown_connections 2020-01-16T05:47:29.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.584+0000 7fc029b4c700 1 -- 172.21.15.84:0/1681990662 wait complete. 2020-01-16T05:47:29.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:29.584+0000 7fc029b4c700 1 -- 172.21.15.84:0/1681990662 >> 172.21.15.84:0/1681990662 conn(0x7fc0240a9040 msgr2=0x7fc0240a4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:29.587 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:29.596 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:31.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~184s 2020-01-16T05:47:31.597 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:31.728 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8529ce700 1 Processor -- start 2020-01-16T05:47:31.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8529ce700 1 -- start start 2020-01-16T05:47:31.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8529ce700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb84c0a9b30 0x7fb84c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:31.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8529ce700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb84c07ff10 0x7fb84c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:31.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8529ce700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84c066dd0 con 0x7fb84c0a4250 2020-01-16T05:47:31.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8529ce700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84c0a4830 con 0x7fb84c07ff10 2020-01-16T05:47:31.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8529ce700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84c07f9d0 con 0x7fb84c0a9b30 2020-01-16T05:47:31.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8519cc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb84c07ff10 0x7fb84c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:31.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8519cc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb84c07ff10 0x7fb84c066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36090/0 (socket says 172.21.15.84:36090) 2020-01-16T05:47:31.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8519cc700 1 -- 172.21.15.84:0/3438412218 learned_addr learned my addr 172.21.15.84:0/3438412218 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:47:31.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb853c30700 1 --1- 172.21.15.84:0/3438412218 >> v1:172.21.15.84:6789/0 conn(0x7fb84c0a4250 0x7fb84c0a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53292/0 (socket says 172.21.15.84:53292) 2020-01-16T05:47:31.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8521cd700 1 --2- 172.21.15.84:0/3438412218 >> v2:172.21.15.142:3300/0 conn(0x7fb84c0a9b30 0x7fb84c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:31.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8519cc700 1 -- 172.21.15.84:0/3438412218 >> v2:172.21.15.142:3300/0 conn(0x7fb84c0a9b30 msgr2=0x7fb84c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:31.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8519cc700 1 --2- 172.21.15.84:0/3438412218 >> v2:172.21.15.142:3300/0 conn(0x7fb84c0a9b30 0x7fb84c0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:31.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8519cc700 1 -- 172.21.15.84:0/3438412218 >> v1:172.21.15.84:6789/0 conn(0x7fb84c0a4250 legacy=0x7fb84c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:31.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8519cc700 1 -- 172.21.15.84:0/3438412218 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c150ce0 con 0x7fb84c07ff10 2020-01-16T05:47:31.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8519cc700 1 --2- 172.21.15.84:0/3438412218 >> v2:172.21.15.84:3300/0 conn(0x7fb84c07ff10 0x7fb84c066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb84c0a49f0 tx=0x7fb840010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:31.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8519cc700 1 --2- 172.21.15.84:0/3438412218 >> v2:172.21.15.84:3300/0 conn(0x7fb84c07ff10 0x7fb84c066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb84c0a49f0 tx=0x7fb840010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:31.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8519cc700 1 --2- 172.21.15.84:0/3438412218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb84c07ff10 0x7fb84c066880 secure :-1 s=READY pgs=426 cs=0 l=1 rx=0x7fb84c0a49f0 tx=0x7fb840010230).ready entity=mon.0 client_cookie=9e1a6829b6f207dc server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:31.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8519cc700 1 --2- 172.21.15.84:0/3438412218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb84c07ff10 0x7fb84c066880 secure :-1 s=THROTTLE_DONE pgs=426 cs=0 l=1 rx=0x7fb84c0a49f0 tx=0x7fb840010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:31.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8519cc700 1 --2- 172.21.15.84:0/3438412218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb84c07ff10 0x7fb84c066880 secure :-1 s=THROTTLE_DONE pgs=426 cs=0 l=1 rx=0x7fb84c0a49f0 tx=0x7fb840010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:31.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8511cb700 1 -- 172.21.15.84:0/3438412218 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb84000a160 con 0x7fb84c07ff10 2020-01-16T05:47:31.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8519cc700 1 --2- 172.21.15.84:0/3438412218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb84c07ff10 0x7fb84c066880 secure :-1 s=THROTTLE_DONE pgs=426 cs=0 l=1 rx=0x7fb84c0a49f0 tx=0x7fb840010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:31.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8511cb700 1 -- 172.21.15.84:0/3438412218 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb840011b70 con 0x7fb84c07ff10 2020-01-16T05:47:31.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8511cb700 1 -- 172.21.15.84:0/3438412218 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb84000a740 con 0x7fb84c07ff10 2020-01-16T05:47:31.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8529ce700 1 -- 172.21.15.84:0/3438412218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb84c07ff10 msgr2=0x7fb84c066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:31.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8529ce700 1 --2- 172.21.15.84:0/3438412218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb84c07ff10 0x7fb84c066880 secure :-1 s=READY pgs=426 cs=0 l=1 rx=0x7fb84c0a49f0 tx=0x7fb840010230).stop 2020-01-16T05:47:31.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8529ce700 1 -- 172.21.15.84:0/3438412218 shutdown_connections 2020-01-16T05:47:31.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8529ce700 1 --2- 172.21.15.84:0/3438412218 >> v2:172.21.15.142:3300/0 conn(0x7fb84c0a9b30 0x7fb84c0abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:31.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8529ce700 1 --2- 172.21.15.84:0/3438412218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb84c07ff10 0x7fb84c066880 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:31.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8529ce700 1 -- 172.21.15.84:0/3438412218 shutdown_connections 2020-01-16T05:47:31.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8529ce700 1 -- 172.21.15.84:0/3438412218 wait complete. 2020-01-16T05:47:31.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.720+0000 7fb8529ce700 1 -- 172.21.15.84:0/3438412218 >> 172.21.15.84:0/3438412218 conn(0x7fb84c0acfc0 msgr2=0x7fb84c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:31.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8529ce700 1 Processor -- start 2020-01-16T05:47:31.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8529ce700 1 -- start start 2020-01-16T05:47:31.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8529ce700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb84c065920 0x7fb84c0a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:31.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8529ce700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb84c13d5d0 0x7fb84c13fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:31.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8529ce700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84c0a33c0 con 0x7fb84c12a5b0 2020-01-16T05:47:31.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8529ce700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84c0a1b40 con 0x7fb84c065920 2020-01-16T05:47:31.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8529ce700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84c0a3700 con 0x7fb84c13d5d0 2020-01-16T05:47:31.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8521cd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb84c065920 0x7fb84c0a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:31.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8519cc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb84c12a5b0 0x7fb84c07cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53298/0 (socket says 172.21.15.84:53298) 2020-01-16T05:47:31.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8519cc700 1 -- 172.21.15.84:0/442320332 learned_addr learned my addr 172.21.15.84:0/442320332 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:31.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb853c30700 1 --2- 172.21.15.84:0/442320332 >> v2:172.21.15.142:3300/0 conn(0x7fb84c13d5d0 0x7fb84c13fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:31.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb84affd700 1 -- 172.21.15.84:0/442320332 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480758024 0 0) 0x7fb84c0a33c0 con 0x7fb84c12a5b0 2020-01-16T05:47:31.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb84affd700 1 -- 172.21.15.84:0/442320332 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb82c003230 con 0x7fb84c12a5b0 2020-01-16T05:47:31.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8521cd700 1 -- 172.21.15.84:0/442320332 >> v2:172.21.15.142:3300/0 conn(0x7fb84c13d5d0 msgr2=0x7fb84c13fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:31.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8521cd700 1 --2- 172.21.15.84:0/442320332 >> v2:172.21.15.142:3300/0 conn(0x7fb84c13d5d0 0x7fb84c13fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:31.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8521cd700 1 -- 172.21.15.84:0/442320332 >> v1:172.21.15.84:6789/0 conn(0x7fb84c12a5b0 legacy=0x7fb84c07cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:31.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb84affd700 1 -- 172.21.15.84:0/442320332 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1200026653 0 0) 0x7fb82c003230 con 0x7fb84c12a5b0 2020-01-16T05:47:31.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8521cd700 1 -- 172.21.15.84:0/442320332 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c0a1350 con 0x7fb84c065920 2020-01-16T05:47:31.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8521cd700 1 --2- 172.21.15.84:0/442320332 >> v2:172.21.15.84:3300/0 conn(0x7fb84c065920 0x7fb84c0a1d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb840011fc0 tx=0x7fb840010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:31.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8521cd700 1 --2- 172.21.15.84:0/442320332 >> v2:172.21.15.84:3300/0 conn(0x7fb84c065920 0x7fb84c0a1d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb840011fc0 tx=0x7fb840010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:31.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8521cd700 1 --2- 172.21.15.84:0/442320332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb84c065920 0x7fb84c0a1d90 secure :-1 s=READY pgs=428 cs=0 l=1 rx=0x7fb840011fc0 tx=0x7fb840010780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:31.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8521cd700 1 --2- 172.21.15.84:0/442320332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb84c065920 0x7fb84c0a1d90 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fb840011fc0 tx=0x7fb840010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:31.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb84affd700 1 -- 172.21.15.84:0/442320332 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb84000a160 con 0x7fb84c065920 2020-01-16T05:47:31.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8521cd700 1 --2- 172.21.15.84:0/442320332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb84c065920 0x7fb84c0a1d90 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fb840011fc0 tx=0x7fb840010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:31.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8521cd700 1 --2- 172.21.15.84:0/442320332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb84c065920 0x7fb84c0a1d90 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fb840011fc0 tx=0x7fb840010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:31.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb84affd700 1 -- 172.21.15.84:0/442320332 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84000a360 con 0x7fb84c065920 2020-01-16T05:47:31.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8529ce700 1 -- 172.21.15.84:0/442320332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84c0a16c0 con 0x7fb84c065920 2020-01-16T05:47:31.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb84affd700 1 -- 172.21.15.84:0/442320332 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb83c007350 con 0x7fb84c065920 2020-01-16T05:47:31.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.724+0000 7fb8529ce700 1 -- 172.21.15.84:0/442320332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84c0903d0 con 0x7fb84c065920 2020-01-16T05:47:31.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.728+0000 7fb8521cd700 1 --2- 172.21.15.84:0/442320332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb84c065920 0x7fb84c0a1d90 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fb840011fc0 tx=0x7fb840010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:31.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.728+0000 7fb8529ce700 1 -- 172.21.15.84:0/442320332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84c05e1c0 con 0x7fb84c065920 2020-01-16T05:47:31.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.728+0000 7fb84affd700 1 -- 172.21.15.84:0/442320332 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fb83c007aa0 con 0x7fb84c065920 2020-01-16T05:47:31.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.728+0000 7fb8521cd700 1 --2- 172.21.15.84:0/442320332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb84c065920 0x7fb84c0a1d90 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fb840011fc0 tx=0x7fb840010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:31.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.728+0000 7fb84affd700 1 --2- 172.21.15.84:0/442320332 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb82c03c700 0x7fb82c03ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:31.739 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.728+0000 7fb84affd700 1 -- 172.21.15.84:0/442320332 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fb83c04c010 con 0x7fb84c065920 2020-01-16T05:47:31.739 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.728+0000 7fb8519cc700 1 --2- 172.21.15.84:0/442320332 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb82c03c700 0x7fb82c03ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:31.739 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.728+0000 7fb8519cc700 1 --2- 172.21.15.84:0/442320332 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb82c03c700 0x7fb82c03ec10 crc :-1 s=READY pgs=168 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:31.740 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.732+0000 7fb8521cd700 1 --2- 172.21.15.84:0/442320332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb84c065920 0x7fb84c0a1d90 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fb840011fc0 tx=0x7fb840010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:31.740 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.732+0000 7fb84affd700 1 -- 172.21.15.84:0/442320332 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fb83c04fde0 con 0x7fb84c065920 2020-01-16T05:47:31.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.884+0000 7fb8529ce700 1 -- 172.21.15.84:0/442320332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb84c09fce0 con 0x7fb84c065920 2020-01-16T05:47:31.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.888+0000 7fb8521cd700 1 --2- 172.21.15.84:0/442320332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb84c065920 0x7fb84c0a1d90 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fb840011fc0 tx=0x7fb840010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:31.887 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.888+0000 7fb84affd700 1 -- 172.21.15.84:0/442320332 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fb83c032610 con 0x7fb84c065920 2020-01-16T05:47:31.887 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:31.888 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.888+0000 7fb8529ce700 1 -- 172.21.15.84:0/442320332 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb82c03c700 msgr2=0x7fb82c03ec10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.888+0000 7fb8529ce700 1 --2- 172.21.15.84:0/442320332 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb82c03c700 0x7fb82c03ec10 crc :-1 s=READY pgs=168 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.888+0000 7fb8529ce700 1 -- 172.21.15.84:0/442320332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb84c065920 msgr2=0x7fb84c0a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.888+0000 7fb8529ce700 1 --2- 172.21.15.84:0/442320332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb84c065920 0x7fb84c0a1d90 secure :-1 s=READY pgs=428 cs=0 l=1 rx=0x7fb840011fc0 tx=0x7fb840010780).stop 2020-01-16T05:47:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.888+0000 7fb8529ce700 1 -- 172.21.15.84:0/442320332 shutdown_connections 2020-01-16T05:47:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.888+0000 7fb8529ce700 1 --2- 172.21.15.84:0/442320332 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb82c03c700 0x7fb82c03ec10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.888+0000 7fb8529ce700 1 --2- 172.21.15.84:0/442320332 >> v2:172.21.15.142:3300/0 conn(0x7fb84c13d5d0 0x7fb84c13fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.888+0000 7fb8529ce700 1 --2- 172.21.15.84:0/442320332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb84c065920 0x7fb84c0a1d90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.888+0000 7fb8529ce700 1 -- 172.21.15.84:0/442320332 shutdown_connections 2020-01-16T05:47:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.888+0000 7fb8529ce700 1 -- 172.21.15.84:0/442320332 wait complete. 2020-01-16T05:47:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:31.888+0000 7fb8529ce700 1 -- 172.21.15.84:0/442320332 >> 172.21.15.84:0/442320332 conn(0x7fb84c0a63d0 msgr2=0x7fb84c0a4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:31.891 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:31.901 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:33.901 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:34.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.016+0000 7f0dbb59e700 1 Processor -- start 2020-01-16T05:47:34.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.016+0000 7f0dbb59e700 1 -- start start 2020-01-16T05:47:34.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dbb59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dbc07ff10 0x7f0dbc0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:34.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dbb59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dbc066880 con 0x7f0dbc0a4250 2020-01-16T05:47:34.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dbb59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dbc066ab0 con 0x7f0dbc0a9b30 2020-01-16T05:47:34.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dbb59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc0a4830 con 0x7f0dbc07ff10 2020-01-16T05:47:34.023 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dc0da3700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0dbc0a4250 0x7f0dbc14fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53308/0 (socket says 172.21.15.84:53308) 2020-01-16T05:47:34.023 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dc0da3700 1 -- 172.21.15.84:0/2882418913 learned_addr learned my addr 172.21.15.84:0/2882418913 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:34.023 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dba59c700 1 --2- 172.21.15.84:0/2882418913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dbc07ff10 0x7f0dbc0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:34.023 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0db9d9b700 1 -- 172.21.15.84:0/2882418913 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718127281 0 0) 0x7f0dbc066880 con 0x7f0dbc0a4250 2020-01-16T05:47:34.023 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0db9d9b700 1 -- 172.21.15.84:0/2882418913 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0da8003230 con 0x7f0dbc0a4250 2020-01-16T05:47:34.023 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0db9d9b700 1 -- 172.21.15.84:0/2882418913 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014855875 0 0) 0x7f0dbc066ab0 con 0x7f0dbc0a9b30 2020-01-16T05:47:34.024 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0db9d9b700 1 -- 172.21.15.84:0/2882418913 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dbc066880 con 0x7f0dbc0a9b30 2020-01-16T05:47:34.024 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dba59c700 1 -- 172.21.15.84:0/2882418913 >> v1:172.21.15.142:6789/0 conn(0x7f0dbc0a9b30 legacy=0x7f0dbc0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:34.024 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dba59c700 1 -- 172.21.15.84:0/2882418913 >> v1:172.21.15.84:6789/0 conn(0x7f0dbc0a4250 legacy=0x7f0dbc14fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:34.024 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dba59c700 1 -- 172.21.15.84:0/2882418913 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc066ce0 con 0x7f0dbc07ff10 2020-01-16T05:47:34.024 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dba59c700 1 --2- 172.21.15.84:0/2882418913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dbc07ff10 0x7f0dbc0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0da4002f30 tx=0x7f0da400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:34.024 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dba59c700 1 --2- 172.21.15.84:0/2882418913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dbc07ff10 0x7f0dbc0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0da4002f30 tx=0x7f0da400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:34.024 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dba59c700 1 --2- 172.21.15.84:0/2882418913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dbc07ff10 0x7f0dbc0abdd0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f0da4002f30 tx=0x7f0da400fd70).ready entity=mon.2 client_cookie=a2e31ddccdf12b82 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:34.024 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dba59c700 1 --2- 172.21.15.84:0/2882418913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dbc07ff10 0x7f0dbc0abdd0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f0da4002f30 tx=0x7f0da400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:34.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0db9d9b700 1 -- 172.21.15.84:0/2882418913 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da4011620 con 0x7f0dbc07ff10 2020-01-16T05:47:34.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dba59c700 1 --2- 172.21.15.84:0/2882418913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dbc07ff10 0x7f0dbc0abdd0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f0da4002f30 tx=0x7f0da400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:34.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dba59c700 1 --2- 172.21.15.84:0/2882418913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dbc07ff10 0x7f0dbc0abdd0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f0da4002f30 tx=0x7f0da400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:34.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0db9d9b700 1 -- 172.21.15.84:0/2882418913 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da4008d40 con 0x7f0dbc07ff10 2020-01-16T05:47:34.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0db9d9b700 1 -- 172.21.15.84:0/2882418913 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da4011c00 con 0x7f0dbc07ff10 2020-01-16T05:47:34.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dbb59e700 1 -- 172.21.15.84:0/2882418913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dbc07ff10 msgr2=0x7f0dbc0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:34.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dbb59e700 1 --2- 172.21.15.84:0/2882418913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dbc07ff10 0x7f0dbc0abdd0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f0da4002f30 tx=0x7f0da400fd70).stop 2020-01-16T05:47:34.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dbb59e700 1 -- 172.21.15.84:0/2882418913 shutdown_connections 2020-01-16T05:47:34.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dbb59e700 1 --2- 172.21.15.84:0/2882418913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dbc07ff10 0x7f0dbc0abdd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:34.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dbb59e700 1 -- 172.21.15.84:0/2882418913 shutdown_connections 2020-01-16T05:47:34.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dbb59e700 1 -- 172.21.15.84:0/2882418913 wait complete. 2020-01-16T05:47:34.027 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dbb59e700 1 -- 172.21.15.84:0/2882418913 >> 172.21.15.84:0/2882418913 conn(0x7f0dbc0acfc0 msgr2=0x7f0dbc0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:34.031 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.020+0000 7f0dbb59e700 1 Processor -- start 2020-01-16T05:47:34.031 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dbb59e700 1 -- start start 2020-01-16T05:47:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dbb59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dbc0a5770 0x7f0dbc125f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dbb59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dbc125130 con 0x7f0dbc135db0 2020-01-16T05:47:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dbb59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dbc1361e0 con 0x7f0dbc124880 2020-01-16T05:47:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dbb59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc125410 con 0x7f0dbc0a5770 2020-01-16T05:47:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dc0da3700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0dbc135db0 0x7f0dbc13d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53314/0 (socket says 172.21.15.84:53314) 2020-01-16T05:47:34.033 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dc0da3700 1 -- 172.21.15.84:0/34199464 learned_addr learned my addr 172.21.15.84:0/34199464 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:34.033 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dbad9d700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dbc0a5770 0x7f0dbc125f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:34.033 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216395757 0 0) 0x7f0dbc125130 con 0x7f0dbc135db0 2020-01-16T05:47:34.033 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0da0003230 con 0x7f0dbc135db0 2020-01-16T05:47:34.033 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374294445 0 0) 0x7f0dbc1361e0 con 0x7f0dbc124880 2020-01-16T05:47:34.033 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dbc125130 con 0x7f0dbc124880 2020-01-16T05:47:34.033 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2712198503 0 0) 0x7f0da0003230 con 0x7f0dbc135db0 2020-01-16T05:47:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0dbc1361e0 con 0x7f0dbc135db0 2020-01-16T05:47:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f0dac001800 con 0x7f0dbc135db0 2020-01-16T05:47:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dbc0a5770 msgr2=0x7f0dbc125f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dbc0a5770 0x7f0dbc125f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 >> v1:172.21.15.142:6789/0 conn(0x7f0dbc124880 legacy=0x7f0dbc09efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 >> v1:172.21.15.84:6789/0 conn(0x7f0dbc135db0 legacy=0x7f0dbc13d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0da0003c30 0x7f0da00045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:34.035 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0da0004130 0x7f0da0004b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:34.035 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0da00097e0 0x7f0da000bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:34.035 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc125410 con 0x7f0da00097e0 2020-01-16T05:47:34.035 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da000c170 con 0x7f0da0004130 2020-01-16T05:47:34.035 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da000c330 con 0x7f0da0003c30 2020-01-16T05:47:34.035 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dbad9d700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dbc0a5770 0x7f0dbc125f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:47:34.035 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dc0da3700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0da00097e0 0x7f0da000bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:34.036 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dba59c700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0da0004130 0x7f0da0004b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:34.036 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dbad9d700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0da0003c30 0x7f0da00045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:34.036 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dc0da3700 1 -- 172.21.15.84:0/34199464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0da0003c30 msgr2=0x7f0da00045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:34.036 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dc0da3700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0da0003c30 0x7f0da00045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:34.036 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dc0da3700 1 -- 172.21.15.84:0/34199464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0da0004130 msgr2=0x7f0da0004b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:34.037 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dc0da3700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0da0004130 0x7f0da0004b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:34.037 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dc0da3700 1 -- 172.21.15.84:0/34199464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc0ab090 con 0x7f0da00097e0 2020-01-16T05:47:34.037 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dbb59e700 1 -- 172.21.15.84:0/34199464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dbc136410 con 0x7f0da00097e0 2020-01-16T05:47:34.037 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dbad9d700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0da0003c30 0x7f0da00045a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:47:34.037 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dbb59e700 1 -- 172.21.15.84:0/34199464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dbc0a5770 con 0x7f0da00097e0 2020-01-16T05:47:34.037 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dc0da3700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0da00097e0 0x7f0da000bc20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0dac000fc0 tx=0x7f0dac0115c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:34.037 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dc0da3700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0da00097e0 0x7f0da000bc20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0dac000fc0 tx=0x7f0dac0115c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dc0da3700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0da00097e0 0x7f0da000bc20 secure :-1 s=READY pgs=433 cs=0 l=1 rx=0x7f0dac000fc0 tx=0x7f0dac0115c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dc0da3700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0da00097e0 0x7f0da000bc20 secure :-1 s=THROTTLE_DONE pgs=433 cs=0 l=1 rx=0x7f0dac000fc0 tx=0x7f0dac0115c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dc0da3700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0da00097e0 0x7f0da000bc20 secure :-1 s=THROTTLE_DONE pgs=433 cs=0 l=1 rx=0x7f0dac000fc0 tx=0x7f0dac0115c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dac0045b0 con 0x7f0da00097e0 2020-01-16T05:47:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dc0da3700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0da00097e0 0x7f0da000bc20 secure :-1 s=THROTTLE_DONE pgs=433 cs=0 l=1 rx=0x7f0dac000fc0 tx=0x7f0dac0115c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac011b90 con 0x7f0da00097e0 2020-01-16T05:47:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dac004bd0 con 0x7f0da00097e0 2020-01-16T05:47:34.039 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.024+0000 7f0dbb59e700 1 -- 172.21.15.84:0/34199464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d94003360 con 0x7f0da00097e0 2020-01-16T05:47:34.039 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.028+0000 7f0dc0da3700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0da00097e0 0x7f0da000bc20 secure :-1 s=THROTTLE_DONE pgs=433 cs=0 l=1 rx=0x7f0dac000fc0 tx=0x7f0dac0115c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:34.039 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.028+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f0dac006180 con 0x7f0da00097e0 2020-01-16T05:47:34.039 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.028+0000 7f0dc0da3700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0da00097e0 0x7f0da000bc20 secure :-1 s=THROTTLE_DONE pgs=433 cs=0 l=1 rx=0x7f0dac000fc0 tx=0x7f0dac0115c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:34.039 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.028+0000 7f0db37fe700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0da00455d0 0x7f0da0047ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:34.039 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.028+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f0dac04ce20 con 0x7f0da00097e0 2020-01-16T05:47:34.039 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.028+0000 7f0dbad9d700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0da00455d0 0x7f0da0047ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:34.040 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.028+0000 7f0dbad9d700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0da00455d0 0x7f0da0047ae0 crc :-1 s=READY pgs=169 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:34.040 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.032+0000 7f0dc0da3700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0da00097e0 0x7f0da000bc20 secure :-1 s=THROTTLE_DONE pgs=433 cs=0 l=1 rx=0x7f0dac000fc0 tx=0x7f0dac0115c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:34.040 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.032+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f0dbc136410 con 0x7f0da00097e0 2020-01-16T05:47:34.182 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.180+0000 7f0dbb59e700 1 -- 172.21.15.84:0/34199464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d94003790 con 0x7f0da00097e0 2020-01-16T05:47:34.183 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.184+0000 7f0dc0da3700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0da00097e0 0x7f0da000bc20 secure :-1 s=THROTTLE_DONE pgs=433 cs=0 l=1 rx=0x7f0dac000fc0 tx=0x7f0dac0115c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:34.183 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.184+0000 7f0db37fe700 1 -- 172.21.15.84:0/34199464 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f0dac033420 con 0x7f0da00097e0 2020-01-16T05:47:34.183 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:34.183 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:34.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.184+0000 7f0dbb59e700 1 -- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0da00455d0 msgr2=0x7f0da0047ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:34.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.184+0000 7f0dbb59e700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f0da00455d0 0x7f0da0047ae0 crc :-1 s=READY pgs=169 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:34.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.184+0000 7f0dc0da3700 1 -- 172.21.15.84:0/34199464 reap_dead start 2020-01-16T05:47:34.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.184+0000 7f0dbb59e700 1 -- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0da00097e0 msgr2=0x7f0da000bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:34.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.184+0000 7f0dbb59e700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0da00097e0 0x7f0da000bc20 secure :-1 s=READY pgs=433 cs=0 l=1 rx=0x7f0dac000fc0 tx=0x7f0dac0115c0).stop 2020-01-16T05:47:34.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.184+0000 7f0dbb59e700 1 -- 172.21.15.84:0/34199464 shutdown_connections 2020-01-16T05:47:34.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.184+0000 7f0dbb59e700 1 --2- 172.21.15.84:0/34199464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0da00097e0 0x7f0da000bc20 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:34.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.184+0000 7f0dbb59e700 1 -- 172.21.15.84:0/34199464 shutdown_connections 2020-01-16T05:47:34.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.184+0000 7f0dbb59e700 1 -- 172.21.15.84:0/34199464 wait complete. 2020-01-16T05:47:34.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:34.184+0000 7f0dbb59e700 1 -- 172.21.15.84:0/34199464 >> 172.21.15.84:0/34199464 conn(0x7f0dbc07e1b0 msgr2=0x7f0dbc024ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:34.187 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:34.197 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:47:36.198 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:36.331 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b52e8a700 1 Processor -- start 2020-01-16T05:47:36.331 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b52e8a700 1 -- start start 2020-01-16T05:47:36.331 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b52e8a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2b4c05b0f0 0x7f2b4c0a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:36.332 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b52e8a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4c07cd60 con 0x7f2b4c08fd80 2020-01-16T05:47:36.332 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b52e8a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4c08f570 con 0x7f2b4c0a2f60 2020-01-16T05:47:36.332 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b52e8a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4c0a3390 con 0x7f2b4c05b0f0 2020-01-16T05:47:36.332 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b50c26700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2b4c05b0f0 0x7f2b4c0a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:36.332 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b51c28700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2b4c08fd80 0x7f2b4c1503f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53332/0 (socket says 172.21.15.84:53332) 2020-01-16T05:47:36.332 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b51c28700 1 -- 172.21.15.84:0/1323336431 learned_addr learned my addr 172.21.15.84:0/1323336431 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:36.332 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b50c26700 1 -- 172.21.15.84:0/1323336431 >> v1:172.21.15.142:6789/0 conn(0x7f2b4c0a2f60 legacy=0x7f2b4c07c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:36.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b50c26700 1 -- 172.21.15.84:0/1323336431 >> v1:172.21.15.84:6789/0 conn(0x7f2b4c08fd80 legacy=0x7f2b4c1503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:36.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b50c26700 1 -- 172.21.15.84:0/1323336431 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c05b520 con 0x7f2b4c05b0f0 2020-01-16T05:47:36.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b50c26700 1 --2- 172.21.15.84:0/1323336431 >> v2:172.21.15.84:3300/0 conn(0x7f2b4c05b0f0 0x7f2b4c0a8ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2b40002f30 tx=0x7f2b4000fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:36.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b50c26700 1 --2- 172.21.15.84:0/1323336431 >> v2:172.21.15.84:3300/0 conn(0x7f2b4c05b0f0 0x7f2b4c0a8ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2b40002f30 tx=0x7f2b4000fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:36.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b50c26700 1 --2- 172.21.15.84:0/1323336431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4c05b0f0 0x7f2b4c0a8ff0 secure :-1 s=READY pgs=435 cs=0 l=1 rx=0x7f2b40002f30 tx=0x7f2b4000fd70).ready entity=mon.0 client_cookie=d2108c3eb08fed87 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:36.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b50c26700 1 --2- 172.21.15.84:0/1323336431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4c05b0f0 0x7f2b4c0a8ff0 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7f2b40002f30 tx=0x7f2b4000fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:36.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b4bfff700 1 -- 172.21.15.84:0/1323336431 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b400115a0 con 0x7f2b4c05b0f0 2020-01-16T05:47:36.334 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b50c26700 1 --2- 172.21.15.84:0/1323336431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4c05b0f0 0x7f2b4c0a8ff0 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7f2b40002f30 tx=0x7f2b4000fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:36.334 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b4bfff700 1 -- 172.21.15.84:0/1323336431 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b40008d40 con 0x7f2b4c05b0f0 2020-01-16T05:47:36.334 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b50c26700 1 --2- 172.21.15.84:0/1323336431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4c05b0f0 0x7f2b4c0a8ff0 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7f2b40002f30 tx=0x7f2b4000fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:36.334 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b52e8a700 1 -- 172.21.15.84:0/1323336431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4c05b0f0 msgr2=0x7f2b4c0a8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:36.334 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b52e8a700 1 --2- 172.21.15.84:0/1323336431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4c05b0f0 0x7f2b4c0a8ff0 secure :-1 s=READY pgs=435 cs=0 l=1 rx=0x7f2b40002f30 tx=0x7f2b4000fd70).stop 2020-01-16T05:47:36.334 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b4bfff700 1 -- 172.21.15.84:0/1323336431 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b40011b80 con 0x7f2b4c05b0f0 2020-01-16T05:47:36.334 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b52e8a700 1 -- 172.21.15.84:0/1323336431 shutdown_connections 2020-01-16T05:47:36.335 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b52e8a700 1 --2- 172.21.15.84:0/1323336431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4c05b0f0 0x7f2b4c0a8ff0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:36.335 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b52e8a700 1 -- 172.21.15.84:0/1323336431 shutdown_connections 2020-01-16T05:47:36.335 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b52e8a700 1 -- 172.21.15.84:0/1323336431 wait complete. 2020-01-16T05:47:36.335 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.320+0000 7f2b52e8a700 1 -- 172.21.15.84:0/1323336431 >> 172.21.15.84:0/1323336431 conn(0x7f2b4c0abc10 msgr2=0x7f2b4c05a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:36.335 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b52e8a700 1 Processor -- start 2020-01-16T05:47:36.335 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b52e8a700 1 -- start start 2020-01-16T05:47:36.335 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b52e8a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2b4c128700 0x7f2b4c09fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:36.336 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b52e8a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4c0a1e50 con 0x7f2b4c148c90 2020-01-16T05:47:36.336 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b52e8a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4c148080 con 0x7f2b4c147c50 2020-01-16T05:47:36.336 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b52e8a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4c149280 con 0x7f2b4c128700 2020-01-16T05:47:36.336 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b51427700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2b4c148c90 0x7f2b4c127f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53334/0 (socket says 172.21.15.84:53334) 2020-01-16T05:47:36.336 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b51427700 1 -- 172.21.15.84:0/1111821991 learned_addr learned my addr 172.21.15.84:0/1111821991 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:36.337 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b50c26700 1 --2- 172.21.15.84:0/1111821991 >> v2:172.21.15.142:3300/0 conn(0x7f2b4c128700 0x7f2b4c09fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:36.337 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b49ffb700 1 -- 172.21.15.84:0/1111821991 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952214784 0 0) 0x7f2b4c0a1e50 con 0x7f2b4c148c90 2020-01-16T05:47:36.337 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b49ffb700 1 -- 172.21.15.84:0/1111821991 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b2c003230 con 0x7f2b4c148c90 2020-01-16T05:47:36.337 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b49ffb700 1 -- 172.21.15.84:0/1111821991 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 859552777 0 0) 0x7f2b2c003230 con 0x7f2b4c148c90 2020-01-16T05:47:36.337 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b49ffb700 1 -- 172.21.15.84:0/1111821991 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2b4c0a1e50 con 0x7f2b4c148c90 2020-01-16T05:47:36.337 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b49ffb700 1 -- 172.21.15.84:0/1111821991 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f2b44001de0 con 0x7f2b4c148c90 2020-01-16T05:47:36.337 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b49ffb700 1 -- 172.21.15.84:0/1111821991 >> v2:172.21.15.142:3300/0 conn(0x7f2b4c128700 msgr2=0x7f2b4c09fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:36.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b49ffb700 1 --2- 172.21.15.84:0/1111821991 >> v2:172.21.15.142:3300/0 conn(0x7f2b4c128700 0x7f2b4c09fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:36.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b49ffb700 1 -- 172.21.15.84:0/1111821991 >> v1:172.21.15.142:6789/0 conn(0x7f2b4c147c50 legacy=0x7f2b4c132910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:36.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b49ffb700 1 -- 172.21.15.84:0/1111821991 >> v1:172.21.15.84:6789/0 conn(0x7f2b4c148c90 legacy=0x7f2b4c127f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:36.350 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b49ffb700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c003a20 0x7f2b2c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:36.350 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b49ffb700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b2c0045a0 0x7f2b2c0049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:36.350 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b49ffb700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b2c005010 0x7f2b2c00b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:36.350 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b49ffb700 1 -- 172.21.15.84:0/1111821991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c149280 con 0x7f2b2c003a20 2020-01-16T05:47:36.350 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b49ffb700 1 -- 172.21.15.84:0/1111821991 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c00bdc0 con 0x7f2b2c005010 2020-01-16T05:47:36.350 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b49ffb700 1 -- 172.21.15.84:0/1111821991 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c00c000 con 0x7f2b2c0045a0 2020-01-16T05:47:36.350 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b50c26700 1 --2- 172.21.15.84:0/1111821991 >> v2:172.21.15.142:3300/0 conn(0x7f2b4c128700 0x7f2b4c09fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:47:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b51427700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c003a20 0x7f2b2c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b51c28700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b2c005010 0x7f2b2c00b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b50c26700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b2c0045a0 0x7f2b2c0049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b51427700 1 -- 172.21.15.84:0/1111821991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b2c0045a0 msgr2=0x7f2b2c0049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b51427700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b2c0045a0 0x7f2b2c0049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b51427700 1 -- 172.21.15.84:0/1111821991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b2c005010 msgr2=0x7f2b2c00b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b51427700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b2c005010 0x7f2b2c00b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b51427700 1 -- 172.21.15.84:0/1111821991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c136140 con 0x7f2b2c003a20 2020-01-16T05:47:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b51c28700 1 -- 172.21.15.84:0/1111821991 reap_dead start 2020-01-16T05:47:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b52e8a700 1 -- 172.21.15.84:0/1111821991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4c147c50 con 0x7f2b2c003a20 2020-01-16T05:47:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b52e8a700 1 -- 172.21.15.84:0/1111821991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c09fbd0 con 0x7f2b2c003a20 2020-01-16T05:47:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.324+0000 7f2b51427700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c003a20 0x7f2b2c003e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b440020a0 tx=0x7f2b44011b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.328+0000 7f2b51427700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c003a20 0x7f2b2c003e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b440020a0 tx=0x7f2b44011b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.328+0000 7f2b51427700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c003a20 0x7f2b2c003e70 secure :-1 s=READY pgs=437 cs=0 l=1 rx=0x7f2b440020a0 tx=0x7f2b44011b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:36.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.328+0000 7f2b51427700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c003a20 0x7f2b2c003e70 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f2b440020a0 tx=0x7f2b44011b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:36.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.328+0000 7f2b49ffb700 1 -- 172.21.15.84:0/1111821991 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b44009e00 con 0x7f2b2c003a20 2020-01-16T05:47:36.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.328+0000 7f2b51427700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c003a20 0x7f2b2c003e70 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f2b440020a0 tx=0x7f2b44011b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:36.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.328+0000 7f2b49ffb700 1 -- 172.21.15.84:0/1111821991 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b44009a20 con 0x7f2b2c003a20 2020-01-16T05:47:36.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.328+0000 7f2b51427700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c003a20 0x7f2b2c003e70 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f2b440020a0 tx=0x7f2b44011b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.328+0000 7f2b49ffb700 1 -- 172.21.15.84:0/1111821991 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b44006cc0 con 0x7f2b2c003a20 2020-01-16T05:47:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.328+0000 7f2b51427700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c003a20 0x7f2b2c003e70 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f2b440020a0 tx=0x7f2b44011b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.328+0000 7f2b52e8a700 1 -- 172.21.15.84:0/1111821991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b24003360 con 0x7f2b2c003a20 2020-01-16T05:47:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.328+0000 7f2b49ffb700 1 -- 172.21.15.84:0/1111821991 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f2b440134d0 con 0x7f2b2c003a20 2020-01-16T05:47:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.328+0000 7f2b51427700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c003a20 0x7f2b2c003e70 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f2b440020a0 tx=0x7f2b44011b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.328+0000 7f2b49ffb700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f2b2c03fea0 0x7f2b2c0423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.328+0000 7f2b49ffb700 1 -- 172.21.15.84:0/1111821991 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f2b4404d5f0 con 0x7f2b2c003a20 2020-01-16T05:47:36.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.328+0000 7f2b50c26700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f2b2c03fea0 0x7f2b2c0423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:36.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.328+0000 7f2b50c26700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f2b2c03fea0 0x7f2b2c0423b0 crc :-1 s=READY pgs=170 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:36.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.332+0000 7f2b51427700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c003a20 0x7f2b2c003e70 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f2b440020a0 tx=0x7f2b44011b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:36.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.332+0000 7f2b49ffb700 1 -- 172.21.15.84:0/1111821991 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f2b44033bf0 con 0x7f2b2c003a20 2020-01-16T05:47:36.482 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.484+0000 7f2b52e8a700 1 -- 172.21.15.84:0/1111821991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b24003790 con 0x7f2b2c003a20 2020-01-16T05:47:36.483 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.484+0000 7f2b51427700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c003a20 0x7f2b2c003e70 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f2b440020a0 tx=0x7f2b44011b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:36.483 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.484+0000 7f2b49ffb700 1 -- 172.21.15.84:0/1111821991 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f2b44033e50 con 0x7f2b2c003a20 2020-01-16T05:47:36.484 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:36.484 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:36.486 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.484+0000 7f2b52e8a700 1 -- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f2b2c03fea0 msgr2=0x7f2b2c0423b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:36.486 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.484+0000 7f2b52e8a700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f2b2c03fea0 0x7f2b2c0423b0 crc :-1 s=READY pgs=170 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:36.486 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.484+0000 7f2b52e8a700 1 -- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c003a20 msgr2=0x7f2b2c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:36.486 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.484+0000 7f2b52e8a700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c003a20 0x7f2b2c003e70 secure :-1 s=READY pgs=437 cs=0 l=1 rx=0x7f2b440020a0 tx=0x7f2b44011b50).stop 2020-01-16T05:47:36.486 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.484+0000 7f2b52e8a700 1 -- 172.21.15.84:0/1111821991 shutdown_connections 2020-01-16T05:47:36.487 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.484+0000 7f2b52e8a700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f2b2c03fea0 0x7f2b2c0423b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:36.487 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.484+0000 7f2b52e8a700 1 --2- 172.21.15.84:0/1111821991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c003a20 0x7f2b2c003e70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:36.487 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.484+0000 7f2b52e8a700 1 -- 172.21.15.84:0/1111821991 shutdown_connections 2020-01-16T05:47:36.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.484+0000 7f2b52e8a700 1 -- 172.21.15.84:0/1111821991 wait complete. 2020-01-16T05:47:36.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:36.484+0000 7f2b52e8a700 1 -- 172.21.15.84:0/1111821991 >> 172.21.15.84:0/1111821991 conn(0x7f2b4c0a87b0 msgr2=0x7f2b4c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:36.495 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:36.502 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:37.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~190s 2020-01-16T05:47:38.503 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe397153700 1 Processor -- start 2020-01-16T05:47:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe397153700 1 -- start start 2020-01-16T05:47:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe397153700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe3900a4250 0x7fe3900abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe397153700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe390066880 con 0x7fe3900a9b30 2020-01-16T05:47:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe397153700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe390066ab0 con 0x7fe39007ff10 2020-01-16T05:47:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe397153700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3900a4830 con 0x7fe3900a4250 2020-01-16T05:47:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe396952700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe3900a9b30 0x7fe3900a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53354/0 (socket says 172.21.15.84:53354) 2020-01-16T05:47:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe396952700 1 -- 172.21.15.84:0/549538771 learned_addr learned my addr 172.21.15.84:0/549538771 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe3983b5700 1 --2- 172.21.15.84:0/549538771 >> v2:172.21.15.142:3300/0 conn(0x7fe3900a4250 0x7fe3900abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe395950700 1 -- 172.21.15.84:0/549538771 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252131117 0 0) 0x7fe390066880 con 0x7fe3900a9b30 2020-01-16T05:47:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe395950700 1 -- 172.21.15.84:0/549538771 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe37c003230 con 0x7fe3900a9b30 2020-01-16T05:47:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe395950700 1 -- 172.21.15.84:0/549538771 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370644060 0 0) 0x7fe390066ab0 con 0x7fe39007ff10 2020-01-16T05:47:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe395950700 1 -- 172.21.15.84:0/549538771 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe390066880 con 0x7fe39007ff10 2020-01-16T05:47:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe395950700 1 -- 172.21.15.84:0/549538771 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2893243832 0 0) 0x7fe37c003230 con 0x7fe3900a9b30 2020-01-16T05:47:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe3983b5700 1 -- 172.21.15.84:0/549538771 >> v1:172.21.15.142:6789/0 conn(0x7fe39007ff10 legacy=0x7fe39014dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe3983b5700 1 -- 172.21.15.84:0/549538771 >> v1:172.21.15.84:6789/0 conn(0x7fe3900a9b30 legacy=0x7fe3900a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe3983b5700 1 -- 172.21.15.84:0/549538771 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe390066ce0 con 0x7fe3900a4250 2020-01-16T05:47:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe3983b5700 1 --2- 172.21.15.84:0/549538771 >> v2:172.21.15.142:3300/0 conn(0x7fe3900a4250 0x7fe3900abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe388008910 tx=0x7fe38c001cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe3983b5700 1 --2- 172.21.15.84:0/549538771 >> v2:172.21.15.142:3300/0 conn(0x7fe3900a4250 0x7fe3900abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe388008910 tx=0x7fe38c001cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.624+0000 7fe3983b5700 1 --2- 172.21.15.84:0/549538771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3900a4250 0x7fe3900abdd0 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7fe388008910 tx=0x7fe38c001cd0).ready entity=mon.1 client_cookie=b44ce99a79c85c4b server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.628+0000 7fe3983b5700 1 --2- 172.21.15.84:0/549538771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3900a4250 0x7fe3900abdd0 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7fe388008910 tx=0x7fe38c001cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.628+0000 7fe395950700 1 -- 172.21.15.84:0/549538771 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe38c001ad0 con 0x7fe3900a4250 2020-01-16T05:47:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.628+0000 7fe3983b5700 1 --2- 172.21.15.84:0/549538771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3900a4250 0x7fe3900abdd0 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7fe388008910 tx=0x7fe38c001cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.628+0000 7fe3983b5700 1 --2- 172.21.15.84:0/549538771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3900a4250 0x7fe3900abdd0 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7fe388008910 tx=0x7fe38c001cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.628+0000 7fe395950700 1 -- 172.21.15.84:0/549538771 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c0018e0 con 0x7fe3900a4250 2020-01-16T05:47:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.628+0000 7fe395950700 1 -- 172.21.15.84:0/549538771 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3880116d0 con 0x7fe3900a4250 2020-01-16T05:47:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.628+0000 7fe397153700 1 -- 172.21.15.84:0/549538771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3900a4250 msgr2=0x7fe3900abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:38.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.628+0000 7fe397153700 1 --2- 172.21.15.84:0/549538771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3900a4250 0x7fe3900abdd0 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7fe388008910 tx=0x7fe38c001cd0).stop 2020-01-16T05:47:38.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.628+0000 7fe397153700 1 -- 172.21.15.84:0/549538771 shutdown_connections 2020-01-16T05:47:38.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.628+0000 7fe397153700 1 --2- 172.21.15.84:0/549538771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3900a4250 0x7fe3900abdd0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:38.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.628+0000 7fe397153700 1 -- 172.21.15.84:0/549538771 shutdown_connections 2020-01-16T05:47:38.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.628+0000 7fe397153700 1 -- 172.21.15.84:0/549538771 wait complete. 2020-01-16T05:47:38.640 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.628+0000 7fe397153700 1 -- 172.21.15.84:0/549538771 >> 172.21.15.84:0/549538771 conn(0x7fe3900acfc0 msgr2=0x7fe3900a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:38.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.628+0000 7fe397153700 1 Processor -- start 2020-01-16T05:47:38.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.628+0000 7fe397153700 1 -- start start 2020-01-16T05:47:38.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe397153700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe390062550 0x7fe390064110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:38.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe397153700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3900a90b0 con 0x7fe390061140 2020-01-16T05:47:38.641 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe397153700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe390061570 con 0x7fe390136b80 2020-01-16T05:47:38.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe397153700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe390062b50 con 0x7fe390062550 2020-01-16T05:47:38.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe396952700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe390062550 0x7fe390064110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:38.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe396151700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe390061140 0x7fe390136380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53360/0 (socket says 172.21.15.84:53360) 2020-01-16T05:47:38.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe396952700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe390062550 0x7fe390064110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36160/0 (socket says 172.21.15.84:36160) 2020-01-16T05:47:38.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe396151700 1 -- 172.21.15.84:0/1178702928 learned_addr learned my addr 172.21.15.84:0/1178702928 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:38.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe396952700 1 -- 172.21.15.84:0/1178702928 >> v1:172.21.15.142:6789/0 conn(0x7fe390136b80 legacy=0x7fe39013d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:38.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe396952700 1 -- 172.21.15.84:0/1178702928 >> v1:172.21.15.84:6789/0 conn(0x7fe390061140 legacy=0x7fe390136380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:38.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe3877fe700 1 -- 172.21.15.84:0/1178702928 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 214798003 0 0) 0x7fe3900a90b0 con 0x7fe390061140 2020-01-16T05:47:38.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe396952700 1 -- 172.21.15.84:0/1178702928 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3900ab090 con 0x7fe390062550 2020-01-16T05:47:38.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe396952700 1 --2- 172.21.15.84:0/1178702928 >> v2:172.21.15.84:3300/0 conn(0x7fe390062550 0x7fe390064110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe38c001320 tx=0x7fe38c00c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:38.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe396952700 1 --2- 172.21.15.84:0/1178702928 >> v2:172.21.15.84:3300/0 conn(0x7fe390062550 0x7fe390064110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe38c001320 tx=0x7fe38c00c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:38.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe396952700 1 --2- 172.21.15.84:0/1178702928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe390062550 0x7fe390064110 secure :-1 s=READY pgs=440 cs=0 l=1 rx=0x7fe38c001320 tx=0x7fe38c00c910).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:38.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe396952700 1 --2- 172.21.15.84:0/1178702928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe390062550 0x7fe390064110 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7fe38c001320 tx=0x7fe38c00c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:38.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe3877fe700 1 -- 172.21.15.84:0/1178702928 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe38c004b20 con 0x7fe390062550 2020-01-16T05:47:38.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe396952700 1 --2- 172.21.15.84:0/1178702928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe390062550 0x7fe390064110 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7fe38c001320 tx=0x7fe38c00c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:38.644 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe3877fe700 1 -- 172.21.15.84:0/1178702928 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c00cd80 con 0x7fe390062550 2020-01-16T05:47:38.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe397153700 1 -- 172.21.15.84:0/1178702928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe390136fb0 con 0x7fe390062550 2020-01-16T05:47:38.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe396952700 1 --2- 172.21.15.84:0/1178702928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe390062550 0x7fe390064110 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7fe38c001320 tx=0x7fe38c00c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:38.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe3877fe700 1 -- 172.21.15.84:0/1178702928 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe38c00d2b0 con 0x7fe390062550 2020-01-16T05:47:38.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe397153700 1 -- 172.21.15.84:0/1178702928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39013f190 con 0x7fe390062550 2020-01-16T05:47:38.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe396952700 1 --2- 172.21.15.84:0/1178702928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe390062550 0x7fe390064110 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7fe38c001320 tx=0x7fe38c00c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:38.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.632+0000 7fe397153700 1 -- 172.21.15.84:0/1178702928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39005e1c0 con 0x7fe390062550 2020-01-16T05:47:38.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.636+0000 7fe3877fe700 1 -- 172.21.15.84:0/1178702928 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fe38c00d590 con 0x7fe390062550 2020-01-16T05:47:38.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.636+0000 7fe396952700 1 --2- 172.21.15.84:0/1178702928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe390062550 0x7fe390064110 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7fe38c001320 tx=0x7fe38c00c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:38.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.636+0000 7fe3877fe700 1 --2- 172.21.15.84:0/1178702928 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe37803c1a0 0x7fe37803e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:38.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.636+0000 7fe3877fe700 1 -- 172.21.15.84:0/1178702928 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fe38c04cb40 con 0x7fe390062550 2020-01-16T05:47:38.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.636+0000 7fe396151700 1 --2- 172.21.15.84:0/1178702928 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe37803c1a0 0x7fe37803e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:38.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.636+0000 7fe396151700 1 --2- 172.21.15.84:0/1178702928 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe37803c1a0 0x7fe37803e6b0 crc :-1 s=READY pgs=171 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:38.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.644+0000 7fe396952700 1 --2- 172.21.15.84:0/1178702928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe390062550 0x7fe390064110 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7fe38c001320 tx=0x7fe38c00c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:38.649 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.644+0000 7fe3877fe700 1 -- 172.21.15.84:0/1178702928 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fe38c033140 con 0x7fe390062550 2020-01-16T05:47:38.794 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.792+0000 7fe397153700 1 -- 172.21.15.84:0/1178702928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe390061fe0 con 0x7fe390062550 2020-01-16T05:47:38.795 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.796+0000 7fe396952700 1 --2- 172.21.15.84:0/1178702928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe390062550 0x7fe390064110 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7fe38c001320 tx=0x7fe38c00c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:38.795 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.796+0000 7fe3877fe700 1 -- 172.21.15.84:0/1178702928 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fe38c0333a0 con 0x7fe390062550 2020-01-16T05:47:38.795 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:38.795 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:38.797 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.796+0000 7fe397153700 1 -- 172.21.15.84:0/1178702928 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe37803c1a0 msgr2=0x7fe37803e6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:38.797 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.796+0000 7fe397153700 1 --2- 172.21.15.84:0/1178702928 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe37803c1a0 0x7fe37803e6b0 crc :-1 s=READY pgs=171 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:38.797 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.796+0000 7fe397153700 1 -- 172.21.15.84:0/1178702928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe390062550 msgr2=0x7fe390064110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:38.797 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.796+0000 7fe397153700 1 --2- 172.21.15.84:0/1178702928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe390062550 0x7fe390064110 secure :-1 s=READY pgs=440 cs=0 l=1 rx=0x7fe38c001320 tx=0x7fe38c00c910).stop 2020-01-16T05:47:38.797 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.796+0000 7fe397153700 1 -- 172.21.15.84:0/1178702928 shutdown_connections 2020-01-16T05:47:38.797 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.796+0000 7fe397153700 1 --2- 172.21.15.84:0/1178702928 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe37803c1a0 0x7fe37803e6b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:38.798 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.796+0000 7fe397153700 1 --2- 172.21.15.84:0/1178702928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe390062550 0x7fe390064110 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:38.798 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.796+0000 7fe397153700 1 -- 172.21.15.84:0/1178702928 shutdown_connections 2020-01-16T05:47:38.798 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.796+0000 7fe397153700 1 -- 172.21.15.84:0/1178702928 wait complete. 2020-01-16T05:47:38.798 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:38.796+0000 7fe397153700 1 -- 172.21.15.84:0/1178702928 >> 172.21.15.84:0/1178702928 conn(0x7fe3900ab6b0 msgr2=0x7fe3900246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:38.798 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:38.808 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:40.810 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:40.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.924+0000 7faa6740f700 1 Processor -- start 2020-01-16T05:47:40.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa6740f700 1 -- start start 2020-01-16T05:47:40.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa6740f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faa600a9b30 0x7faa600abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:40.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa6740f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa60066880 con 0x7faa6007ff10 2020-01-16T05:47:40.931 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa6740f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa60066ab0 con 0x7faa600a4250 2020-01-16T05:47:40.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa6740f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa600a4830 con 0x7faa600a9b30 2020-01-16T05:47:40.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa6640d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faa6007ff10 0x7faa600a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53368/0 (socket says 172.21.15.84:53368) 2020-01-16T05:47:40.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa6640d700 1 -- 172.21.15.84:0/1822807402 learned_addr learned my addr 172.21.15.84:0/1822807402 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:40.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa66c0e700 1 --2- 172.21.15.84:0/1822807402 >> v2:172.21.15.142:3300/0 conn(0x7faa600a9b30 0x7faa600abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:40.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa65c0c700 1 -- 172.21.15.84:0/1822807402 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388399998 0 0) 0x7faa60066880 con 0x7faa6007ff10 2020-01-16T05:47:40.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa65c0c700 1 -- 172.21.15.84:0/1822807402 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa4c003230 con 0x7faa6007ff10 2020-01-16T05:47:40.932 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa65c0c700 1 -- 172.21.15.84:0/1822807402 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 281396416 0 0) 0x7faa4c003230 con 0x7faa6007ff10 2020-01-16T05:47:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa65c0c700 1 -- 172.21.15.84:0/1822807402 >> v2:172.21.15.142:3300/0 conn(0x7faa600a9b30 msgr2=0x7faa600abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa65c0c700 1 --2- 172.21.15.84:0/1822807402 >> v2:172.21.15.142:3300/0 conn(0x7faa600a9b30 0x7faa600abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa65c0c700 1 -- 172.21.15.84:0/1822807402 >> v1:172.21.15.142:6789/0 conn(0x7faa600a4250 legacy=0x7faa6014fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa65c0c700 1 -- 172.21.15.84:0/1822807402 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa60066ce0 con 0x7faa6007ff10 2020-01-16T05:47:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa65c0c700 1 -- 172.21.15.84:0/1822807402 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7faa50001750 con 0x7faa6007ff10 2020-01-16T05:47:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa65c0c700 1 -- 172.21.15.84:0/1822807402 >> v1:172.21.15.84:6789/0 conn(0x7faa6007ff10 legacy=0x7faa600a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa65c0c700 1 --2- 172.21.15.84:0/1822807402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa4c003860 0x7faa4c003cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa65c0c700 1 --2- 172.21.15.84:0/1822807402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa4c0045a0 0x7faa4c0049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa65c0c700 1 --2- 172.21.15.84:0/1822807402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa4c004f20 0x7faa4c00b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa65c0c700 1 -- 172.21.15.84:0/1822807402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa600a4830 con 0x7faa4c004f20 2020-01-16T05:47:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa65c0c700 1 -- 172.21.15.84:0/1822807402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c04fde0 con 0x7faa4c0045a0 2020-01-16T05:47:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa65c0c700 1 -- 172.21.15.84:0/1822807402 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c050020 con 0x7faa4c003860 2020-01-16T05:47:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa68671700 1 --2- 172.21.15.84:0/1822807402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa4c004f20 0x7faa4c00b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa6640d700 1 --2- 172.21.15.84:0/1822807402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa4c0045a0 0x7faa4c0049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:40.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa66c0e700 1 --2- 172.21.15.84:0/1822807402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa4c003860 0x7faa4c003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:40.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa68671700 1 -- 172.21.15.84:0/1822807402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa4c003860 msgr2=0x7faa4c003cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:40.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa68671700 1 --2- 172.21.15.84:0/1822807402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa4c003860 0x7faa4c003cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:40.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa68671700 1 -- 172.21.15.84:0/1822807402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa4c0045a0 msgr2=0x7faa4c0049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:40.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa68671700 1 --2- 172.21.15.84:0/1822807402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa4c0045a0 0x7faa4c0049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:40.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa68671700 1 -- 172.21.15.84:0/1822807402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c050320 con 0x7faa4c004f20 2020-01-16T05:47:40.935 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa68671700 1 --2- 172.21.15.84:0/1822807402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa4c004f20 0x7faa4c00b7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faa58001000 tx=0x7faa5800fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:40.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa68671700 1 -- 172.21.15.84:0/1822807402 reap_dead start 2020-01-16T05:47:40.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa68671700 1 --2- 172.21.15.84:0/1822807402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa4c004f20 0x7faa4c00b7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faa58001000 tx=0x7faa5800fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:40.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa68671700 1 --2- 172.21.15.84:0/1822807402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa4c004f20 0x7faa4c00b7f0 secure :-1 s=READY pgs=442 cs=0 l=1 rx=0x7faa58001000 tx=0x7faa5800fe20).ready entity=mon.0 client_cookie=9ae28e29b43f008f server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:40.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa68671700 1 --2- 172.21.15.84:0/1822807402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa4c004f20 0x7faa4c00b7f0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7faa58001000 tx=0x7faa5800fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:40.936 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa65c0c700 1 -- 172.21.15.84:0/1822807402 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa58003540 con 0x7faa4c004f20 2020-01-16T05:47:40.942 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa68671700 1 --2- 172.21.15.84:0/1822807402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa4c004f20 0x7faa4c00b7f0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7faa58001000 tx=0x7faa5800fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:40.942 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa68671700 1 --2- 172.21.15.84:0/1822807402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa4c004f20 0x7faa4c00b7f0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7faa58001000 tx=0x7faa5800fe20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:40.942 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa65c0c700 1 -- 172.21.15.84:0/1822807402 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa58003160 con 0x7faa4c004f20 2020-01-16T05:47:40.942 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa65c0c700 1 -- 172.21.15.84:0/1822807402 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa58003b40 con 0x7faa4c004f20 2020-01-16T05:47:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa6740f700 1 -- 172.21.15.84:0/1822807402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa4c004f20 msgr2=0x7faa4c00b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa6740f700 1 --2- 172.21.15.84:0/1822807402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa4c004f20 0x7faa4c00b7f0 secure :-1 s=READY pgs=442 cs=0 l=1 rx=0x7faa58001000 tx=0x7faa5800fe20).stop 2020-01-16T05:47:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa6740f700 1 -- 172.21.15.84:0/1822807402 shutdown_connections 2020-01-16T05:47:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa6740f700 1 --2- 172.21.15.84:0/1822807402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa4c004f20 0x7faa4c00b7f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa6740f700 1 -- 172.21.15.84:0/1822807402 shutdown_connections 2020-01-16T05:47:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa6740f700 1 -- 172.21.15.84:0/1822807402 wait complete. 2020-01-16T05:47:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.928+0000 7faa6740f700 1 -- 172.21.15.84:0/1822807402 >> 172.21.15.84:0/1822807402 conn(0x7faa600acfc0 msgr2=0x7faa600a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:40.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.932+0000 7faa6740f700 1 Processor -- start 2020-01-16T05:47:40.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.932+0000 7faa6740f700 1 -- start start 2020-01-16T05:47:40.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6740f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faa60090f60 0x7faa600913c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:40.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6740f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa60126140 0x7faa6009f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:40.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6740f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa600a8f80 con 0x7faa6009fa60 2020-01-16T05:47:40.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6740f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa60090550 con 0x7faa60090f60 2020-01-16T05:47:40.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6740f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6005f2a0 con 0x7faa60126140 2020-01-16T05:47:40.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6640d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa60126140 0x7faa6009f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:40.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa66c0e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faa60090f60 0x7faa600913c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:40.948 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa68671700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7faa6009fa60 0x7faa60134a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:51608/0 (socket says 172.21.15.84:51608) 2020-01-16T05:47:40.948 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa68671700 1 -- 172.21.15.84:0/1667501322 learned_addr learned my addr 172.21.15.84:0/1667501322 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:40.948 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa577fe700 1 -- 172.21.15.84:0/1667501322 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083780416 0 0) 0x7faa600a8f80 con 0x7faa6009fa60 2020-01-16T05:47:40.948 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa577fe700 1 -- 172.21.15.84:0/1667501322 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa48003230 con 0x7faa6009fa60 2020-01-16T05:47:40.948 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6640d700 1 -- 172.21.15.84:0/1667501322 >> v2:172.21.15.142:3300/0 conn(0x7faa60090f60 msgr2=0x7faa600913c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:40.948 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6640d700 1 --2- 172.21.15.84:0/1667501322 >> v2:172.21.15.142:3300/0 conn(0x7faa60090f60 0x7faa600913c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:40.948 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6640d700 1 -- 172.21.15.84:0/1667501322 >> v1:172.21.15.142:6789/0 conn(0x7faa6009fa60 legacy=0x7faa60134a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:40.949 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6640d700 1 -- 172.21.15.84:0/1667501322 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa600a6c60 con 0x7faa60126140 2020-01-16T05:47:40.949 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6640d700 1 --2- 172.21.15.84:0/1667501322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa60126140 0x7faa6009f510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faa50001460 tx=0x7faa50010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:40.949 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6640d700 1 --2- 172.21.15.84:0/1667501322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa60126140 0x7faa6009f510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faa50001460 tx=0x7faa50010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:40.949 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6640d700 1 --2- 172.21.15.84:0/1667501322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa60126140 0x7faa6009f510 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7faa50001460 tx=0x7faa50010b60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:40.949 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6640d700 1 --2- 172.21.15.84:0/1667501322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa60126140 0x7faa6009f510 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7faa50001460 tx=0x7faa50010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:40.949 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa577fe700 1 -- 172.21.15.84:0/1667501322 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa50012940 con 0x7faa60126140 2020-01-16T05:47:40.949 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6640d700 1 --2- 172.21.15.84:0/1667501322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa60126140 0x7faa6009f510 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7faa50001460 tx=0x7faa50010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:40.950 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6740f700 1 -- 172.21.15.84:0/1667501322 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa60090190 con 0x7faa60126140 2020-01-16T05:47:40.950 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa577fe700 1 -- 172.21.15.84:0/1667501322 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa50012560 con 0x7faa60126140 2020-01-16T05:47:40.950 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6640d700 1 --2- 172.21.15.84:0/1667501322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa60126140 0x7faa6009f510 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7faa50001460 tx=0x7faa50010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:40.950 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa577fe700 1 -- 172.21.15.84:0/1667501322 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa500044f0 con 0x7faa60126140 2020-01-16T05:47:40.950 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6740f700 1 -- 172.21.15.84:0/1667501322 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa60091910 con 0x7faa60126140 2020-01-16T05:47:40.950 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6640d700 1 --2- 172.21.15.84:0/1667501322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa60126140 0x7faa6009f510 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7faa50001460 tx=0x7faa50010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:40.951 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.936+0000 7faa6740f700 1 -- 172.21.15.84:0/1667501322 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6005e1c0 con 0x7faa60126140 2020-01-16T05:47:40.951 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.940+0000 7faa577fe700 1 -- 172.21.15.84:0/1667501322 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7faa5000eb70 con 0x7faa60126140 2020-01-16T05:47:40.951 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.940+0000 7faa6640d700 1 --2- 172.21.15.84:0/1667501322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa60126140 0x7faa6009f510 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7faa50001460 tx=0x7faa50010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:40.951 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.940+0000 7faa577fe700 1 --2- 172.21.15.84:0/1667501322 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7faa4803c800 0x7faa4803ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:40.951 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.940+0000 7faa577fe700 1 -- 172.21.15.84:0/1667501322 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7faa5004c520 con 0x7faa60126140 2020-01-16T05:47:40.951 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.940+0000 7faa66c0e700 1 --2- 172.21.15.84:0/1667501322 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7faa4803c800 0x7faa4803ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:40.951 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.940+0000 7faa66c0e700 1 --2- 172.21.15.84:0/1667501322 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7faa4803c800 0x7faa4803ed10 crc :-1 s=READY pgs=172 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:40.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.948+0000 7faa6640d700 1 --2- 172.21.15.84:0/1667501322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa60126140 0x7faa6009f510 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7faa50001460 tx=0x7faa50010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:40.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:40.948+0000 7faa577fe700 1 -- 172.21.15.84:0/1667501322 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7faa50001230 con 0x7faa60126140 2020-01-16T05:47:41.100 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:41.100+0000 7faa6740f700 1 -- 172.21.15.84:0/1667501322 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa6005cbc0 con 0x7faa60126140 2020-01-16T05:47:41.101 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:41.100+0000 7faa6640d700 1 --2- 172.21.15.84:0/1667501322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa60126140 0x7faa6009f510 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7faa50001460 tx=0x7faa50010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:41.101 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:41.100+0000 7faa577fe700 1 -- 172.21.15.84:0/1667501322 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7faa50032b20 con 0x7faa60126140 2020-01-16T05:47:41.102 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:41.102 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:41.103 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:41.104+0000 7faa6740f700 1 -- 172.21.15.84:0/1667501322 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7faa4803c800 msgr2=0x7faa4803ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:41.103 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:41.104+0000 7faa6740f700 1 --2- 172.21.15.84:0/1667501322 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7faa4803c800 0x7faa4803ed10 crc :-1 s=READY pgs=172 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:41.103 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:41.104+0000 7faa6740f700 1 -- 172.21.15.84:0/1667501322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa60126140 msgr2=0x7faa6009f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:41.104 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:41.104+0000 7faa6740f700 1 --2- 172.21.15.84:0/1667501322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa60126140 0x7faa6009f510 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7faa50001460 tx=0x7faa50010b60).stop 2020-01-16T05:47:41.104 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:41.104+0000 7faa6740f700 1 -- 172.21.15.84:0/1667501322 shutdown_connections 2020-01-16T05:47:41.104 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:41.104+0000 7faa6740f700 1 --2- 172.21.15.84:0/1667501322 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7faa4803c800 0x7faa4803ed10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:41.104 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:41.104+0000 7faa6740f700 1 --2- 172.21.15.84:0/1667501322 >> v2:172.21.15.142:3300/0 conn(0x7faa60090f60 0x7faa600913c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:41.104 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:41.104+0000 7faa6740f700 1 --2- 172.21.15.84:0/1667501322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa60126140 0x7faa6009f510 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:41.104 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:41.104+0000 7faa6740f700 1 -- 172.21.15.84:0/1667501322 shutdown_connections 2020-01-16T05:47:41.105 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:41.104+0000 7faa6740f700 1 -- 172.21.15.84:0/1667501322 wait complete. 2020-01-16T05:47:41.105 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:41.104+0000 7faa6740f700 1 -- 172.21.15.84:0/1667501322 >> 172.21.15.84:0/1667501322 conn(0x7faa600a6460 msgr2=0x7faa60126f20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:41.105 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:41.117 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:43.119 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:43.248 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a8c78700 1 Processor -- start 2020-01-16T05:47:43.248 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a8c78700 1 -- start start 2020-01-16T05:47:43.248 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a8c78700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f81a40a9b30 0x7f81a40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:43.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a8c78700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a407ff10 0x7f81a4066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:43.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a8c78700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a4066dd0 con 0x7f81a40a4250 2020-01-16T05:47:43.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a8c78700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a40a4830 con 0x7f81a40a9b30 2020-01-16T05:47:43.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a8c78700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a407f9d0 con 0x7f81a407ff10 2020-01-16T05:47:43.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a9eda700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f81a40a4250 0x7f81a40a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53386/0 (socket says 172.21.15.84:53386) 2020-01-16T05:47:43.249 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a9eda700 1 -- 172.21.15.84:0/4105051434 learned_addr learned my addr 172.21.15.84:0/4105051434 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:43.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a37fe700 1 --2- 172.21.15.84:0/4105051434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a407ff10 0x7f81a4066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:43.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a3fff700 1 --2- 172.21.15.84:0/4105051434 >> v2:172.21.15.142:3300/0 conn(0x7f81a40a9b30 0x7f81a40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:43.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a2ffd700 1 -- 172.21.15.84:0/4105051434 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179981439 0 0) 0x7f81a4066dd0 con 0x7f81a40a4250 2020-01-16T05:47:43.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a2ffd700 1 -- 172.21.15.84:0/4105051434 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f818c003230 con 0x7f81a40a4250 2020-01-16T05:47:43.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a2ffd700 1 -- 172.21.15.84:0/4105051434 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3730352675 0 0) 0x7f818c003230 con 0x7f81a40a4250 2020-01-16T05:47:43.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a2ffd700 1 -- 172.21.15.84:0/4105051434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a407ff10 msgr2=0x7f81a4066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:43.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a2ffd700 1 --2- 172.21.15.84:0/4105051434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a407ff10 0x7f81a4066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:43.251 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a2ffd700 1 -- 172.21.15.84:0/4105051434 >> v2:172.21.15.142:3300/0 conn(0x7f81a40a9b30 msgr2=0x7f81a40abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:43.251 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a2ffd700 1 --2- 172.21.15.84:0/4105051434 >> v2:172.21.15.142:3300/0 conn(0x7f81a40a9b30 0x7f81a40abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:43.251 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a2ffd700 1 -- 172.21.15.84:0/4105051434 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a4150ce0 con 0x7f81a40a4250 2020-01-16T05:47:43.251 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a2ffd700 1 -- 172.21.15.84:0/4105051434 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f819c001ad0 con 0x7f81a40a4250 2020-01-16T05:47:43.251 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a2ffd700 1 -- 172.21.15.84:0/4105051434 >> v1:172.21.15.84:6789/0 conn(0x7f81a40a4250 legacy=0x7f81a40a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:43.251 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a2ffd700 1 --2- 172.21.15.84:0/4105051434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f818c003860 0x7f818c003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:43.251 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a2ffd700 1 --2- 172.21.15.84:0/4105051434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f818c0045a0 0x7f818c0049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:43.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a2ffd700 1 --2- 172.21.15.84:0/4105051434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818c004f20 0x7f818c04f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:43.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a2ffd700 1 -- 172.21.15.84:0/4105051434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a40a4830 con 0x7f818c0045a0 2020-01-16T05:47:43.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a2ffd700 1 -- 172.21.15.84:0/4105051434 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a407f9d0 con 0x7f818c004f20 2020-01-16T05:47:43.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a2ffd700 1 -- 172.21.15.84:0/4105051434 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818c04fd50 con 0x7f818c003860 2020-01-16T05:47:43.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a37fe700 1 --2- 172.21.15.84:0/4105051434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f818c0045a0 0x7f818c0049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:43.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a3fff700 1 --2- 172.21.15.84:0/4105051434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f818c003860 0x7f818c003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:43.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a9eda700 1 --2- 172.21.15.84:0/4105051434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818c004f20 0x7f818c04f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a37fe700 1 -- 172.21.15.84:0/4105051434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f818c003860 msgr2=0x7f818c003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a37fe700 1 --2- 172.21.15.84:0/4105051434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f818c003860 0x7f818c003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a37fe700 1 -- 172.21.15.84:0/4105051434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818c004f20 msgr2=0x7f818c04f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a37fe700 1 --2- 172.21.15.84:0/4105051434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818c004f20 0x7f818c04f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a37fe700 1 -- 172.21.15.84:0/4105051434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c04ff10 con 0x7f818c0045a0 2020-01-16T05:47:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a37fe700 1 --2- 172.21.15.84:0/4105051434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f818c0045a0 0x7f818c0049d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8198002f30 tx=0x7f8198010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:43.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a37fe700 1 --2- 172.21.15.84:0/4105051434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f818c0045a0 0x7f818c0049d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8198002f30 tx=0x7f8198010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:43.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.240+0000 7f81a37fe700 1 --2- 172.21.15.84:0/4105051434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f818c0045a0 0x7f818c0049d0 secure :-1 s=READY pgs=444 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198010160).ready entity=mon.0 client_cookie=e34359b6a8640d81 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:43.254 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a37fe700 1 --2- 172.21.15.84:0/4105051434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f818c0045a0 0x7f818c0049d0 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:43.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a2ffd700 1 -- 172.21.15.84:0/4105051434 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8198008950 con 0x7f818c0045a0 2020-01-16T05:47:43.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a37fe700 1 --2- 172.21.15.84:0/4105051434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f818c0045a0 0x7f818c0049d0 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:43.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a37fe700 1 --2- 172.21.15.84:0/4105051434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f818c0045a0 0x7f818c0049d0 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:43.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a2ffd700 1 -- 172.21.15.84:0/4105051434 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8198010ab0 con 0x7f818c0045a0 2020-01-16T05:47:43.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a2ffd700 1 -- 172.21.15.84:0/4105051434 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81980056c0 con 0x7f818c0045a0 2020-01-16T05:47:43.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a8c78700 1 -- 172.21.15.84:0/4105051434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f818c0045a0 msgr2=0x7f818c0049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:43.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a8c78700 1 --2- 172.21.15.84:0/4105051434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f818c0045a0 0x7f818c0049d0 secure :-1 s=READY pgs=444 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198010160).stop 2020-01-16T05:47:43.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a9eda700 1 -- 172.21.15.84:0/4105051434 reap_dead start 2020-01-16T05:47:43.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a8c78700 1 -- 172.21.15.84:0/4105051434 shutdown_connections 2020-01-16T05:47:43.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a8c78700 1 -- 172.21.15.84:0/4105051434 shutdown_connections 2020-01-16T05:47:43.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a8c78700 1 -- 172.21.15.84:0/4105051434 wait complete. 2020-01-16T05:47:43.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a8c78700 1 -- 172.21.15.84:0/4105051434 >> 172.21.15.84:0/4105051434 conn(0x7f81a40acfc0 msgr2=0x7f81a40a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:43.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a8c78700 1 Processor -- start 2020-01-16T05:47:43.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a8c78700 1 -- start start 2020-01-16T05:47:43.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a8c78700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a4124c30 0x7f81a4135b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:43.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a8c78700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f81a4136070 0x7f81a41364a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:43.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a8c78700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a4125a10 con 0x7f81a405ec40 2020-01-16T05:47:43.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a8c78700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a405f3e0 con 0x7f81a4136070 2020-01-16T05:47:43.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.244+0000 7f81a8c78700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a4125310 con 0x7f81a4124c30 2020-01-16T05:47:43.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f81a405ec40 0x7f81a40a87d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53398/0 (socket says 172.21.15.84:53398) 2020-01-16T05:47:43.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a3fff700 1 -- 172.21.15.84:0/698078271 learned_addr learned my addr 172.21.15.84:0/698078271 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a37fe700 1 --2- 172.21.15.84:0/698078271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a4124c30 0x7f81a4135b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a9eda700 1 --2- 172.21.15.84:0/698078271 >> v2:172.21.15.142:3300/0 conn(0x7f81a4136070 0x7f81a41364a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a0ff9700 1 -- 172.21.15.84:0/698078271 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170860474 0 0) 0x7f81a4125a10 con 0x7f81a405ec40 2020-01-16T05:47:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a0ff9700 1 -- 172.21.15.84:0/698078271 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8184003230 con 0x7f81a405ec40 2020-01-16T05:47:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a37fe700 1 -- 172.21.15.84:0/698078271 >> v2:172.21.15.142:3300/0 conn(0x7f81a4136070 msgr2=0x7f81a41364a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a37fe700 1 --2- 172.21.15.84:0/698078271 >> v2:172.21.15.142:3300/0 conn(0x7f81a4136070 0x7f81a41364a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a37fe700 1 -- 172.21.15.84:0/698078271 >> v1:172.21.15.84:6789/0 conn(0x7f81a405ec40 legacy=0x7f81a40a87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a37fe700 1 -- 172.21.15.84:0/698078271 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a4125060 con 0x7f81a4124c30 2020-01-16T05:47:43.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a37fe700 1 --2- 172.21.15.84:0/698078271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a4124c30 0x7f81a4135b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198007c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:43.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a37fe700 1 --2- 172.21.15.84:0/698078271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a4124c30 0x7f81a4135b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198007c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:43.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a37fe700 1 --2- 172.21.15.84:0/698078271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a4124c30 0x7f81a4135b20 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198007c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:43.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a37fe700 1 --2- 172.21.15.84:0/698078271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a4124c30 0x7f81a4135b20 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198007c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:43.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a0ff9700 1 -- 172.21.15.84:0/698078271 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81980056c0 con 0x7f81a4124c30 2020-01-16T05:47:43.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a37fe700 1 --2- 172.21.15.84:0/698078271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a4124c30 0x7f81a4135b20 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198007c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:43.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a37fe700 1 --2- 172.21.15.84:0/698078271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a4124c30 0x7f81a4135b20 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198007c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:43.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a0ff9700 1 -- 172.21.15.84:0/698078271 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8198008b50 con 0x7f81a4124c30 2020-01-16T05:47:43.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a8c78700 1 -- 172.21.15.84:0/698078271 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a4123340 con 0x7f81a4124c30 2020-01-16T05:47:43.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a0ff9700 1 -- 172.21.15.84:0/698078271 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8198005ab0 con 0x7f81a4124c30 2020-01-16T05:47:43.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a8c78700 1 -- 172.21.15.84:0/698078271 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a41235d0 con 0x7f81a4124c30 2020-01-16T05:47:43.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a37fe700 1 --2- 172.21.15.84:0/698078271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a4124c30 0x7f81a4135b20 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198007c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a0ff9700 1 -- 172.21.15.84:0/698078271 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f819800f1f0 con 0x7f81a4124c30 2020-01-16T05:47:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a8c78700 1 -- 172.21.15.84:0/698078271 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a405e1c0 con 0x7f81a4124c30 2020-01-16T05:47:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a37fe700 1 --2- 172.21.15.84:0/698078271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a4124c30 0x7f81a4135b20 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198007c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a0ff9700 1 --2- 172.21.15.84:0/698078271 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f818403c7f0 0x7f818403ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a0ff9700 1 -- 172.21.15.84:0/698078271 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f819804c790 con 0x7f81a4124c30 2020-01-16T05:47:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.248+0000 7f81a3fff700 1 --2- 172.21.15.84:0/698078271 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f818403c7f0 0x7f818403ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:43.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.252+0000 7f81a3fff700 1 --2- 172.21.15.84:0/698078271 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f818403c7f0 0x7f818403ed00 crc :-1 s=READY pgs=173 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:43.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.260+0000 7f81a37fe700 1 --2- 172.21.15.84:0/698078271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a4124c30 0x7f81a4135b20 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198007c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:43.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.260+0000 7f81a0ff9700 1 -- 172.21.15.84:0/698078271 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f8198032db0 con 0x7f81a4124c30 2020-01-16T05:47:43.411 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.412+0000 7f81a8c78700 1 -- 172.21.15.84:0/698078271 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81a4125750 con 0x7f81a4124c30 2020-01-16T05:47:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.412+0000 7f81a37fe700 1 --2- 172.21.15.84:0/698078271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a4124c30 0x7f81a4135b20 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198007c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.412+0000 7f81a0ff9700 1 -- 172.21.15.84:0/698078271 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f8198005cb0 con 0x7f81a4124c30 2020-01-16T05:47:43.412 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:43.412 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:43.413 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.412+0000 7f81a8c78700 1 -- 172.21.15.84:0/698078271 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f818403c7f0 msgr2=0x7f818403ed00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:43.414 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.412+0000 7f81a8c78700 1 --2- 172.21.15.84:0/698078271 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f818403c7f0 0x7f818403ed00 crc :-1 s=READY pgs=173 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:43.414 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.412+0000 7f81a8c78700 1 -- 172.21.15.84:0/698078271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a4124c30 msgr2=0x7f81a4135b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:43.414 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.412+0000 7f81a8c78700 1 --2- 172.21.15.84:0/698078271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a4124c30 0x7f81a4135b20 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198007c40).stop 2020-01-16T05:47:43.414 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.412+0000 7f81a8c78700 1 -- 172.21.15.84:0/698078271 shutdown_connections 2020-01-16T05:47:43.414 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.412+0000 7f81a8c78700 1 --2- 172.21.15.84:0/698078271 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f818403c7f0 0x7f818403ed00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:43.414 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.412+0000 7f81a8c78700 1 --2- 172.21.15.84:0/698078271 >> v2:172.21.15.142:3300/0 conn(0x7f81a4136070 0x7f81a41364a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:43.415 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.412+0000 7f81a8c78700 1 --2- 172.21.15.84:0/698078271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a4124c30 0x7f81a4135b20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:43.415 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.412+0000 7f81a8c78700 1 -- 172.21.15.84:0/698078271 shutdown_connections 2020-01-16T05:47:43.415 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.412+0000 7f81a8c78700 1 -- 172.21.15.84:0/698078271 wait complete. 2020-01-16T05:47:43.415 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:43.412+0000 7f81a8c78700 1 -- 172.21.15.84:0/698078271 >> 172.21.15.84:0/698078271 conn(0x7f81a40a9390 msgr2=0x7f81a407ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:43.415 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:43.425 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:43.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~197s 2020-01-16T05:47:44.484 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:47:44.486 INFO:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:47:45.427 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:45.548 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331f59e700 1 Processor -- start 2020-01-16T05:47:45.548 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331f59e700 1 -- start start 2020-01-16T05:47:45.548 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331f59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f332007ff10 0x7f33200abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331f59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f33200a4250 0x7f3320066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331f59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3320066dd0 con 0x7f33200a9b30 2020-01-16T05:47:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331f59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33200a4830 con 0x7f33200a4250 2020-01-16T05:47:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331f59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332007f9d0 con 0x7f332007ff10 2020-01-16T05:47:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331ed9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f33200a9b30 0x7f33200a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53406/0 (socket says 172.21.15.84:53406) 2020-01-16T05:47:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331ed9d700 1 -- 172.21.15.84:0/3670390457 learned_addr learned my addr 172.21.15.84:0/3670390457 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331e59c700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f332007ff10 0x7f33200abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f3324d8c700 1 --2- 172.21.15.84:0/3670390457 >> v2:172.21.15.142:3300/0 conn(0x7f33200a4250 0x7f3320066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331dd9b700 1 -- 172.21.15.84:0/3670390457 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156146130 0 0) 0x7f3320066dd0 con 0x7f33200a9b30 2020-01-16T05:47:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331dd9b700 1 -- 172.21.15.84:0/3670390457 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3308003230 con 0x7f33200a9b30 2020-01-16T05:47:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331dd9b700 1 -- 172.21.15.84:0/3670390457 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4079117312 0 0) 0x7f3308003230 con 0x7f33200a9b30 2020-01-16T05:47:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331dd9b700 1 -- 172.21.15.84:0/3670390457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f332007ff10 msgr2=0x7f33200abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331dd9b700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f332007ff10 0x7f33200abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331dd9b700 1 -- 172.21.15.84:0/3670390457 >> v2:172.21.15.142:3300/0 conn(0x7f33200a4250 msgr2=0x7f3320066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331dd9b700 1 --2- 172.21.15.84:0/3670390457 >> v2:172.21.15.142:3300/0 conn(0x7f33200a4250 0x7f3320066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331dd9b700 1 -- 172.21.15.84:0/3670390457 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3320150ce0 con 0x7f33200a9b30 2020-01-16T05:47:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331dd9b700 1 -- 172.21.15.84:0/3670390457 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f3310001750 con 0x7f33200a9b30 2020-01-16T05:47:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331dd9b700 1 -- 172.21.15.84:0/3670390457 >> v1:172.21.15.84:6789/0 conn(0x7f33200a9b30 legacy=0x7f33200a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:45.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331dd9b700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33080038e0 0x7f3308003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:45.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331dd9b700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33080045a0 0x7f33080049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:45.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331dd9b700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3308004f20 0x7f330804f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:45.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331dd9b700 1 -- 172.21.15.84:0/3670390457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33200a4830 con 0x7f33080045a0 2020-01-16T05:47:45.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331dd9b700 1 -- 172.21.15.84:0/3670390457 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332007f9d0 con 0x7f33080038e0 2020-01-16T05:47:45.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331dd9b700 1 -- 172.21.15.84:0/3670390457 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33080053d0 con 0x7f3308004f20 2020-01-16T05:47:45.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331e59c700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33080045a0 0x7f33080049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:45.553 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f3324d8c700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3308004f20 0x7f330804f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:45.553 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331ed9d700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33080038e0 0x7f3308003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:45.553 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331e59c700 1 -- 172.21.15.84:0/3670390457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3308004f20 msgr2=0x7f330804f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:45.553 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331e59c700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3308004f20 0x7f330804f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:45.553 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331e59c700 1 -- 172.21.15.84:0/3670390457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33080038e0 msgr2=0x7f3308003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:45.553 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331e59c700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33080038e0 0x7f3308003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:45.553 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331e59c700 1 -- 172.21.15.84:0/3670390457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330804fe90 con 0x7f33080045a0 2020-01-16T05:47:45.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331ed9d700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33080038e0 0x7f3308003d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:47:45.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f3324d8c700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3308004f20 0x7f330804f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:47:45.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.544+0000 7f331e59c700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33080045a0 0x7f33080049d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3314002f30 tx=0x7f3314010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:45.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.548+0000 7f331e59c700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33080045a0 0x7f33080049d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3314002f30 tx=0x7f3314010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:45.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.548+0000 7f331e59c700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33080045a0 0x7f33080049d0 secure :-1 s=READY pgs=447 cs=0 l=1 rx=0x7f3314002f30 tx=0x7f3314010160).ready entity=mon.0 client_cookie=7a6e1f5b3de2a8c7 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:45.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.548+0000 7f331e59c700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33080045a0 0x7f33080049d0 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7f3314002f30 tx=0x7f3314010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:45.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.548+0000 7f331dd9b700 1 -- 172.21.15.84:0/3670390457 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3314008950 con 0x7f33080045a0 2020-01-16T05:47:45.555 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.548+0000 7f331e59c700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33080045a0 0x7f33080049d0 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7f3314002f30 tx=0x7f3314010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:45.555 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.548+0000 7f331dd9b700 1 -- 172.21.15.84:0/3670390457 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3314010ab0 con 0x7f33080045a0 2020-01-16T05:47:45.555 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.548+0000 7f331e59c700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33080045a0 0x7f33080049d0 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7f3314002f30 tx=0x7f3314010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:45.555 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.548+0000 7f331dd9b700 1 -- 172.21.15.84:0/3670390457 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33140056c0 con 0x7f33080045a0 2020-01-16T05:47:45.555 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.548+0000 7f331f59e700 1 -- 172.21.15.84:0/3670390457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33080045a0 msgr2=0x7f33080049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:45.555 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.548+0000 7f331f59e700 1 --2- 172.21.15.84:0/3670390457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33080045a0 0x7f33080049d0 secure :-1 s=READY pgs=447 cs=0 l=1 rx=0x7f3314002f30 tx=0x7f3314010160).stop 2020-01-16T05:47:45.555 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.548+0000 7f3324d8c700 1 -- 172.21.15.84:0/3670390457 reap_dead start 2020-01-16T05:47:45.556 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.548+0000 7f331f59e700 1 -- 172.21.15.84:0/3670390457 shutdown_connections 2020-01-16T05:47:45.556 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.548+0000 7f331f59e700 1 -- 172.21.15.84:0/3670390457 shutdown_connections 2020-01-16T05:47:45.556 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.548+0000 7f331f59e700 1 -- 172.21.15.84:0/3670390457 wait complete. 2020-01-16T05:47:45.556 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.548+0000 7f331f59e700 1 -- 172.21.15.84:0/3670390457 >> 172.21.15.84:0/3670390457 conn(0x7f33200acfc0 msgr2=0x7f33200a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:45.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f331f59e700 1 Processor -- start 2020-01-16T05:47:45.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f331f59e700 1 -- start start 2020-01-16T05:47:45.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f331f59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3320126840 0x7f33200a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:45.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f331f59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3320091020 0x7f332007c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:45.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f331f59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332007c9f0 con 0x7f3320091ac0 2020-01-16T05:47:45.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f331f59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332005f400 con 0x7f3320126840 2020-01-16T05:47:45.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f331f59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33200915c0 con 0x7f3320091020 2020-01-16T05:47:45.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f331ed9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3320091ac0 0x7f332008f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53418/0 (socket says 172.21.15.84:53418) 2020-01-16T05:47:45.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f331ed9d700 1 -- 172.21.15.84:0/3765344346 learned_addr learned my addr 172.21.15.84:0/3765344346 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:45.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f3324d8c700 1 --2- 172.21.15.84:0/3765344346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3320091020 0x7f332007c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:45.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f331e59c700 1 --2- 172.21.15.84:0/3765344346 >> v2:172.21.15.142:3300/0 conn(0x7f3320126840 0x7f33200a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:45.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f330f7fe700 1 -- 172.21.15.84:0/3765344346 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515176124 0 0) 0x7f332007c9f0 con 0x7f3320091ac0 2020-01-16T05:47:45.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f330f7fe700 1 -- 172.21.15.84:0/3765344346 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3304003230 con 0x7f3320091ac0 2020-01-16T05:47:45.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f330f7fe700 1 -- 172.21.15.84:0/3765344346 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2076108337 0 0) 0x7f3304003230 con 0x7f3320091ac0 2020-01-16T05:47:45.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f3324d8c700 1 -- 172.21.15.84:0/3765344346 >> v2:172.21.15.142:3300/0 conn(0x7f3320126840 msgr2=0x7f33200a89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:45.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f3324d8c700 1 --2- 172.21.15.84:0/3765344346 >> v2:172.21.15.142:3300/0 conn(0x7f3320126840 0x7f33200a89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:45.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f3324d8c700 1 -- 172.21.15.84:0/3765344346 >> v1:172.21.15.84:6789/0 conn(0x7f3320091ac0 legacy=0x7f332008f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:45.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f3324d8c700 1 -- 172.21.15.84:0/3765344346 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332007cc20 con 0x7f3320091020 2020-01-16T05:47:45.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f331e59c700 1 --2- 172.21.15.84:0/3765344346 >> v2:172.21.15.142:3300/0 conn(0x7f3320126840 0x7f33200a89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:47:45.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f3324d8c700 1 --2- 172.21.15.84:0/3765344346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3320091020 0x7f332007c4a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3310001ab0 tx=0x7f3310001b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:45.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f3324d8c700 1 --2- 172.21.15.84:0/3765344346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3320091020 0x7f332007c4a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3310001ab0 tx=0x7f3310001b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:45.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f3324d8c700 1 --2- 172.21.15.84:0/3765344346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3320091020 0x7f332007c4a0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f3310001ab0 tx=0x7f3310001b40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:45.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f3324d8c700 1 --2- 172.21.15.84:0/3765344346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3320091020 0x7f332007c4a0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f3310001ab0 tx=0x7f3310001b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:45.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f330f7fe700 1 -- 172.21.15.84:0/3765344346 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33100018b0 con 0x7f3320091020 2020-01-16T05:47:45.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f3324d8c700 1 --2- 172.21.15.84:0/3765344346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3320091020 0x7f332007c4a0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f3310001ab0 tx=0x7f3310001b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:45.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f330f7fe700 1 -- 172.21.15.84:0/3765344346 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3310001c80 con 0x7f3320091020 2020-01-16T05:47:45.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f3324d8c700 1 --2- 172.21.15.84:0/3765344346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3320091020 0x7f332007c4a0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f3310001ab0 tx=0x7f3310001b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:45.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f330f7fe700 1 -- 172.21.15.84:0/3765344346 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33180129a0 con 0x7f3320091020 2020-01-16T05:47:45.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.552+0000 7f331f59e700 1 -- 172.21.15.84:0/3765344346 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332013be90 con 0x7f3320091020 2020-01-16T05:47:45.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.556+0000 7f331f59e700 1 -- 172.21.15.84:0/3765344346 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332013c3e0 con 0x7f3320091020 2020-01-16T05:47:45.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.556+0000 7f3324d8c700 1 --2- 172.21.15.84:0/3765344346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3320091020 0x7f332007c4a0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f3310001ab0 tx=0x7f3310001b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:45.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.556+0000 7f331f59e700 1 -- 172.21.15.84:0/3765344346 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332005e1c0 con 0x7f3320091020 2020-01-16T05:47:45.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.556+0000 7f330f7fe700 1 -- 172.21.15.84:0/3765344346 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f3318013060 con 0x7f3320091020 2020-01-16T05:47:45.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.556+0000 7f3324d8c700 1 --2- 172.21.15.84:0/3765344346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3320091020 0x7f332007c4a0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f3310001ab0 tx=0x7f3310001b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:45.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.556+0000 7f330f7fe700 1 --2- 172.21.15.84:0/3765344346 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f330403c790 0x7f330403eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:45.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.556+0000 7f330f7fe700 1 -- 172.21.15.84:0/3765344346 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f331804c220 con 0x7f3320091020 2020-01-16T05:47:45.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.556+0000 7f331ed9d700 1 --2- 172.21.15.84:0/3765344346 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f330403c790 0x7f330403eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:45.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.556+0000 7f331ed9d700 1 --2- 172.21.15.84:0/3765344346 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f330403c790 0x7f330403eca0 crc :-1 s=READY pgs=174 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:45.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.564+0000 7f3324d8c700 1 --2- 172.21.15.84:0/3765344346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3320091020 0x7f332007c4a0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f3310001ab0 tx=0x7f3310001b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:45.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.564+0000 7f330f7fe700 1 -- 172.21.15.84:0/3765344346 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f3318032820 con 0x7f3320091020 2020-01-16T05:47:45.715 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.716+0000 7f331f59e700 1 -- 172.21.15.84:0/3765344346 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f332005cbc0 con 0x7f3320091020 2020-01-16T05:47:45.716 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.716+0000 7f3324d8c700 1 --2- 172.21.15.84:0/3765344346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3320091020 0x7f332007c4a0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f3310001ab0 tx=0x7f3310001b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:45.717 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.716+0000 7f330f7fe700 1 -- 172.21.15.84:0/3765344346 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f3318032a80 con 0x7f3320091020 2020-01-16T05:47:45.717 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:45.717 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:45.718 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.716+0000 7f331f59e700 1 -- 172.21.15.84:0/3765344346 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f330403c790 msgr2=0x7f330403eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:45.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.716+0000 7f331f59e700 1 --2- 172.21.15.84:0/3765344346 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f330403c790 0x7f330403eca0 crc :-1 s=READY pgs=174 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:45.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.716+0000 7f331f59e700 1 -- 172.21.15.84:0/3765344346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3320091020 msgr2=0x7f332007c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:45.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.716+0000 7f331f59e700 1 --2- 172.21.15.84:0/3765344346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3320091020 0x7f332007c4a0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f3310001ab0 tx=0x7f3310001b40).stop 2020-01-16T05:47:45.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.716+0000 7f331f59e700 1 -- 172.21.15.84:0/3765344346 shutdown_connections 2020-01-16T05:47:45.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.716+0000 7f331f59e700 1 --2- 172.21.15.84:0/3765344346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3320091020 0x7f332007c4a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:45.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.716+0000 7f331f59e700 1 --2- 172.21.15.84:0/3765344346 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f330403c790 0x7f330403eca0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:45.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.716+0000 7f331f59e700 1 --2- 172.21.15.84:0/3765344346 >> v2:172.21.15.142:3300/0 conn(0x7f3320126840 0x7f33200a89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:45.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.720+0000 7f331f59e700 1 -- 172.21.15.84:0/3765344346 shutdown_connections 2020-01-16T05:47:45.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.720+0000 7f331f59e700 1 -- 172.21.15.84:0/3765344346 wait complete. 2020-01-16T05:47:45.720 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:45.720+0000 7f331f59e700 1 -- 172.21.15.84:0/3765344346 >> 172.21.15.84:0/3765344346 conn(0x7f3320066650 msgr2=0x7f332007d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:45.720 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:45.731 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:47:47.732 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:47.857 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.852+0000 7f2fa00cd700 1 Processor -- start 2020-01-16T05:47:47.857 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.852+0000 7f2fa00cd700 1 -- start start 2020-01-16T05:47:47.857 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.852+0000 7f2fa00cd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2f9805b0f0 0x7f2f980a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:47.857 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.852+0000 7f2fa00cd700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9807cd60 con 0x7f2f980a2f60 2020-01-16T05:47:47.857 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.852+0000 7f2fa00cd700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9808f570 con 0x7f2f9808fd80 2020-01-16T05:47:47.858 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.852+0000 7f2fa00cd700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f980a3390 con 0x7f2f9805b0f0 2020-01-16T05:47:47.858 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2f9e66a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2f980a2f60 0x7f2f9807c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53426/0 (socket says 172.21.15.84:53426) 2020-01-16T05:47:47.858 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2f9e66a700 1 -- 172.21.15.84:0/2986261459 learned_addr learned my addr 172.21.15.84:0/2986261459 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:47.858 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2f9de69700 1 --2- 172.21.15.84:0/2986261459 >> v2:172.21.15.84:3300/0 conn(0x7f2f9805b0f0 0x7f2f980a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:47.858 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2f9d668700 1 -- 172.21.15.84:0/2986261459 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298010413 0 0) 0x7f2f9807cd60 con 0x7f2f980a2f60 2020-01-16T05:47:47.858 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2f9d668700 1 -- 172.21.15.84:0/2986261459 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f80003230 con 0x7f2f980a2f60 2020-01-16T05:47:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2f9de69700 1 -- 172.21.15.84:0/2986261459 >> v1:172.21.15.142:6789/0 conn(0x7f2f9808fd80 legacy=0x7f2f981503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2f9de69700 1 -- 172.21.15.84:0/2986261459 >> v1:172.21.15.84:6789/0 conn(0x7f2f980a2f60 legacy=0x7f2f9807c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2f9d668700 1 -- 172.21.15.84:0/2986261459 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344420996 0 0) 0x7f2f9808f570 con 0x7f2f9808fd80 2020-01-16T05:47:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2f9de69700 1 -- 172.21.15.84:0/2986261459 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9805b520 con 0x7f2f9805b0f0 2020-01-16T05:47:47.860 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2f9de69700 1 --2- 172.21.15.84:0/2986261459 >> v2:172.21.15.84:3300/0 conn(0x7f2f9805b0f0 0x7f2f980a8ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2f90001d10 tx=0x7f2f90001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:47.860 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2f9de69700 1 --2- 172.21.15.84:0/2986261459 >> v2:172.21.15.84:3300/0 conn(0x7f2f9805b0f0 0x7f2f980a8ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2f90001d10 tx=0x7f2f90001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:47.860 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2f9de69700 1 --2- 172.21.15.84:0/2986261459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f9805b0f0 0x7f2f980a8ff0 secure :-1 s=READY pgs=450 cs=0 l=1 rx=0x7f2f90001d10 tx=0x7f2f90001820).ready entity=mon.0 client_cookie=ebb90ca554fa1c45 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:47.860 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2f9de69700 1 --2- 172.21.15.84:0/2986261459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f9805b0f0 0x7f2f980a8ff0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f2f90001d10 tx=0x7f2f90001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:47.861 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2f9d668700 1 -- 172.21.15.84:0/2986261459 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f90001ad0 con 0x7f2f9805b0f0 2020-01-16T05:47:47.861 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2f9de69700 1 --2- 172.21.15.84:0/2986261459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f9805b0f0 0x7f2f980a8ff0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f2f90001d10 tx=0x7f2f90001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:47.861 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2f9d668700 1 -- 172.21.15.84:0/2986261459 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f900018e0 con 0x7f2f9805b0f0 2020-01-16T05:47:47.861 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2f9de69700 1 --2- 172.21.15.84:0/2986261459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f9805b0f0 0x7f2f980a8ff0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f2f90001d10 tx=0x7f2f90001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:47.861 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2fa00cd700 1 -- 172.21.15.84:0/2986261459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f9805b0f0 msgr2=0x7f2f980a8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:47.861 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2f9d668700 1 -- 172.21.15.84:0/2986261459 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f8c011580 con 0x7f2f9805b0f0 2020-01-16T05:47:47.861 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2fa00cd700 1 --2- 172.21.15.84:0/2986261459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f9805b0f0 0x7f2f980a8ff0 secure :-1 s=READY pgs=450 cs=0 l=1 rx=0x7f2f90001d10 tx=0x7f2f90001820).stop 2020-01-16T05:47:47.862 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2fa00cd700 1 -- 172.21.15.84:0/2986261459 shutdown_connections 2020-01-16T05:47:47.862 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2fa00cd700 1 --2- 172.21.15.84:0/2986261459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f9805b0f0 0x7f2f980a8ff0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:47.862 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2fa00cd700 1 -- 172.21.15.84:0/2986261459 shutdown_connections 2020-01-16T05:47:47.862 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2fa00cd700 1 -- 172.21.15.84:0/2986261459 wait complete. 2020-01-16T05:47:47.862 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2fa00cd700 1 -- 172.21.15.84:0/2986261459 >> 172.21.15.84:0/2986261459 conn(0x7f2f980abc10 msgr2=0x7f2f9805a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:47.865 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2fa00cd700 1 Processor -- start 2020-01-16T05:47:47.865 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.856+0000 7f2fa00cd700 1 -- start start 2020-01-16T05:47:47.865 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2fa00cd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f980a5a40 0x7f2f98147a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:47.865 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2fa00cd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2f98147fd0 0x7f2f98078130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:47.866 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2fa00cd700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f98148400 con 0x7f2f98078680 2020-01-16T05:47:47.866 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2fa00cd700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f98079ef0 con 0x7f2f98147fd0 2020-01-16T05:47:47.866 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2fa00cd700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9807a190 con 0x7f2f980a5a40 2020-01-16T05:47:47.866 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f9ee6b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2f98078680 0x7f2f98131a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53434/0 (socket says 172.21.15.84:53434) 2020-01-16T05:47:47.866 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f9ee6b700 1 -- 172.21.15.84:0/3954428427 learned_addr learned my addr 172.21.15.84:0/3954428427 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:47.866 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f9e66a700 1 --2- 172.21.15.84:0/3954428427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f980a5a40 0x7f2f98147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:47.866 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f9de69700 1 --2- 172.21.15.84:0/3954428427 >> v2:172.21.15.142:3300/0 conn(0x7f2f98147fd0 0x7f2f98078130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:47.867 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f96ffd700 1 -- 172.21.15.84:0/3954428427 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933349972 0 0) 0x7f2f98148400 con 0x7f2f98078680 2020-01-16T05:47:47.867 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f96ffd700 1 -- 172.21.15.84:0/3954428427 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f78003230 con 0x7f2f98078680 2020-01-16T05:47:47.867 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f9e66a700 1 -- 172.21.15.84:0/3954428427 >> v2:172.21.15.142:3300/0 conn(0x7f2f98147fd0 msgr2=0x7f2f98078130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:47.867 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f9e66a700 1 --2- 172.21.15.84:0/3954428427 >> v2:172.21.15.142:3300/0 conn(0x7f2f98147fd0 0x7f2f98078130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:47.867 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f9e66a700 1 -- 172.21.15.84:0/3954428427 >> v1:172.21.15.84:6789/0 conn(0x7f2f98078680 legacy=0x7f2f98131a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:47.867 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f9e66a700 1 -- 172.21.15.84:0/3954428427 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f98078ab0 con 0x7f2f980a5a40 2020-01-16T05:47:47.867 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f9de69700 1 --2- 172.21.15.84:0/3954428427 >> v2:172.21.15.142:3300/0 conn(0x7f2f98147fd0 0x7f2f98078130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:47:47.868 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f9e66a700 1 --2- 172.21.15.84:0/3954428427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f980a5a40 0x7f2f98147a80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2f900048a0 tx=0x7f2f90010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:47.868 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f9e66a700 1 --2- 172.21.15.84:0/3954428427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f980a5a40 0x7f2f98147a80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2f900048a0 tx=0x7f2f90010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:47.868 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f9e66a700 1 --2- 172.21.15.84:0/3954428427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f980a5a40 0x7f2f98147a80 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f2f900048a0 tx=0x7f2f90010ee0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:47.868 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f9e66a700 1 --2- 172.21.15.84:0/3954428427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f980a5a40 0x7f2f98147a80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f2f900048a0 tx=0x7f2f90010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:47.868 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f96ffd700 1 -- 172.21.15.84:0/3954428427 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f9000cd60 con 0x7f2f980a5a40 2020-01-16T05:47:47.868 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f9e66a700 1 --2- 172.21.15.84:0/3954428427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f980a5a40 0x7f2f98147a80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f2f900048a0 tx=0x7f2f90010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:47.868 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f9e66a700 1 --2- 172.21.15.84:0/3954428427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f980a5a40 0x7f2f98147a80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f2f900048a0 tx=0x7f2f90010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:47.869 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f96ffd700 1 -- 172.21.15.84:0/3954428427 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9000c980 con 0x7f2f980a5a40 2020-01-16T05:47:47.869 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2fa00cd700 1 -- 172.21.15.84:0/3954428427 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f980a5e70 con 0x7f2f980a5a40 2020-01-16T05:47:47.869 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f96ffd700 1 -- 172.21.15.84:0/3954428427 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f90012d30 con 0x7f2f980a5a40 2020-01-16T05:47:47.869 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2fa00cd700 1 -- 172.21.15.84:0/3954428427 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f980796d0 con 0x7f2f980a5a40 2020-01-16T05:47:47.869 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.860+0000 7f2f9e66a700 1 --2- 172.21.15.84:0/3954428427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f980a5a40 0x7f2f98147a80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f2f900048a0 tx=0x7f2f90010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:47.869 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.864+0000 7f2fa00cd700 1 -- 172.21.15.84:0/3954428427 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9805e1c0 con 0x7f2f980a5a40 2020-01-16T05:47:47.869 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.864+0000 7f2f96ffd700 1 -- 172.21.15.84:0/3954428427 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f2f90004930 con 0x7f2f980a5a40 2020-01-16T05:47:47.870 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.864+0000 7f2f9e66a700 1 --2- 172.21.15.84:0/3954428427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f980a5a40 0x7f2f98147a80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f2f900048a0 tx=0x7f2f90010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:47.870 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.864+0000 7f2f96ffd700 1 --2- 172.21.15.84:0/3954428427 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f2f7803c800 0x7f2f7803ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:47.870 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.864+0000 7f2f96ffd700 1 -- 172.21.15.84:0/3954428427 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f2f9004c990 con 0x7f2f980a5a40 2020-01-16T05:47:47.870 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.864+0000 7f2f9de69700 1 --2- 172.21.15.84:0/3954428427 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f2f7803c800 0x7f2f7803ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:47.870 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.864+0000 7f2f9de69700 1 --2- 172.21.15.84:0/3954428427 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f2f7803c800 0x7f2f7803ed10 crc :-1 s=READY pgs=175 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:47.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.872+0000 7f2f9e66a700 1 --2- 172.21.15.84:0/3954428427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f980a5a40 0x7f2f98147a80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f2f900048a0 tx=0x7f2f90010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:47.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:47.872+0000 7f2f96ffd700 1 -- 172.21.15.84:0/3954428427 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f2f90032f90 con 0x7f2f980a5a40 2020-01-16T05:47:48.023 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:48.024+0000 7f2fa00cd700 1 -- 172.21.15.84:0/3954428427 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f9808f350 con 0x7f2f980a5a40 2020-01-16T05:47:48.024 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:48.024+0000 7f2f9e66a700 1 --2- 172.21.15.84:0/3954428427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f980a5a40 0x7f2f98147a80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f2f900048a0 tx=0x7f2f90010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:48.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:48.024+0000 7f2f96ffd700 1 -- 172.21.15.84:0/3954428427 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f2f900331f0 con 0x7f2f980a5a40 2020-01-16T05:47:48.025 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:48.025 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:48.027 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:48.024+0000 7f2fa00cd700 1 -- 172.21.15.84:0/3954428427 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f2f7803c800 msgr2=0x7f2f7803ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:48.027 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:48.028+0000 7f2fa00cd700 1 --2- 172.21.15.84:0/3954428427 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f2f7803c800 0x7f2f7803ed10 crc :-1 s=READY pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:48.027 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:48.028+0000 7f2fa00cd700 1 -- 172.21.15.84:0/3954428427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f980a5a40 msgr2=0x7f2f98147a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:48.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:48.028+0000 7f2fa00cd700 1 --2- 172.21.15.84:0/3954428427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f980a5a40 0x7f2f98147a80 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f2f900048a0 tx=0x7f2f90010ee0).stop 2020-01-16T05:47:48.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:48.028+0000 7f2fa00cd700 1 -- 172.21.15.84:0/3954428427 shutdown_connections 2020-01-16T05:47:48.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:48.028+0000 7f2fa00cd700 1 --2- 172.21.15.84:0/3954428427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f980a5a40 0x7f2f98147a80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:48.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:48.028+0000 7f2fa00cd700 1 --2- 172.21.15.84:0/3954428427 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f2f7803c800 0x7f2f7803ed10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:48.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:48.028+0000 7f2fa00cd700 1 --2- 172.21.15.84:0/3954428427 >> v2:172.21.15.142:3300/0 conn(0x7f2f98147fd0 0x7f2f98078130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:48.029 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:48.028+0000 7f2fa00cd700 1 -- 172.21.15.84:0/3954428427 shutdown_connections 2020-01-16T05:47:48.029 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:48.028+0000 7f2fa00cd700 1 -- 172.21.15.84:0/3954428427 wait complete. 2020-01-16T05:47:48.029 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:48.028+0000 7f2fa00cd700 1 -- 172.21.15.84:0/3954428427 >> 172.21.15.84:0/3954428427 conn(0x7f2f980a9760 msgr2=0x7f2f980a3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:48.029 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:48.038 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:50.039 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:50.090 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~203s 2020-01-16T05:47:50.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.160+0000 7f0932388700 1 Processor -- start 2020-01-16T05:47:50.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.160+0000 7f0932388700 1 -- start start 2020-01-16T05:47:50.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.160+0000 7f0932388700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f092c0a4250 0x7f092c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:50.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.160+0000 7f0932388700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092c066880 con 0x7f092c0a9b30 2020-01-16T05:47:50.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.160+0000 7f0932388700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092c066ab0 con 0x7f092c07ff10 2020-01-16T05:47:50.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.160+0000 7f0932388700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f092c0a4830 con 0x7f092c0a4250 2020-01-16T05:47:50.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.160+0000 7f0931b87700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f092c0a9b30 0x7f092c0a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53440/0 (socket says 172.21.15.84:53440) 2020-01-16T05:47:50.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.160+0000 7f0931b87700 1 -- 172.21.15.84:0/1501439293 learned_addr learned my addr 172.21.15.84:0/1501439293 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:50.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.160+0000 7f09335ea700 1 --2- 172.21.15.84:0/1501439293 >> v2:172.21.15.142:3300/0 conn(0x7f092c0a4250 0x7f092c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:50.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.160+0000 7f0930b85700 1 -- 172.21.15.84:0/1501439293 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189396582 0 0) 0x7f092c066880 con 0x7f092c0a9b30 2020-01-16T05:47:50.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.160+0000 7f0930b85700 1 -- 172.21.15.84:0/1501439293 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0914003230 con 0x7f092c0a9b30 2020-01-16T05:47:50.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.160+0000 7f09335ea700 1 -- 172.21.15.84:0/1501439293 >> v1:172.21.15.142:6789/0 conn(0x7f092c07ff10 legacy=0x7f092c14dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:50.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.160+0000 7f09335ea700 1 -- 172.21.15.84:0/1501439293 >> v1:172.21.15.84:6789/0 conn(0x7f092c0a9b30 legacy=0x7f092c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:50.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.160+0000 7f0930b85700 1 -- 172.21.15.84:0/1501439293 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1348641865 0 0) 0x7f0914003230 con 0x7f092c0a9b30 2020-01-16T05:47:50.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.160+0000 7f09335ea700 1 -- 172.21.15.84:0/1501439293 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c066ce0 con 0x7f092c0a4250 2020-01-16T05:47:50.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.164+0000 7f09335ea700 1 --2- 172.21.15.84:0/1501439293 >> v2:172.21.15.142:3300/0 conn(0x7f092c0a4250 0x7f092c0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f091c008910 tx=0x7f0920001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:50.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.164+0000 7f09335ea700 1 --2- 172.21.15.84:0/1501439293 >> v2:172.21.15.142:3300/0 conn(0x7f092c0a4250 0x7f092c0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f091c008910 tx=0x7f0920001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:50.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.164+0000 7f09335ea700 1 --2- 172.21.15.84:0/1501439293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f092c0a4250 0x7f092c0abdd0 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7f091c008910 tx=0x7f0920001990).ready entity=mon.1 client_cookie=12c81090ce4f51d5 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:50.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.164+0000 7f09335ea700 1 --2- 172.21.15.84:0/1501439293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f092c0a4250 0x7f092c0abdd0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f091c008910 tx=0x7f0920001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:50.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.164+0000 7f0930b85700 1 -- 172.21.15.84:0/1501439293 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0920001750 con 0x7f092c0a4250 2020-01-16T05:47:50.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.164+0000 7f09335ea700 1 --2- 172.21.15.84:0/1501439293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f092c0a4250 0x7f092c0abdd0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f091c008910 tx=0x7f0920001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.164+0000 7f09335ea700 1 --2- 172.21.15.84:0/1501439293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f092c0a4250 0x7f092c0abdd0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f091c008910 tx=0x7f0920001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.164+0000 7f0930b85700 1 -- 172.21.15.84:0/1501439293 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0920001560 con 0x7f092c0a4250 2020-01-16T05:47:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.164+0000 7f0930b85700 1 -- 172.21.15.84:0/1501439293 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f091c0116d0 con 0x7f092c0a4250 2020-01-16T05:47:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.164+0000 7f0932388700 1 -- 172.21.15.84:0/1501439293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f092c0a4250 msgr2=0x7f092c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.164+0000 7f0932388700 1 --2- 172.21.15.84:0/1501439293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f092c0a4250 0x7f092c0abdd0 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7f091c008910 tx=0x7f0920001990).stop 2020-01-16T05:47:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.164+0000 7f0932388700 1 -- 172.21.15.84:0/1501439293 shutdown_connections 2020-01-16T05:47:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.164+0000 7f0932388700 1 --2- 172.21.15.84:0/1501439293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f092c0a4250 0x7f092c0abdd0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.164+0000 7f0932388700 1 -- 172.21.15.84:0/1501439293 shutdown_connections 2020-01-16T05:47:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.164+0000 7f0932388700 1 -- 172.21.15.84:0/1501439293 wait complete. 2020-01-16T05:47:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.164+0000 7f0932388700 1 -- 172.21.15.84:0/1501439293 >> 172.21.15.84:0/1501439293 conn(0x7f092c0acfc0 msgr2=0x7f092c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:50.182 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.164+0000 7f0932388700 1 Processor -- start 2020-01-16T05:47:50.182 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f0932388700 1 -- start start 2020-01-16T05:47:50.182 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f0932388700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f092c065890 0x7f092c0a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:50.182 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f0932388700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f092c07c030 0x7f092c13f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f0932388700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092c138030 con 0x7f092c0a2720 2020-01-16T05:47:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f0932388700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f092c0a3710 con 0x7f092c07c030 2020-01-16T05:47:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f0932388700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f092c0a1e20 con 0x7f092c065890 2020-01-16T05:47:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f09335ea700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f092c07c030 0x7f092c13f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:50.184 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f09335ea700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f092c07c030 0x7f092c13f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36250/0 (socket says 172.21.15.84:36250) 2020-01-16T05:47:50.184 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f09335ea700 1 -- 172.21.15.84:0/2031558471 learned_addr learned my addr 172.21.15.84:0/2031558471 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:47:50.184 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f0931b87700 1 --2- 172.21.15.84:0/2031558471 >> v2:172.21.15.142:3300/0 conn(0x7f092c065890 0x7f092c0a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:50.184 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f09335ea700 1 -- 172.21.15.84:0/2031558471 >> v2:172.21.15.142:3300/0 conn(0x7f092c065890 msgr2=0x7f092c0a21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:50.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f09335ea700 1 --2- 172.21.15.84:0/2031558471 >> v2:172.21.15.142:3300/0 conn(0x7f092c065890 0x7f092c0a21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:50.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f09335ea700 1 -- 172.21.15.84:0/2031558471 >> v1:172.21.15.142:6789/0 conn(0x7f092c0a2720 legacy=0x7f092c07b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:50.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f09335ea700 1 -- 172.21.15.84:0/2031558471 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c0ab090 con 0x7f092c07c030 2020-01-16T05:47:50.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f09335ea700 1 --2- 172.21.15.84:0/2031558471 >> v2:172.21.15.84:3300/0 conn(0x7f092c07c030 0x7f092c13f750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f091c008910 tx=0x7f091c008790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f09335ea700 1 --2- 172.21.15.84:0/2031558471 >> v2:172.21.15.84:3300/0 conn(0x7f092c07c030 0x7f092c13f750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f091c008910 tx=0x7f091c008790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f09335ea700 1 --2- 172.21.15.84:0/2031558471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f092c07c030 0x7f092c13f750 secure :-1 s=READY pgs=453 cs=0 l=1 rx=0x7f091c008910 tx=0x7f091c008790).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f09335ea700 1 --2- 172.21.15.84:0/2031558471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f092c07c030 0x7f092c13f750 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f091c008910 tx=0x7f091c008790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f092a7fc700 1 -- 172.21.15.84:0/2031558471 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f091c007340 con 0x7f092c07c030 2020-01-16T05:47:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f09335ea700 1 --2- 172.21.15.84:0/2031558471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f092c07c030 0x7f092c13f750 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f091c008910 tx=0x7f091c008790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f09335ea700 1 --2- 172.21.15.84:0/2031558471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f092c07c030 0x7f092c13f750 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f091c008910 tx=0x7f091c008790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f092a7fc700 1 -- 172.21.15.84:0/2031558471 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c0112f0 con 0x7f092c07c030 2020-01-16T05:47:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f0932388700 1 -- 172.21.15.84:0/2031558471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f092c0a1a40 con 0x7f092c07c030 2020-01-16T05:47:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f092a7fc700 1 -- 172.21.15.84:0/2031558471 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f091c00f740 con 0x7f092c07c030 2020-01-16T05:47:50.188 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f0932388700 1 -- 172.21.15.84:0/2031558471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092c0a0d80 con 0x7f092c07c030 2020-01-16T05:47:50.188 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f09335ea700 1 --2- 172.21.15.84:0/2031558471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f092c07c030 0x7f092c13f750 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f091c008910 tx=0x7f091c008790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:50.189 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.168+0000 7f0932388700 1 -- 172.21.15.84:0/2031558471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092c05e1c0 con 0x7f092c07c030 2020-01-16T05:47:50.189 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.172+0000 7f092a7fc700 1 -- 172.21.15.84:0/2031558471 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f091c0056c0 con 0x7f092c07c030 2020-01-16T05:47:50.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.172+0000 7f09335ea700 1 --2- 172.21.15.84:0/2031558471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f092c07c030 0x7f092c13f750 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f091c008910 tx=0x7f091c008790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:50.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.172+0000 7f092a7fc700 1 --2- 172.21.15.84:0/2031558471 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f090c03c280 0x7f090c03e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:50.190 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.172+0000 7f092a7fc700 1 -- 172.21.15.84:0/2031558471 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f091c04d290 con 0x7f092c07c030 2020-01-16T05:47:50.191 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.172+0000 7f0931b87700 1 --2- 172.21.15.84:0/2031558471 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f090c03c280 0x7f090c03e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:50.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.172+0000 7f0931b87700 1 --2- 172.21.15.84:0/2031558471 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f090c03c280 0x7f090c03e790 crc :-1 s=READY pgs=176 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:50.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.176+0000 7f09335ea700 1 --2- 172.21.15.84:0/2031558471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f092c07c030 0x7f092c13f750 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f091c008910 tx=0x7f091c008790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:50.192 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.176+0000 7f092a7fc700 1 -- 172.21.15.84:0/2031558471 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f091c033890 con 0x7f092c07c030 2020-01-16T05:47:50.329 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.328+0000 7f0932388700 1 -- 172.21.15.84:0/2031558471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f092c05cbc0 con 0x7f092c07c030 2020-01-16T05:47:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.328+0000 7f09335ea700 1 --2- 172.21.15.84:0/2031558471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f092c07c030 0x7f092c13f750 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f091c008910 tx=0x7f091c008790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.328+0000 7f092a7fc700 1 -- 172.21.15.84:0/2031558471 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f091c033af0 con 0x7f092c07c030 2020-01-16T05:47:50.330 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:50.330 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:50.332 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.332+0000 7f0932388700 1 -- 172.21.15.84:0/2031558471 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f090c03c280 msgr2=0x7f090c03e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.332+0000 7f0932388700 1 --2- 172.21.15.84:0/2031558471 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f090c03c280 0x7f090c03e790 crc :-1 s=READY pgs=176 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.332+0000 7f0932388700 1 -- 172.21.15.84:0/2031558471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f092c07c030 msgr2=0x7f092c13f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.332+0000 7f0932388700 1 --2- 172.21.15.84:0/2031558471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f092c07c030 0x7f092c13f750 secure :-1 s=READY pgs=453 cs=0 l=1 rx=0x7f091c008910 tx=0x7f091c008790).stop 2020-01-16T05:47:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.332+0000 7f0932388700 1 -- 172.21.15.84:0/2031558471 shutdown_connections 2020-01-16T05:47:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.332+0000 7f0932388700 1 --2- 172.21.15.84:0/2031558471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f092c07c030 0x7f092c13f750 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.332+0000 7f0932388700 1 --2- 172.21.15.84:0/2031558471 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f090c03c280 0x7f090c03e790 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.332+0000 7f0932388700 1 --2- 172.21.15.84:0/2031558471 >> v2:172.21.15.142:3300/0 conn(0x7f092c065890 0x7f092c0a21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.332+0000 7f0932388700 1 -- 172.21.15.84:0/2031558471 shutdown_connections 2020-01-16T05:47:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.332+0000 7f0932388700 1 -- 172.21.15.84:0/2031558471 wait complete. 2020-01-16T05:47:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:50.332+0000 7f0932388700 1 -- 172.21.15.84:0/2031558471 >> 172.21.15.84:0/2031558471 conn(0x7f092c0ab6b0 msgr2=0x7f092c0a4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:50.349 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:52.350 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:52.475 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f2493700 1 Processor -- start 2020-01-16T05:47:52.475 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f2493700 1 -- start start 2020-01-16T05:47:52.476 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f2493700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec0a4250 0x7f81ec0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:52.476 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f2493700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ec066880 con 0x7f81ec07ff10 2020-01-16T05:47:52.476 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f2493700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ec066ab0 con 0x7f81ec0a9b30 2020-01-16T05:47:52.476 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f2493700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec0a4830 con 0x7f81ec0a4250 2020-01-16T05:47:52.476 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f1491700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f81ec07ff10 0x7f81ec14dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53456/0 (socket says 172.21.15.84:53456) 2020-01-16T05:47:52.476 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f1491700 1 -- 172.21.15.84:0/1381081551 learned_addr learned my addr 172.21.15.84:0/1381081551 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:52.476 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f36f5700 1 --2- 172.21.15.84:0/1381081551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec0a4250 0x7f81ec0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:52.477 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f0c90700 1 -- 172.21.15.84:0/1381081551 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397978804 0 0) 0x7f81ec066880 con 0x7f81ec07ff10 2020-01-16T05:47:52.477 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f0c90700 1 -- 172.21.15.84:0/1381081551 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81d8003230 con 0x7f81ec07ff10 2020-01-16T05:47:52.477 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f0c90700 1 -- 172.21.15.84:0/1381081551 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383851302 0 0) 0x7f81ec066ab0 con 0x7f81ec0a9b30 2020-01-16T05:47:52.477 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f36f5700 1 -- 172.21.15.84:0/1381081551 >> v1:172.21.15.142:6789/0 conn(0x7f81ec0a9b30 legacy=0x7f81ec0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:52.477 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f36f5700 1 -- 172.21.15.84:0/1381081551 >> v1:172.21.15.84:6789/0 conn(0x7f81ec07ff10 legacy=0x7f81ec14dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:52.477 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f36f5700 1 -- 172.21.15.84:0/1381081551 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec066ce0 con 0x7f81ec0a4250 2020-01-16T05:47:52.477 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f36f5700 1 --2- 172.21.15.84:0/1381081551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec0a4250 0x7f81ec0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f81e40032b0 tx=0x7f81e40100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:52.478 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f36f5700 1 --2- 172.21.15.84:0/1381081551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec0a4250 0x7f81ec0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f81e40032b0 tx=0x7f81e40100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:52.478 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f36f5700 1 --2- 172.21.15.84:0/1381081551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec0a4250 0x7f81ec0abdd0 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f81e40032b0 tx=0x7f81e40100f0).ready entity=mon.2 client_cookie=658baf3155086791 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:52.478 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f36f5700 1 --2- 172.21.15.84:0/1381081551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec0a4250 0x7f81ec0abdd0 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f81e40032b0 tx=0x7f81e40100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:52.478 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f0c90700 1 -- 172.21.15.84:0/1381081551 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e400a160 con 0x7f81ec0a4250 2020-01-16T05:47:52.478 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f36f5700 1 --2- 172.21.15.84:0/1381081551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec0a4250 0x7f81ec0abdd0 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f81e40032b0 tx=0x7f81e40100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:52.478 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f0c90700 1 -- 172.21.15.84:0/1381081551 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e4011ba0 con 0x7f81ec0a4250 2020-01-16T05:47:52.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f36f5700 1 --2- 172.21.15.84:0/1381081551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec0a4250 0x7f81ec0abdd0 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f81e40032b0 tx=0x7f81e40100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:52.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f0c90700 1 -- 172.21.15.84:0/1381081551 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e400a740 con 0x7f81ec0a4250 2020-01-16T05:47:52.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f2493700 1 -- 172.21.15.84:0/1381081551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec0a4250 msgr2=0x7f81ec0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:52.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.472+0000 7f81f2493700 1 --2- 172.21.15.84:0/1381081551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec0a4250 0x7f81ec0abdd0 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f81e40032b0 tx=0x7f81e40100f0).stop 2020-01-16T05:47:52.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.476+0000 7f81f2493700 1 -- 172.21.15.84:0/1381081551 shutdown_connections 2020-01-16T05:47:52.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.476+0000 7f81f2493700 1 --2- 172.21.15.84:0/1381081551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec0a4250 0x7f81ec0abdd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:52.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.476+0000 7f81f2493700 1 -- 172.21.15.84:0/1381081551 shutdown_connections 2020-01-16T05:47:52.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.476+0000 7f81f2493700 1 -- 172.21.15.84:0/1381081551 wait complete. 2020-01-16T05:47:52.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.476+0000 7f81f2493700 1 -- 172.21.15.84:0/1381081551 >> 172.21.15.84:0/1381081551 conn(0x7f81ec0acfc0 msgr2=0x7f81ec0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:52.486 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.476+0000 7f81f2493700 1 Processor -- start 2020-01-16T05:47:52.486 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.476+0000 7f81f2493700 1 -- start start 2020-01-16T05:47:52.486 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f2493700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec07d6c0 0x7f81ec07c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:52.487 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f2493700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ec09f9f0 con 0x7f81ec13b310 2020-01-16T05:47:52.487 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f2493700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ec07bfb0 con 0x7f81ec126140 2020-01-16T05:47:52.487 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f2493700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec124690 con 0x7f81ec07d6c0 2020-01-16T05:47:52.487 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f36f5700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f81ec13b310 0x7f81ec13d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53464/0 (socket says 172.21.15.84:53464) 2020-01-16T05:47:52.487 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f36f5700 1 -- 172.21.15.84:0/3886431244 learned_addr learned my addr 172.21.15.84:0/3886431244 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:52.487 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f1c92700 1 --2- 172.21.15.84:0/3886431244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec07d6c0 0x7f81ec07c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:52.488 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81de7fc700 1 -- 172.21.15.84:0/3886431244 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457845548 0 0) 0x7f81ec09f9f0 con 0x7f81ec13b310 2020-01-16T05:47:52.488 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81de7fc700 1 -- 172.21.15.84:0/3886431244 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81d4003230 con 0x7f81ec13b310 2020-01-16T05:47:52.488 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81de7fc700 1 -- 172.21.15.84:0/3886431244 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884368978 0 0) 0x7f81ec07bfb0 con 0x7f81ec126140 2020-01-16T05:47:52.488 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81de7fc700 1 -- 172.21.15.84:0/3886431244 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81ec09f9f0 con 0x7f81ec126140 2020-01-16T05:47:52.488 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f1c92700 1 -- 172.21.15.84:0/3886431244 >> v1:172.21.15.142:6789/0 conn(0x7f81ec126140 legacy=0x7f81ec126570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:52.488 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f1c92700 1 -- 172.21.15.84:0/3886431244 >> v1:172.21.15.84:6789/0 conn(0x7f81ec13b310 legacy=0x7f81ec13d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:52.488 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f1c92700 1 -- 172.21.15.84:0/3886431244 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec07c820 con 0x7f81ec07d6c0 2020-01-16T05:47:52.489 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f1c92700 1 --2- 172.21.15.84:0/3886431244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec07d6c0 0x7f81ec07c2d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f81ec0a4da0 tx=0x7f81e00109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:52.489 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f1c92700 1 --2- 172.21.15.84:0/3886431244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec07d6c0 0x7f81ec07c2d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f81ec0a4da0 tx=0x7f81e00109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:52.489 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f1c92700 1 --2- 172.21.15.84:0/3886431244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec07d6c0 0x7f81ec07c2d0 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f81ec0a4da0 tx=0x7f81e00109a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:52.489 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f1c92700 1 --2- 172.21.15.84:0/3886431244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec07d6c0 0x7f81ec07c2d0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f81ec0a4da0 tx=0x7f81e00109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:52.489 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81de7fc700 1 -- 172.21.15.84:0/3886431244 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e0006cb0 con 0x7f81ec07d6c0 2020-01-16T05:47:52.490 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f1c92700 1 --2- 172.21.15.84:0/3886431244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec07d6c0 0x7f81ec07c2d0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f81ec0a4da0 tx=0x7f81e00109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:52.490 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81de7fc700 1 -- 172.21.15.84:0/3886431244 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e00068d0 con 0x7f81ec07d6c0 2020-01-16T05:47:52.490 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f2493700 1 -- 172.21.15.84:0/3886431244 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ec124270 con 0x7f81ec07d6c0 2020-01-16T05:47:52.490 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f1c92700 1 --2- 172.21.15.84:0/3886431244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec07d6c0 0x7f81ec07c2d0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f81ec0a4da0 tx=0x7f81e00109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:52.490 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81de7fc700 1 -- 172.21.15.84:0/3886431244 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e0012400 con 0x7f81ec07d6c0 2020-01-16T05:47:52.490 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f2493700 1 -- 172.21.15.84:0/3886431244 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81ec07daf0 con 0x7f81ec07d6c0 2020-01-16T05:47:52.490 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.480+0000 7f81f1c92700 1 --2- 172.21.15.84:0/3886431244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec07d6c0 0x7f81ec07c2d0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f81ec0a4da0 tx=0x7f81e00109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.484+0000 7f81f2493700 1 -- 172.21.15.84:0/3886431244 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ec05e1c0 con 0x7f81ec07d6c0 2020-01-16T05:47:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.484+0000 7f81de7fc700 1 -- 172.21.15.84:0/3886431244 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f81e00126e0 con 0x7f81ec07d6c0 2020-01-16T05:47:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.484+0000 7f81f1c92700 1 --2- 172.21.15.84:0/3886431244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec07d6c0 0x7f81ec07c2d0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f81ec0a4da0 tx=0x7f81e00109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.484+0000 7f81de7fc700 1 --2- 172.21.15.84:0/3886431244 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f81d403c930 0x7f81d403ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.484+0000 7f81de7fc700 1 -- 172.21.15.84:0/3886431244 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f81e004c8b0 con 0x7f81ec07d6c0 2020-01-16T05:47:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.484+0000 7f81f1491700 1 --2- 172.21.15.84:0/3886431244 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f81d403c930 0x7f81d403ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.484+0000 7f81f1491700 1 --2- 172.21.15.84:0/3886431244 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f81d403c930 0x7f81d403ee40 crc :-1 s=READY pgs=177 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:52.492 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.492+0000 7f81f1c92700 1 --2- 172.21.15.84:0/3886431244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec07d6c0 0x7f81ec07c2d0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f81ec0a4da0 tx=0x7f81e00109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:52.492 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.492+0000 7f81de7fc700 1 -- 172.21.15.84:0/3886431244 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f81e0032eb0 con 0x7f81ec07d6c0 2020-01-16T05:47:52.649 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.648+0000 7f81f2493700 1 -- 172.21.15.84:0/3886431244 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81ec07bcb0 con 0x7f81ec07d6c0 2020-01-16T05:47:52.650 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.652+0000 7f81f1c92700 1 --2- 172.21.15.84:0/3886431244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec07d6c0 0x7f81ec07c2d0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f81ec0a4da0 tx=0x7f81e00109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:52.650 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.652+0000 7f81de7fc700 1 -- 172.21.15.84:0/3886431244 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f81e0030430 con 0x7f81ec07d6c0 2020-01-16T05:47:52.650 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:52.651 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:52.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.652+0000 7f81f2493700 1 -- 172.21.15.84:0/3886431244 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f81d403c930 msgr2=0x7f81d403ee40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:52.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.652+0000 7f81f2493700 1 --2- 172.21.15.84:0/3886431244 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f81d403c930 0x7f81d403ee40 crc :-1 s=READY pgs=177 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:52.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.652+0000 7f81f2493700 1 -- 172.21.15.84:0/3886431244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec07d6c0 msgr2=0x7f81ec07c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:52.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.652+0000 7f81f2493700 1 --2- 172.21.15.84:0/3886431244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec07d6c0 0x7f81ec07c2d0 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f81ec0a4da0 tx=0x7f81e00109a0).stop 2020-01-16T05:47:52.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.652+0000 7f81f2493700 1 -- 172.21.15.84:0/3886431244 shutdown_connections 2020-01-16T05:47:52.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.652+0000 7f81f2493700 1 --2- 172.21.15.84:0/3886431244 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f81d403c930 0x7f81d403ee40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:52.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.652+0000 7f81f2493700 1 --2- 172.21.15.84:0/3886431244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81ec07d6c0 0x7f81ec07c2d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:52.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.652+0000 7f81f2493700 1 -- 172.21.15.84:0/3886431244 shutdown_connections 2020-01-16T05:47:52.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.652+0000 7f81f2493700 1 -- 172.21.15.84:0/3886431244 wait complete. 2020-01-16T05:47:52.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:52.652+0000 7f81f2493700 1 -- 172.21.15.84:0/3886431244 >> 172.21.15.84:0/3886431244 conn(0x7f81ec0acfc0 msgr2=0x7f81ec07cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:52.655 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:52.671 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:54.672 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:54.800 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa2974700 1 Processor -- start 2020-01-16T05:47:54.800 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa2974700 1 -- start start 2020-01-16T05:47:54.800 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa2974700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fea9c05b0f0 0x7fea9c0a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:54.801 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa2974700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fea9c08fd80 0x7fea9c1503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:54.801 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa2974700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9c07cd60 con 0x7fea9c0a2f60 2020-01-16T05:47:54.801 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa2974700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea9c0a3390 con 0x7fea9c08fd80 2020-01-16T05:47:54.801 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa2974700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea9c0905b0 con 0x7fea9c05b0f0 2020-01-16T05:47:54.801 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa1712700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fea9c08fd80 0x7fea9c1503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:54.801 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa1712700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fea9c08fd80 0x7fea9c1503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36280/0 (socket says 172.21.15.84:36280) 2020-01-16T05:47:54.802 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa1712700 1 -- 172.21.15.84:0/2333537136 learned_addr learned my addr 172.21.15.84:0/2333537136 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:47:54.802 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa0f11700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fea9c0a2f60 0x7fea9c07c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53476/0 (socket says 172.21.15.84:53476) 2020-01-16T05:47:54.802 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7fea9bfff700 1 --2- 172.21.15.84:0/2333537136 >> v2:172.21.15.142:3300/0 conn(0x7fea9c05b0f0 0x7fea9c0a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:54.802 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa1712700 1 -- 172.21.15.84:0/2333537136 >> v2:172.21.15.142:3300/0 conn(0x7fea9c05b0f0 msgr2=0x7fea9c0a8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:54.802 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa1712700 1 --2- 172.21.15.84:0/2333537136 >> v2:172.21.15.142:3300/0 conn(0x7fea9c05b0f0 0x7fea9c0a8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:54.802 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa1712700 1 -- 172.21.15.84:0/2333537136 >> v1:172.21.15.84:6789/0 conn(0x7fea9c0a2f60 legacy=0x7fea9c07c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:54.802 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa1712700 1 -- 172.21.15.84:0/2333537136 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c05b520 con 0x7fea9c08fd80 2020-01-16T05:47:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7fea9b7fe700 1 -- 172.21.15.84:0/2333537136 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319796287 0 0) 0x7fea9c07cd60 con 0x7fea9c0a2f60 2020-01-16T05:47:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa1712700 1 --2- 172.21.15.84:0/2333537136 >> v2:172.21.15.84:3300/0 conn(0x7fea9c08fd80 0x7fea9c1503f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fea9c0a2530 tx=0x7fea94010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa1712700 1 --2- 172.21.15.84:0/2333537136 >> v2:172.21.15.84:3300/0 conn(0x7fea9c08fd80 0x7fea9c1503f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fea9c0a2530 tx=0x7fea94010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa1712700 1 --2- 172.21.15.84:0/2333537136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea9c08fd80 0x7fea9c1503f0 secure :-1 s=READY pgs=458 cs=0 l=1 rx=0x7fea9c0a2530 tx=0x7fea94010230).ready entity=mon.0 client_cookie=502af7a4a9261be1 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.796+0000 7feaa1712700 1 --2- 172.21.15.84:0/2333537136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea9c08fd80 0x7fea9c1503f0 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7fea9c0a2530 tx=0x7fea94010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.800+0000 7fea9b7fe700 1 -- 172.21.15.84:0/2333537136 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea9400a160 con 0x7fea9c08fd80 2020-01-16T05:47:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.800+0000 7feaa1712700 1 --2- 172.21.15.84:0/2333537136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea9c08fd80 0x7fea9c1503f0 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7fea9c0a2530 tx=0x7fea94010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:54.804 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.800+0000 7feaa1712700 1 --2- 172.21.15.84:0/2333537136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea9c08fd80 0x7fea9c1503f0 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7fea9c0a2530 tx=0x7fea94010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:54.804 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.800+0000 7fea9b7fe700 1 -- 172.21.15.84:0/2333537136 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea94011b70 con 0x7fea9c08fd80 2020-01-16T05:47:54.804 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.800+0000 7fea9b7fe700 1 -- 172.21.15.84:0/2333537136 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea9400a740 con 0x7fea9c08fd80 2020-01-16T05:47:54.804 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.800+0000 7feaa2974700 1 -- 172.21.15.84:0/2333537136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea9c08fd80 msgr2=0x7fea9c1503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:54.804 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.800+0000 7feaa2974700 1 --2- 172.21.15.84:0/2333537136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea9c08fd80 0x7fea9c1503f0 secure :-1 s=READY pgs=458 cs=0 l=1 rx=0x7fea9c0a2530 tx=0x7fea94010230).stop 2020-01-16T05:47:54.804 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.800+0000 7feaa2974700 1 -- 172.21.15.84:0/2333537136 shutdown_connections 2020-01-16T05:47:54.804 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.800+0000 7feaa2974700 1 --2- 172.21.15.84:0/2333537136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea9c08fd80 0x7fea9c1503f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:54.805 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.800+0000 7feaa2974700 1 --2- 172.21.15.84:0/2333537136 >> v2:172.21.15.142:3300/0 conn(0x7fea9c05b0f0 0x7fea9c0a8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:54.805 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.800+0000 7feaa2974700 1 -- 172.21.15.84:0/2333537136 shutdown_connections 2020-01-16T05:47:54.805 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.800+0000 7feaa2974700 1 -- 172.21.15.84:0/2333537136 wait complete. 2020-01-16T05:47:54.805 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.800+0000 7feaa2974700 1 -- 172.21.15.84:0/2333537136 >> 172.21.15.84:0/2333537136 conn(0x7fea9c0abc10 msgr2=0x7fea9c05a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:54.808 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.800+0000 7feaa2974700 1 Processor -- start 2020-01-16T05:47:54.808 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.800+0000 7feaa2974700 1 -- start start 2020-01-16T05:47:54.811 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa2974700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fea9c133650 0x7fea9c13af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:54.811 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa2974700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9c07c2e0 con 0x7fea9c07e670 2020-01-16T05:47:54.811 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa2974700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9c07fe00 con 0x7fea9c09c400 2020-01-16T05:47:54.811 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa2974700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea9c080030 con 0x7fea9c133650 2020-01-16T05:47:54.811 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa1712700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fea9c133650 0x7fea9c13af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:54.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7fea9bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fea9c07e670 0x7fea9c132e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53486/0 (socket says 172.21.15.84:53486) 2020-01-16T05:47:54.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa1712700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fea9c133650 0x7fea9c13af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36284/0 (socket says 172.21.15.84:36284) 2020-01-16T05:47:54.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7fea9bfff700 1 -- 172.21.15.84:0/503668896 learned_addr learned my addr 172.21.15.84:0/503668896 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:54.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa1712700 1 -- 172.21.15.84:0/503668896 >> v1:172.21.15.142:6789/0 conn(0x7fea9c09c400 legacy=0x7fea9c07bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:54.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa1712700 1 -- 172.21.15.84:0/503668896 >> v1:172.21.15.84:6789/0 conn(0x7fea9c07e670 legacy=0x7fea9c132e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:54.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa1712700 1 -- 172.21.15.84:0/503668896 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c13d4e0 con 0x7fea9c133650 2020-01-16T05:47:54.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7fea997fa700 1 -- 172.21.15.84:0/503668896 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498302089 0 0) 0x7fea9c07c2e0 con 0x7fea9c07e670 2020-01-16T05:47:54.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa1712700 1 --2- 172.21.15.84:0/503668896 >> v2:172.21.15.84:3300/0 conn(0x7fea9c133650 0x7fea9c13af70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fea9c0a6b80 tx=0x7fea9400ac10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:54.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa1712700 1 --2- 172.21.15.84:0/503668896 >> v2:172.21.15.84:3300/0 conn(0x7fea9c133650 0x7fea9c13af70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fea9c0a6b80 tx=0x7fea9400ac10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:54.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa1712700 1 --2- 172.21.15.84:0/503668896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea9c133650 0x7fea9c13af70 secure :-1 s=READY pgs=460 cs=0 l=1 rx=0x7fea9c0a6b80 tx=0x7fea9400ac10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:54.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa1712700 1 --2- 172.21.15.84:0/503668896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea9c133650 0x7fea9c13af70 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7fea9c0a6b80 tx=0x7fea9400ac10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:54.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa1712700 1 --2- 172.21.15.84:0/503668896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea9c133650 0x7fea9c13af70 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7fea9c0a6b80 tx=0x7fea9400ac10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:54.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7fea997fa700 1 -- 172.21.15.84:0/503668896 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea94005c30 con 0x7fea9c133650 2020-01-16T05:47:54.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa1712700 1 --2- 172.21.15.84:0/503668896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea9c133650 0x7fea9c13af70 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7fea9c0a6b80 tx=0x7fea9400ac10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:54.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7fea997fa700 1 -- 172.21.15.84:0/503668896 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9400a360 con 0x7fea9c133650 2020-01-16T05:47:54.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7fea997fa700 1 -- 172.21.15.84:0/503668896 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea9400f950 con 0x7fea9c133650 2020-01-16T05:47:54.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa2974700 1 -- 172.21.15.84:0/503668896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9c13b4c0 con 0x7fea9c133650 2020-01-16T05:47:54.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa2974700 1 -- 172.21.15.84:0/503668896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c13b990 con 0x7fea9c133650 2020-01-16T05:47:54.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa1712700 1 --2- 172.21.15.84:0/503668896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea9c133650 0x7fea9c13af70 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7fea9c0a6b80 tx=0x7fea9400ac10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:54.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa2974700 1 -- 172.21.15.84:0/503668896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9c099720 con 0x7fea9c133650 2020-01-16T05:47:54.814 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7fea997fa700 1 -- 172.21.15.84:0/503668896 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fea94007150 con 0x7fea9c133650 2020-01-16T05:47:54.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7feaa1712700 1 --2- 172.21.15.84:0/503668896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea9c133650 0x7fea9c13af70 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7fea9c0a6b80 tx=0x7fea9400ac10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:54.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7fea997fa700 1 --2- 172.21.15.84:0/503668896 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fea7c03c1c0 0x7fea7c03e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:54.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.804+0000 7fea997fa700 1 -- 172.21.15.84:0/503668896 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fea9404d590 con 0x7fea9c133650 2020-01-16T05:47:54.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.808+0000 7feaa0f11700 1 --2- 172.21.15.84:0/503668896 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fea7c03c1c0 0x7fea7c03e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:54.815 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.808+0000 7feaa0f11700 1 --2- 172.21.15.84:0/503668896 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fea7c03c1c0 0x7fea7c03e6d0 crc :-1 s=READY pgs=178 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:54.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.812+0000 7feaa1712700 1 --2- 172.21.15.84:0/503668896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea9c133650 0x7fea9c13af70 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7fea9c0a6b80 tx=0x7fea9400ac10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:54.816 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.812+0000 7fea997fa700 1 -- 172.21.15.84:0/503668896 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fea9c05b520 con 0x7fea9c133650 2020-01-16T05:47:54.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.964+0000 7feaa2974700 1 -- 172.21.15.84:0/503668896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea9c05e1c0 con 0x7fea9c133650 2020-01-16T05:47:54.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.964+0000 7feaa1712700 1 --2- 172.21.15.84:0/503668896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea9c133650 0x7fea9c13af70 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7fea9c0a6b80 tx=0x7fea9400ac10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:54.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.964+0000 7fea997fa700 1 -- 172.21.15.84:0/503668896 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fea94033bb0 con 0x7fea9c133650 2020-01-16T05:47:54.964 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:54.965 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:54.966 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.964+0000 7feaa2974700 1 -- 172.21.15.84:0/503668896 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fea7c03c1c0 msgr2=0x7fea7c03e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:54.966 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.964+0000 7feaa2974700 1 --2- 172.21.15.84:0/503668896 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fea7c03c1c0 0x7fea7c03e6d0 crc :-1 s=READY pgs=178 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:54.966 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.964+0000 7feaa2974700 1 -- 172.21.15.84:0/503668896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea9c133650 msgr2=0x7fea9c13af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:54.967 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.964+0000 7feaa2974700 1 --2- 172.21.15.84:0/503668896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea9c133650 0x7fea9c13af70 secure :-1 s=READY pgs=460 cs=0 l=1 rx=0x7fea9c0a6b80 tx=0x7fea9400ac10).stop 2020-01-16T05:47:54.967 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.968+0000 7feaa2974700 1 -- 172.21.15.84:0/503668896 shutdown_connections 2020-01-16T05:47:54.967 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.968+0000 7feaa2974700 1 --2- 172.21.15.84:0/503668896 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fea7c03c1c0 0x7fea7c03e6d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:54.967 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.968+0000 7feaa2974700 1 --2- 172.21.15.84:0/503668896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea9c133650 0x7fea9c13af70 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:54.967 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.968+0000 7feaa2974700 1 -- 172.21.15.84:0/503668896 shutdown_connections 2020-01-16T05:47:54.967 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.968+0000 7feaa2974700 1 -- 172.21.15.84:0/503668896 wait complete. 2020-01-16T05:47:54.967 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:54.968+0000 7feaa2974700 1 -- 172.21.15.84:0/503668896 >> 172.21.15.84:0/503668896 conn(0x7fea9c0a8730 msgr2=0x7fea9c09cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:54.968 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:54.978 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:47:56.402 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~209s 2020-01-16T05:47:56.979 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.100+0000 7f5f374c3700 1 Processor -- start 2020-01-16T05:47:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.100+0000 7f5f374c3700 1 -- start start 2020-01-16T05:47:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.100+0000 7f5f374c3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f3007ff10 0x7f5f300abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.100+0000 7f5f374c3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f30066880 con 0x7f5f300a9b30 2020-01-16T05:47:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.100+0000 7f5f374c3700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f30066ab0 con 0x7f5f300a4250 2020-01-16T05:47:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.100+0000 7f5f374c3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f300a4830 con 0x7f5f3007ff10 2020-01-16T05:47:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f36cc2700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5f300a9b30 0x7f5f300a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53490/0 (socket says 172.21.15.84:53490) 2020-01-16T05:47:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f36cc2700 1 -- 172.21.15.84:0/3117911472 learned_addr learned my addr 172.21.15.84:0/3117911472 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f364c1700 1 --2- 172.21.15.84:0/3117911472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f3007ff10 0x7f5f300abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f35cc0700 1 -- 172.21.15.84:0/3117911472 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716510942 0 0) 0x7f5f30066880 con 0x7f5f300a9b30 2020-01-16T05:47:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f35cc0700 1 -- 172.21.15.84:0/3117911472 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f1c003230 con 0x7f5f300a9b30 2020-01-16T05:47:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f35cc0700 1 -- 172.21.15.84:0/3117911472 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1054103792 0 0) 0x7f5f1c003230 con 0x7f5f300a9b30 2020-01-16T05:47:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f35cc0700 1 -- 172.21.15.84:0/3117911472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f3007ff10 msgr2=0x7f5f300abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f35cc0700 1 --2- 172.21.15.84:0/3117911472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f3007ff10 0x7f5f300abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f35cc0700 1 -- 172.21.15.84:0/3117911472 >> v1:172.21.15.142:6789/0 conn(0x7f5f300a4250 legacy=0x7f5f3014fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f35cc0700 1 -- 172.21.15.84:0/3117911472 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f30066ce0 con 0x7f5f300a9b30 2020-01-16T05:47:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f35cc0700 1 -- 172.21.15.84:0/3117911472 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f5f2c001ad0 con 0x7f5f300a9b30 2020-01-16T05:47:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f35cc0700 1 -- 172.21.15.84:0/3117911472 >> v1:172.21.15.84:6789/0 conn(0x7f5f300a9b30 legacy=0x7f5f300a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f35cc0700 1 --2- 172.21.15.84:0/3117911472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f1c003890 0x7f5f1c003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f35cc0700 1 --2- 172.21.15.84:0/3117911472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f1c0045a0 0x7f5f1c0049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f35cc0700 1 --2- 172.21.15.84:0/3117911472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f1c004f20 0x7f5f1c00b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:57.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f35cc0700 1 -- 172.21.15.84:0/3117911472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f300a4830 con 0x7f5f1c003890 2020-01-16T05:47:57.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f35cc0700 1 -- 172.21.15.84:0/3117911472 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c005350 con 0x7f5f1c0045a0 2020-01-16T05:47:57.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f35cc0700 1 -- 172.21.15.84:0/3117911472 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c04fd50 con 0x7f5f1c004f20 2020-01-16T05:47:57.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f36cc2700 1 --2- 172.21.15.84:0/3117911472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f1c003890 0x7f5f1c003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:57.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f364c1700 1 --2- 172.21.15.84:0/3117911472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f1c0045a0 0x7f5f1c0049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:57.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f38725700 1 --2- 172.21.15.84:0/3117911472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f1c004f20 0x7f5f1c00b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:57.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f36cc2700 1 -- 172.21.15.84:0/3117911472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f1c004f20 msgr2=0x7f5f1c00b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:57.110 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f36cc2700 1 --2- 172.21.15.84:0/3117911472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f1c004f20 0x7f5f1c00b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:57.110 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f36cc2700 1 -- 172.21.15.84:0/3117911472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f1c0045a0 msgr2=0x7f5f1c0049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:47:57.110 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f36cc2700 1 --2- 172.21.15.84:0/3117911472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f1c0045a0 0x7f5f1c0049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:47:57.110 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f36cc2700 1 -- 172.21.15.84:0/3117911472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c04ffd0 con 0x7f5f1c003890 2020-01-16T05:47:57.110 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f36cc2700 1 --2- 172.21.15.84:0/3117911472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f1c003890 0x7f5f1c003cc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5f2c0017e0 tx=0x7f5f2c00c6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:57.110 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f36cc2700 1 --2- 172.21.15.84:0/3117911472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f1c003890 0x7f5f1c003cc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5f2c0017e0 tx=0x7f5f2c00c6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:57.110 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f36cc2700 1 --2- 172.21.15.84:0/3117911472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f1c003890 0x7f5f1c003cc0 secure :-1 s=READY pgs=462 cs=0 l=1 rx=0x7f5f2c0017e0 tx=0x7f5f2c00c6e0).ready entity=mon.0 client_cookie=cd695d68cb451e8b server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:57.111 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f36cc2700 1 --2- 172.21.15.84:0/3117911472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f1c003890 0x7f5f1c003cc0 secure :-1 s=THROTTLE_DONE pgs=462 cs=0 l=1 rx=0x7f5f2c0017e0 tx=0x7f5f2c00c6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:57.111 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f35cc0700 1 -- 172.21.15.84:0/3117911472 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f2c00b4a0 con 0x7f5f1c003890 2020-01-16T05:47:57.111 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f36cc2700 1 --2- 172.21.15.84:0/3117911472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f1c003890 0x7f5f1c003cc0 secure :-1 s=THROTTLE_DONE pgs=462 cs=0 l=1 rx=0x7f5f2c0017e0 tx=0x7f5f2c00c6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:57.111 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f35cc0700 1 -- 172.21.15.84:0/3117911472 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c00b0c0 con 0x7f5f1c003890 2020-01-16T05:47:57.111 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f36cc2700 1 --2- 172.21.15.84:0/3117911472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f1c003890 0x7f5f1c003cc0 secure :-1 s=THROTTLE_DONE pgs=462 cs=0 l=1 rx=0x7f5f2c0017e0 tx=0x7f5f2c00c6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:57.111 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f35cc0700 1 -- 172.21.15.84:0/3117911472 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f2c012130 con 0x7f5f1c003890 2020-01-16T05:47:57.111 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f374c3700 1 -- 172.21.15.84:0/3117911472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f1c003890 msgr2=0x7f5f1c003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f374c3700 1 --2- 172.21.15.84:0/3117911472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f1c003890 0x7f5f1c003cc0 secure :-1 s=READY pgs=462 cs=0 l=1 rx=0x7f5f2c0017e0 tx=0x7f5f2c00c6e0).stop 2020-01-16T05:47:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f38725700 1 -- 172.21.15.84:0/3117911472 reap_dead start 2020-01-16T05:47:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f374c3700 1 -- 172.21.15.84:0/3117911472 shutdown_connections 2020-01-16T05:47:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f374c3700 1 -- 172.21.15.84:0/3117911472 shutdown_connections 2020-01-16T05:47:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f374c3700 1 -- 172.21.15.84:0/3117911472 wait complete. 2020-01-16T05:47:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.104+0000 7f5f374c3700 1 -- 172.21.15.84:0/3117911472 >> 172.21.15.84:0/3117911472 conn(0x7f5f300acfc0 msgr2=0x7f5f300a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:57.115 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f374c3700 1 Processor -- start 2020-01-16T05:47:57.115 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f374c3700 1 -- start start 2020-01-16T05:47:57.115 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f374c3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f300a33a0 0x7f5f301388e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:57.115 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f374c3700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5f30134b60 0x7f5f3009f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:57.115 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f374c3700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f30138e30 con 0x7f5f30124700 2020-01-16T05:47:57.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f374c3700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f30138140 con 0x7f5f30134b60 2020-01-16T05:47:57.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f374c3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f301383a0 con 0x7f5f300a33a0 2020-01-16T05:47:57.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f364c1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f300a33a0 0x7f5f301388e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:57.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f36cc2700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5f30124700 0x7f5f3007d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:51728/0 (socket says 172.21.15.84:51728) 2020-01-16T05:47:57.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f38725700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5f30134b60 0x7f5f3009f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:57.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f36cc2700 1 -- 172.21.15.84:0/4004927468 learned_addr learned my addr 172.21.15.84:0/4004927468 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:57.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f364c1700 1 -- 172.21.15.84:0/4004927468 >> v2:172.21.15.142:3300/0 conn(0x7f5f30134b60 msgr2=0x7f5f3009f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:57.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f364c1700 1 --2- 172.21.15.84:0/4004927468 >> v2:172.21.15.142:3300/0 conn(0x7f5f30134b60 0x7f5f3009f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:57.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f364c1700 1 -- 172.21.15.84:0/4004927468 >> v1:172.21.15.142:6789/0 conn(0x7f5f30124700 legacy=0x7f5f3007d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:57.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f364c1700 1 -- 172.21.15.84:0/4004927468 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3009f670 con 0x7f5f300a33a0 2020-01-16T05:47:57.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f364c1700 1 --2- 172.21.15.84:0/4004927468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f300a33a0 0x7f5f301388e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5f20002f30 tx=0x7f5f20010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:57.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f364c1700 1 --2- 172.21.15.84:0/4004927468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f300a33a0 0x7f5f301388e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5f20002f30 tx=0x7f5f20010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:57.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f364c1700 1 --2- 172.21.15.84:0/4004927468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f300a33a0 0x7f5f301388e0 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f5f20002f30 tx=0x7f5f20010cb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:57.117 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f364c1700 1 --2- 172.21.15.84:0/4004927468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f300a33a0 0x7f5f301388e0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f5f20002f30 tx=0x7f5f20010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:57.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f277fe700 1 -- 172.21.15.84:0/4004927468 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f20007160 con 0x7f5f300a33a0 2020-01-16T05:47:57.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f364c1700 1 --2- 172.21.15.84:0/4004927468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f300a33a0 0x7f5f301388e0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f5f20002f30 tx=0x7f5f20010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:57.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f364c1700 1 --2- 172.21.15.84:0/4004927468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f300a33a0 0x7f5f301388e0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f5f20002f30 tx=0x7f5f20010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:57.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f277fe700 1 -- 172.21.15.84:0/4004927468 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f20005ab0 con 0x7f5f300a33a0 2020-01-16T05:47:57.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f277fe700 1 -- 172.21.15.84:0/4004927468 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f200083e0 con 0x7f5f300a33a0 2020-01-16T05:47:57.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f374c3700 1 -- 172.21.15.84:0/4004927468 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3009f9a0 con 0x7f5f300a33a0 2020-01-16T05:47:57.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.108+0000 7f5f374c3700 1 -- 172.21.15.84:0/4004927468 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3013f490 con 0x7f5f300a33a0 2020-01-16T05:47:57.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.112+0000 7f5f364c1700 1 --2- 172.21.15.84:0/4004927468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f300a33a0 0x7f5f301388e0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f5f20002f30 tx=0x7f5f20010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:57.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.112+0000 7f5f374c3700 1 -- 172.21.15.84:0/4004927468 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3005e1c0 con 0x7f5f300a33a0 2020-01-16T05:47:57.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.112+0000 7f5f277fe700 1 -- 172.21.15.84:0/4004927468 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f5f200086f0 con 0x7f5f300a33a0 2020-01-16T05:47:57.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.112+0000 7f5f364c1700 1 --2- 172.21.15.84:0/4004927468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f300a33a0 0x7f5f301388e0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f5f20002f30 tx=0x7f5f20010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:57.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.112+0000 7f5f277fe700 1 --2- 172.21.15.84:0/4004927468 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5f1803c270 0x7f5f1803e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:57.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.112+0000 7f5f277fe700 1 -- 172.21.15.84:0/4004927468 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f5f2004cd50 con 0x7f5f300a33a0 2020-01-16T05:47:57.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.112+0000 7f5f36cc2700 1 --2- 172.21.15.84:0/4004927468 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5f1803c270 0x7f5f1803e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:57.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.112+0000 7f5f36cc2700 1 --2- 172.21.15.84:0/4004927468 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5f1803c270 0x7f5f1803e780 crc :-1 s=READY pgs=179 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:57.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.120+0000 7f5f364c1700 1 --2- 172.21.15.84:0/4004927468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f300a33a0 0x7f5f301388e0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f5f20002f30 tx=0x7f5f20010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:57.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.120+0000 7f5f277fe700 1 -- 172.21.15.84:0/4004927468 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f5f20033330 con 0x7f5f300a33a0 2020-01-16T05:47:57.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.272+0000 7f5f374c3700 1 -- 172.21.15.84:0/4004927468 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f3005cbc0 con 0x7f5f300a33a0 2020-01-16T05:47:57.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.272+0000 7f5f364c1700 1 --2- 172.21.15.84:0/4004927468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f300a33a0 0x7f5f301388e0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f5f20002f30 tx=0x7f5f20010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:57.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.272+0000 7f5f277fe700 1 -- 172.21.15.84:0/4004927468 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f5f20033590 con 0x7f5f300a33a0 2020-01-16T05:47:57.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.276+0000 7f5f374c3700 1 -- 172.21.15.84:0/4004927468 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5f1803c270 msgr2=0x7f5f1803e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:57.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.276+0000 7f5f374c3700 1 --2- 172.21.15.84:0/4004927468 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5f1803c270 0x7f5f1803e780 crc :-1 s=READY pgs=179 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:57.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.276+0000 7f5f374c3700 1 -- 172.21.15.84:0/4004927468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f300a33a0 msgr2=0x7f5f301388e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:57.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.276+0000 7f5f374c3700 1 --2- 172.21.15.84:0/4004927468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f300a33a0 0x7f5f301388e0 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f5f20002f30 tx=0x7f5f20010cb0).stop 2020-01-16T05:47:57.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.276+0000 7f5f374c3700 1 -- 172.21.15.84:0/4004927468 shutdown_connections 2020-01-16T05:47:57.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.276+0000 7f5f374c3700 1 --2- 172.21.15.84:0/4004927468 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5f1803c270 0x7f5f1803e780 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:57.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.276+0000 7f5f374c3700 1 --2- 172.21.15.84:0/4004927468 >> v2:172.21.15.142:3300/0 conn(0x7f5f30134b60 0x7f5f3009f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:57.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.276+0000 7f5f374c3700 1 --2- 172.21.15.84:0/4004927468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f300a33a0 0x7f5f301388e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:57.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.276+0000 7f5f374c3700 1 -- 172.21.15.84:0/4004927468 shutdown_connections 2020-01-16T05:47:57.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.276+0000 7f5f374c3700 1 -- 172.21.15.84:0/4004927468 wait complete. 2020-01-16T05:47:57.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:57.276+0000 7f5f374c3700 1 -- 172.21.15.84:0/4004927468 >> 172.21.15.84:0/4004927468 conn(0x7f5f300a9040 msgr2=0x7f5f300665b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:57.285 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:57.285 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:57.285 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:57.288 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:47:59.291 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:47:59.415 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.408+0000 7fb35af11700 1 Processor -- start 2020-01-16T05:47:59.415 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.408+0000 7fb35af11700 1 -- start start 2020-01-16T05:47:59.415 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.408+0000 7fb35af11700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3540a9b30 0x7fb3540abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:47:59.416 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.408+0000 7fb35af11700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb354066880 con 0x7fb3540a4250 2020-01-16T05:47:59.416 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.408+0000 7fb35af11700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb354066ab0 con 0x7fb35407ff10 2020-01-16T05:47:59.416 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.408+0000 7fb35af11700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540a4830 con 0x7fb3540a9b30 2020-01-16T05:47:59.416 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35c173700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb3540a4250 0x7fb35414fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53516/0 (socket says 172.21.15.84:53516) 2020-01-16T05:47:59.416 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35c173700 1 -- 172.21.15.84:0/2948015881 learned_addr learned my addr 172.21.15.84:0/2948015881 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:59.416 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35a710700 1 --2- 172.21.15.84:0/2948015881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3540a9b30 0x7fb3540abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:59.416 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35970e700 1 -- 172.21.15.84:0/2948015881 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682036133 0 0) 0x7fb354066880 con 0x7fb3540a4250 2020-01-16T05:47:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35970e700 1 -- 172.21.15.84:0/2948015881 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb340003230 con 0x7fb3540a4250 2020-01-16T05:47:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35970e700 1 -- 172.21.15.84:0/2948015881 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496267725 0 0) 0x7fb354066ab0 con 0x7fb35407ff10 2020-01-16T05:47:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35970e700 1 -- 172.21.15.84:0/2948015881 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb354066880 con 0x7fb35407ff10 2020-01-16T05:47:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35a710700 1 -- 172.21.15.84:0/2948015881 >> v1:172.21.15.142:6789/0 conn(0x7fb35407ff10 legacy=0x7fb3540a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35a710700 1 -- 172.21.15.84:0/2948015881 >> v1:172.21.15.84:6789/0 conn(0x7fb3540a4250 legacy=0x7fb35414fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35a710700 1 -- 172.21.15.84:0/2948015881 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb354066ce0 con 0x7fb3540a9b30 2020-01-16T05:47:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35a710700 1 --2- 172.21.15.84:0/2948015881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3540a9b30 0x7fb3540abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb34c0032b0 tx=0x7fb34c0100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:59.418 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35a710700 1 --2- 172.21.15.84:0/2948015881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3540a9b30 0x7fb3540abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb34c0032b0 tx=0x7fb34c0100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:59.418 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35a710700 1 --2- 172.21.15.84:0/2948015881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3540a9b30 0x7fb3540abdd0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fb34c0032b0 tx=0x7fb34c0100f0).ready entity=mon.2 client_cookie=3b90eaa1dff5793a server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:59.418 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35a710700 1 --2- 172.21.15.84:0/2948015881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3540a9b30 0x7fb3540abdd0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fb34c0032b0 tx=0x7fb34c0100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:59.418 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35970e700 1 -- 172.21.15.84:0/2948015881 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb34c00a160 con 0x7fb3540a9b30 2020-01-16T05:47:59.418 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35a710700 1 --2- 172.21.15.84:0/2948015881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3540a9b30 0x7fb3540abdd0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fb34c0032b0 tx=0x7fb34c0100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:59.418 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35970e700 1 -- 172.21.15.84:0/2948015881 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c011ba0 con 0x7fb3540a9b30 2020-01-16T05:47:59.418 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35a710700 1 --2- 172.21.15.84:0/2948015881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3540a9b30 0x7fb3540abdd0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fb34c0032b0 tx=0x7fb34c0100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:59.419 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35970e700 1 -- 172.21.15.84:0/2948015881 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb34c00a740 con 0x7fb3540a9b30 2020-01-16T05:47:59.419 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35af11700 1 -- 172.21.15.84:0/2948015881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3540a9b30 msgr2=0x7fb3540abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:59.419 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35af11700 1 --2- 172.21.15.84:0/2948015881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3540a9b30 0x7fb3540abdd0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fb34c0032b0 tx=0x7fb34c0100f0).stop 2020-01-16T05:47:59.419 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35af11700 1 -- 172.21.15.84:0/2948015881 shutdown_connections 2020-01-16T05:47:59.419 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35af11700 1 --2- 172.21.15.84:0/2948015881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3540a9b30 0x7fb3540abdd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:59.419 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35af11700 1 -- 172.21.15.84:0/2948015881 shutdown_connections 2020-01-16T05:47:59.419 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35af11700 1 -- 172.21.15.84:0/2948015881 wait complete. 2020-01-16T05:47:59.419 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.412+0000 7fb35af11700 1 -- 172.21.15.84:0/2948015881 >> 172.21.15.84:0/2948015881 conn(0x7fb3540acfc0 msgr2=0x7fb3540a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35af11700 1 Processor -- start 2020-01-16T05:47:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35af11700 1 -- start start 2020-01-16T05:47:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35af11700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3540a0700 0x7fb354091120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35af11700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb354135fa0 0x7fb354128970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35af11700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35409f920 con 0x7fb35407b760 2020-01-16T05:47:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35af11700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3541363d0 con 0x7fb354135fa0 2020-01-16T05:47:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35af11700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb354128ec0 con 0x7fb3540a0700 2020-01-16T05:47:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35a710700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb35407b760 0x7fb35409f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53520/0 (socket says 172.21.15.84:53520) 2020-01-16T05:47:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35a710700 1 -- 172.21.15.84:0/1238364593 learned_addr learned my addr 172.21.15.84:0/1238364593 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:47:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35c173700 1 --2- 172.21.15.84:0/1238364593 >> v2:172.21.15.142:3300/0 conn(0x7fb354135fa0 0x7fb354128970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb359f0f700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3540a0700 0x7fb354091120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 -- 172.21.15.84:0/1238364593 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260493697 0 0) 0x7fb35409f920 con 0x7fb35407b760 2020-01-16T05:47:59.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 -- 172.21.15.84:0/1238364593 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb33c003230 con 0x7fb35407b760 2020-01-16T05:47:59.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 -- 172.21.15.84:0/1238364593 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3555045650 0 0) 0x7fb33c003230 con 0x7fb35407b760 2020-01-16T05:47:59.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 -- 172.21.15.84:0/1238364593 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb35409f920 con 0x7fb35407b760 2020-01-16T05:47:59.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 -- 172.21.15.84:0/1238364593 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7fb34c00a160 con 0x7fb35407b760 2020-01-16T05:47:59.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 -- 172.21.15.84:0/1238364593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3540a0700 msgr2=0x7fb354091120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3540a0700 0x7fb354091120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 -- 172.21.15.84:0/1238364593 >> v2:172.21.15.142:3300/0 conn(0x7fb354135fa0 msgr2=0x7fb354128970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 --2- 172.21.15.84:0/1238364593 >> v2:172.21.15.142:3300/0 conn(0x7fb354135fa0 0x7fb354128970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 -- 172.21.15.84:0/1238364593 >> v1:172.21.15.84:6789/0 conn(0x7fb35407b760 legacy=0x7fb35409f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb33c003a20 0x7fb33c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb33c0045a0 0x7fb33c0049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb33c004f20 0x7fb33c00b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:59.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 -- 172.21.15.84:0/1238364593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3541363d0 con 0x7fb33c004f20 2020-01-16T05:47:59.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 -- 172.21.15.84:0/1238364593 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb354128ec0 con 0x7fb33c0045a0 2020-01-16T05:47:59.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 -- 172.21.15.84:0/1238364593 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c00bd40 con 0x7fb33c003a20 2020-01-16T05:47:59.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb359f0f700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb33c0045a0 0x7fb33c0049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:59.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35a710700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb33c003a20 0x7fb33c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:59.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35c173700 1 --2- 172.21.15.84:0/1238364593 >> v2:172.21.15.142:3300/0 conn(0x7fb354135fa0 0x7fb354128970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:47:59.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35c173700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb33c004f20 0x7fb33c00b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb359f0f700 1 -- 172.21.15.84:0/1238364593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb33c0045a0 msgr2=0x7fb33c0049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2020-01-16T05:47:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb359f0f700 1 -- 172.21.15.84:0/1238364593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb33c0045a0 msgr2=0x7fb33c0049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-01-16T05:47:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb359f0f700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb33c0045a0 0x7fb33c0049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-01-16T05:47:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb359f0f700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb33c0045a0 0x7fb33c0049d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-16T05:47:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35c173700 1 -- 172.21.15.84:0/1238364593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb33c003a20 msgr2=0x7fb33c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35c173700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb33c003a20 0x7fb33c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35c173700 1 -- 172.21.15.84:0/1238364593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb33c0045a0 msgr2=0x7fb33c0049d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-16T05:47:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35c173700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb33c0045a0 0x7fb33c0049d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:59.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35c173700 1 -- 172.21.15.84:0/1238364593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35413e400 con 0x7fb33c004f20 2020-01-16T05:47:59.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35af11700 1 -- 172.21.15.84:0/1238364593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3540a0700 con 0x7fb33c004f20 2020-01-16T05:47:59.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35c173700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb33c004f20 0x7fb33c00b7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb350004520 tx=0x7fb350011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:59.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35af11700 1 -- 172.21.15.84:0/1238364593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb354091120 con 0x7fb33c004f20 2020-01-16T05:47:59.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35c173700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb33c004f20 0x7fb33c00b7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb350004520 tx=0x7fb350011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:59.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35c173700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb33c004f20 0x7fb33c00b7f0 secure :-1 s=READY pgs=465 cs=0 l=1 rx=0x7fb350004520 tx=0x7fb350011110).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:59.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35c173700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb33c004f20 0x7fb33c00b7f0 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7fb350004520 tx=0x7fb350011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:59.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 -- 172.21.15.84:0/1238364593 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb350011b40 con 0x7fb33c004f20 2020-01-16T05:47:59.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35c173700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb33c004f20 0x7fb33c00b7f0 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7fb350004520 tx=0x7fb350011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:59.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb35c173700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb33c004f20 0x7fb33c00b7f0 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7fb350004520 tx=0x7fb350011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:59.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 -- 172.21.15.84:0/1238364593 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb350011760 con 0x7fb33c004f20 2020-01-16T05:47:59.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.416+0000 7fb34affd700 1 -- 172.21.15.84:0/1238364593 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb35000c900 con 0x7fb33c004f20 2020-01-16T05:47:59.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.420+0000 7fb35c173700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb33c004f20 0x7fb33c00b7f0 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7fb350004520 tx=0x7fb350011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:59.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.420+0000 7fb35af11700 1 -- 172.21.15.84:0/1238364593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb330003360 con 0x7fb33c004f20 2020-01-16T05:47:59.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.420+0000 7fb35c173700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb33c004f20 0x7fb33c00b7f0 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7fb350004520 tx=0x7fb350011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:59.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.420+0000 7fb34affd700 1 -- 172.21.15.84:0/1238364593 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fb35000cb00 con 0x7fb33c004f20 2020-01-16T05:47:59.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.420+0000 7fb34affd700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb33c044f80 0x7fb33c047490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:47:59.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.420+0000 7fb34affd700 1 -- 172.21.15.84:0/1238364593 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fb35004cab0 con 0x7fb33c004f20 2020-01-16T05:47:59.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.420+0000 7fb35a710700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb33c044f80 0x7fb33c047490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:47:59.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.420+0000 7fb35a710700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb33c044f80 0x7fb33c047490 crc :-1 s=READY pgs=180 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:47:59.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.424+0000 7fb35c173700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb33c004f20 0x7fb33c00b7f0 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7fb350004520 tx=0x7fb350011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:59.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.424+0000 7fb34affd700 1 -- 172.21.15.84:0/1238364593 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fb3500332f0 con 0x7fb33c004f20 2020-01-16T05:47:59.575 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.576+0000 7fb35af11700 1 -- 172.21.15.84:0/1238364593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb330003790 con 0x7fb33c004f20 2020-01-16T05:47:59.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.576+0000 7fb35c173700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb33c004f20 0x7fb33c00b7f0 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7fb350004520 tx=0x7fb350011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:47:59.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.576+0000 7fb34affd700 1 -- 172.21.15.84:0/1238364593 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fb350034980 con 0x7fb33c004f20 2020-01-16T05:47:59.576 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:47:59.576 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:47:59.577 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.576+0000 7fb35af11700 1 -- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb33c044f80 msgr2=0x7fb33c047490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:59.578 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.576+0000 7fb35af11700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb33c044f80 0x7fb33c047490 crc :-1 s=READY pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:59.578 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.576+0000 7fb35af11700 1 -- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb33c004f20 msgr2=0x7fb33c00b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:47:59.578 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.576+0000 7fb35c173700 1 -- 172.21.15.84:0/1238364593 reap_dead start 2020-01-16T05:47:59.578 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.576+0000 7fb35af11700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb33c004f20 0x7fb33c00b7f0 secure :-1 s=READY pgs=465 cs=0 l=1 rx=0x7fb350004520 tx=0x7fb350011110).stop 2020-01-16T05:47:59.578 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.576+0000 7fb35af11700 1 -- 172.21.15.84:0/1238364593 shutdown_connections 2020-01-16T05:47:59.578 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.576+0000 7fb35af11700 1 --2- 172.21.15.84:0/1238364593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb33c004f20 0x7fb33c00b7f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:47:59.578 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.576+0000 7fb35af11700 1 -- 172.21.15.84:0/1238364593 shutdown_connections 2020-01-16T05:47:59.579 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.576+0000 7fb35af11700 1 -- 172.21.15.84:0/1238364593 wait complete. 2020-01-16T05:47:59.579 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:47:59.576+0000 7fb35af11700 1 -- 172.21.15.84:0/1238364593 >> 172.21.15.84:0/1238364593 conn(0x7fb3540a6c60 msgr2=0x7fb3540246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:47:59.579 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:47:59.590 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:01.591 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:01.714 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.708+0000 7f62e5fdc700 1 Processor -- start 2020-01-16T05:48:01.714 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.708+0000 7f62e5fdc700 1 -- start start 2020-01-16T05:48:01.714 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e5fdc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62e007ff10 0x7f62e00abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:01.714 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e5fdc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f62e00a4250 0x7f62e0066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:01.714 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e5fdc700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e0066dd0 con 0x7f62e00a9b30 2020-01-16T05:48:01.714 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e5fdc700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e00a4830 con 0x7f62e007ff10 2020-01-16T05:48:01.715 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e5fdc700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e007f9d0 con 0x7f62e00a4250 2020-01-16T05:48:01.715 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e4fda700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62e007ff10 0x7f62e00abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:01.715 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e4fda700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62e007ff10 0x7f62e00abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36334/0 (socket says 172.21.15.84:36334) 2020-01-16T05:48:01.715 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e4fda700 1 -- 172.21.15.84:0/4041960137 learned_addr learned my addr 172.21.15.84:0/4041960137 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:01.715 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e723e700 1 --2- 172.21.15.84:0/4041960137 >> v2:172.21.15.142:3300/0 conn(0x7f62e00a4250 0x7f62e0066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:01.715 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e4fda700 1 -- 172.21.15.84:0/4041960137 >> v2:172.21.15.142:3300/0 conn(0x7f62e00a4250 msgr2=0x7f62e0066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:01.715 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e4fda700 1 --2- 172.21.15.84:0/4041960137 >> v2:172.21.15.142:3300/0 conn(0x7f62e00a4250 0x7f62e0066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:01.716 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e4fda700 1 -- 172.21.15.84:0/4041960137 >> v1:172.21.15.142:6789/0 conn(0x7f62e00a9b30 legacy=0x7f62e00a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:01.716 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e4fda700 1 -- 172.21.15.84:0/4041960137 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e0150ce0 con 0x7f62e007ff10 2020-01-16T05:48:01.716 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e4fda700 1 --2- 172.21.15.84:0/4041960137 >> v2:172.21.15.84:3300/0 conn(0x7f62e007ff10 0x7f62e00abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f62e00a49f0 tx=0x7f62d400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:01.716 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e4fda700 1 --2- 172.21.15.84:0/4041960137 >> v2:172.21.15.84:3300/0 conn(0x7f62e007ff10 0x7f62e00abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f62e00a49f0 tx=0x7f62d400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:01.716 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e4fda700 1 --2- 172.21.15.84:0/4041960137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62e007ff10 0x7f62e00abdd0 secure :-1 s=READY pgs=466 cs=0 l=1 rx=0x7f62e00a49f0 tx=0x7f62d400feb0).ready entity=mon.0 client_cookie=c9865a2400f9d99c server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:01.716 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e4fda700 1 --2- 172.21.15.84:0/4041960137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62e007ff10 0x7f62e00abdd0 secure :-1 s=THROTTLE_DONE pgs=466 cs=0 l=1 rx=0x7f62e00a49f0 tx=0x7f62d400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:01.716 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62dffff700 1 -- 172.21.15.84:0/4041960137 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62d40116e0 con 0x7f62e007ff10 2020-01-16T05:48:01.717 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e4fda700 1 --2- 172.21.15.84:0/4041960137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62e007ff10 0x7f62e00abdd0 secure :-1 s=THROTTLE_DONE pgs=466 cs=0 l=1 rx=0x7f62e00a49f0 tx=0x7f62d400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:01.717 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62dffff700 1 -- 172.21.15.84:0/4041960137 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d4008d30 con 0x7f62e007ff10 2020-01-16T05:48:01.717 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e4fda700 1 --2- 172.21.15.84:0/4041960137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62e007ff10 0x7f62e00abdd0 secure :-1 s=THROTTLE_DONE pgs=466 cs=0 l=1 rx=0x7f62e00a49f0 tx=0x7f62d400feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:01.717 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62dffff700 1 -- 172.21.15.84:0/4041960137 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62d4011cc0 con 0x7f62e007ff10 2020-01-16T05:48:01.717 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e5fdc700 1 -- 172.21.15.84:0/4041960137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62e007ff10 msgr2=0x7f62e00abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:01.717 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e5fdc700 1 --2- 172.21.15.84:0/4041960137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62e007ff10 0x7f62e00abdd0 secure :-1 s=READY pgs=466 cs=0 l=1 rx=0x7f62e00a49f0 tx=0x7f62d400feb0).stop 2020-01-16T05:48:01.717 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e5fdc700 1 -- 172.21.15.84:0/4041960137 shutdown_connections 2020-01-16T05:48:01.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e5fdc700 1 --2- 172.21.15.84:0/4041960137 >> v2:172.21.15.142:3300/0 conn(0x7f62e00a4250 0x7f62e0066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:01.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e5fdc700 1 --2- 172.21.15.84:0/4041960137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62e007ff10 0x7f62e00abdd0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:01.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e5fdc700 1 -- 172.21.15.84:0/4041960137 shutdown_connections 2020-01-16T05:48:01.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e5fdc700 1 -- 172.21.15.84:0/4041960137 wait complete. 2020-01-16T05:48:01.719 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.712+0000 7f62e5fdc700 1 -- 172.21.15.84:0/4041960137 >> 172.21.15.84:0/4041960137 conn(0x7f62e00acfc0 msgr2=0x7f62e00a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:01.722 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62e5fdc700 1 Processor -- start 2020-01-16T05:48:01.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62e5fdc700 1 -- start start 2020-01-16T05:48:01.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62e5fdc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62e007b290 0x7f62e0140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:01.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62e5fdc700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e0124990 con 0x7f62e00a4b70 2020-01-16T05:48:01.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62e5fdc700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e00759a0 con 0x7f62e0065920 2020-01-16T05:48:01.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62e5fdc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00a5480 con 0x7f62e007b290 2020-01-16T05:48:01.723 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62e4fda700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f62e00a4b70 0x7f62e01279f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53544/0 (socket says 172.21.15.84:53544) 2020-01-16T05:48:01.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62e4fda700 1 -- 172.21.15.84:0/2274536124 learned_addr learned my addr 172.21.15.84:0/2274536124 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:01.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62e723e700 1 --2- 172.21.15.84:0/2274536124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62e007b290 0x7f62e0140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:01.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62ddffb700 1 -- 172.21.15.84:0/2274536124 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859557929 0 0) 0x7f62e0124990 con 0x7f62e00a4b70 2020-01-16T05:48:01.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62ddffb700 1 -- 172.21.15.84:0/2274536124 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62c0003230 con 0x7f62e00a4b70 2020-01-16T05:48:01.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62ddffb700 1 -- 172.21.15.84:0/2274536124 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820104710 0 0) 0x7f62e0066dd0 con 0x7f62e0065920 2020-01-16T05:48:01.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62ddffb700 1 -- 172.21.15.84:0/2274536124 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62e0124990 con 0x7f62e0065920 2020-01-16T05:48:01.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62ddffb700 1 -- 172.21.15.84:0/2274536124 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4198267799 0 0) 0x7f62c0003230 con 0x7f62e00a4b70 2020-01-16T05:48:01.724 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62e723e700 1 -- 172.21.15.84:0/2274536124 >> v1:172.21.15.142:6789/0 conn(0x7f62e0065920 legacy=0x7f62e01271f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:01.725 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62e723e700 1 -- 172.21.15.84:0/2274536124 >> v1:172.21.15.84:6789/0 conn(0x7f62e00a4b70 legacy=0x7f62e01279f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:01.725 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62e723e700 1 -- 172.21.15.84:0/2274536124 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e00ab090 con 0x7f62e007b290 2020-01-16T05:48:01.725 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62e723e700 1 --2- 172.21.15.84:0/2274536124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62e007b290 0x7f62e0140990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f62d4011ee0 tx=0x7f62d4010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:01.725 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62e723e700 1 --2- 172.21.15.84:0/2274536124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62e007b290 0x7f62e0140990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f62d4011ee0 tx=0x7f62d4010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:01.725 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62e723e700 1 --2- 172.21.15.84:0/2274536124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62e007b290 0x7f62e0140990 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f62d4011ee0 tx=0x7f62d4010380).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:01.725 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62e723e700 1 --2- 172.21.15.84:0/2274536124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62e007b290 0x7f62e0140990 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f62d4011ee0 tx=0x7f62d4010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:01.725 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62ddffb700 1 -- 172.21.15.84:0/2274536124 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62d4008d30 con 0x7f62e007b290 2020-01-16T05:48:01.726 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.716+0000 7f62e723e700 1 --2- 172.21.15.84:0/2274536124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62e007b290 0x7f62e0140990 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f62d4011ee0 tx=0x7f62d4010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:01.726 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.720+0000 7f62ddffb700 1 -- 172.21.15.84:0/2274536124 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d40118e0 con 0x7f62e007b290 2020-01-16T05:48:01.726 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.720+0000 7f62e5fdc700 1 -- 172.21.15.84:0/2274536124 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e0125380 con 0x7f62e007b290 2020-01-16T05:48:01.726 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.720+0000 7f62e723e700 1 --2- 172.21.15.84:0/2274536124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62e007b290 0x7f62e0140990 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f62d4011ee0 tx=0x7f62d4010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:01.726 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.720+0000 7f62ddffb700 1 -- 172.21.15.84:0/2274536124 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62d80128b0 con 0x7f62e007b290 2020-01-16T05:48:01.726 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.720+0000 7f62e5fdc700 1 -- 172.21.15.84:0/2274536124 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e007b6c0 con 0x7f62e007b290 2020-01-16T05:48:01.726 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.720+0000 7f62e723e700 1 --2- 172.21.15.84:0/2274536124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62e007b290 0x7f62e0140990 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f62d4011ee0 tx=0x7f62d4010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:01.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.720+0000 7f62e5fdc700 1 -- 172.21.15.84:0/2274536124 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e005e1c0 con 0x7f62e007b290 2020-01-16T05:48:01.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.720+0000 7f62ddffb700 1 -- 172.21.15.84:0/2274536124 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f62d8012c10 con 0x7f62e007b290 2020-01-16T05:48:01.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.720+0000 7f62e723e700 1 --2- 172.21.15.84:0/2274536124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62e007b290 0x7f62e0140990 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f62d4011ee0 tx=0x7f62d4010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:01.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.720+0000 7f62ddffb700 1 --2- 172.21.15.84:0/2274536124 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f62c003c970 0x7f62c003ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:01.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.720+0000 7f62ddffb700 1 -- 172.21.15.84:0/2274536124 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f62d804c840 con 0x7f62e007b290 2020-01-16T05:48:01.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.720+0000 7f62e57db700 1 --2- 172.21.15.84:0/2274536124 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f62c003c970 0x7f62c003ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:01.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.720+0000 7f62e57db700 1 --2- 172.21.15.84:0/2274536124 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f62c003c970 0x7f62c003ee80 crc :-1 s=READY pgs=181 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:01.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.728+0000 7f62e723e700 1 --2- 172.21.15.84:0/2274536124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62e007b290 0x7f62e0140990 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f62d4011ee0 tx=0x7f62d4010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:01.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.728+0000 7f62ddffb700 1 -- 172.21.15.84:0/2274536124 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f62d8032e40 con 0x7f62e007b290 2020-01-16T05:48:01.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.880+0000 7f62e5fdc700 1 -- 172.21.15.84:0/2274536124 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62e005cbc0 con 0x7f62e007b290 2020-01-16T05:48:01.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.884+0000 7f62e723e700 1 --2- 172.21.15.84:0/2274536124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62e007b290 0x7f62e0140990 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f62d4011ee0 tx=0x7f62d4010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:01.883 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.884+0000 7f62ddffb700 1 -- 172.21.15.84:0/2274536124 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f62d80330a0 con 0x7f62e007b290 2020-01-16T05:48:01.883 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:01.883 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:01.884 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.884+0000 7f62e5fdc700 1 -- 172.21.15.84:0/2274536124 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f62c003c970 msgr2=0x7f62c003ee80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:01.885 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.884+0000 7f62e5fdc700 1 --2- 172.21.15.84:0/2274536124 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f62c003c970 0x7f62c003ee80 crc :-1 s=READY pgs=181 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:01.885 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.884+0000 7f62e5fdc700 1 -- 172.21.15.84:0/2274536124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62e007b290 msgr2=0x7f62e0140990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:01.885 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.884+0000 7f62e5fdc700 1 --2- 172.21.15.84:0/2274536124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62e007b290 0x7f62e0140990 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f62d4011ee0 tx=0x7f62d4010380).stop 2020-01-16T05:48:01.885 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.884+0000 7f62e5fdc700 1 -- 172.21.15.84:0/2274536124 shutdown_connections 2020-01-16T05:48:01.885 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.884+0000 7f62e5fdc700 1 --2- 172.21.15.84:0/2274536124 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f62c003c970 0x7f62c003ee80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:01.885 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.884+0000 7f62e5fdc700 1 --2- 172.21.15.84:0/2274536124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62e007b290 0x7f62e0140990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:01.885 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.884+0000 7f62e5fdc700 1 -- 172.21.15.84:0/2274536124 shutdown_connections 2020-01-16T05:48:01.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.884+0000 7f62e5fdc700 1 -- 172.21.15.84:0/2274536124 wait complete. 2020-01-16T05:48:01.886 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:01.884+0000 7f62e5fdc700 1 -- 172.21.15.84:0/2274536124 >> 172.21.15.84:0/2274536124 conn(0x7f62e0066650 msgr2=0x7f62e007dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:01.886 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:01.895 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:02.715 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~216s 2020-01-16T05:48:03.896 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:04.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.016+0000 7f9b352ef700 1 Processor -- start 2020-01-16T05:48:04.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.016+0000 7f9b352ef700 1 -- start start 2020-01-16T05:48:04.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.016+0000 7f9b352ef700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3007ff10 0x7f9b300abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:04.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.016+0000 7f9b352ef700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9b300a4250 0x7f9b30066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:04.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.016+0000 7f9b352ef700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b30066dd0 con 0x7f9b300a9b30 2020-01-16T05:48:04.023 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.016+0000 7f9b352ef700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b300a4830 con 0x7f9b300a4250 2020-01-16T05:48:04.024 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.016+0000 7f9b352ef700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3007f9d0 con 0x7f9b3007ff10 2020-01-16T05:48:04.024 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b2ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3007ff10 0x7f9b300abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:04.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b34aee700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9b300a9b30 0x7f9b300a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:51776/0 (socket says 172.21.15.84:51776) 2020-01-16T05:48:04.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b34aee700 1 -- 172.21.15.84:0/4051367004 learned_addr learned my addr 172.21.15.84:0/4051367004 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:04.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b36551700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9b300a4250 0x7f9b30066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:04.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b2f7fe700 1 -- 172.21.15.84:0/4051367004 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371697482 0 0) 0x7f9b30066dd0 con 0x7f9b300a9b30 2020-01-16T05:48:04.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b2f7fe700 1 -- 172.21.15.84:0/4051367004 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b1c003230 con 0x7f9b300a9b30 2020-01-16T05:48:04.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b2ffff700 1 -- 172.21.15.84:0/4051367004 >> v2:172.21.15.142:3300/0 conn(0x7f9b300a4250 msgr2=0x7f9b30066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:04.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b2ffff700 1 --2- 172.21.15.84:0/4051367004 >> v2:172.21.15.142:3300/0 conn(0x7f9b300a4250 0x7f9b30066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:04.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b2ffff700 1 -- 172.21.15.84:0/4051367004 >> v1:172.21.15.142:6789/0 conn(0x7f9b300a9b30 legacy=0x7f9b300a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:04.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b2ffff700 1 -- 172.21.15.84:0/4051367004 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b30150ce0 con 0x7f9b3007ff10 2020-01-16T05:48:04.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b36551700 1 --2- 172.21.15.84:0/4051367004 >> v2:172.21.15.142:3300/0 conn(0x7f9b300a4250 0x7f9b30066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:48:04.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b2ffff700 1 --2- 172.21.15.84:0/4051367004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3007ff10 0x7f9b300abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9b18008910 tx=0x7f9b1800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:04.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b2ffff700 1 --2- 172.21.15.84:0/4051367004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3007ff10 0x7f9b300abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9b18008910 tx=0x7f9b1800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:04.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b2ffff700 1 --2- 172.21.15.84:0/4051367004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3007ff10 0x7f9b300abdd0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f9b18008910 tx=0x7f9b1800fdf0).ready entity=mon.2 client_cookie=7db9baf4e25d3307 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:04.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b2ffff700 1 --2- 172.21.15.84:0/4051367004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3007ff10 0x7f9b300abdd0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f9b18008910 tx=0x7f9b1800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:04.027 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b2f7fe700 1 -- 172.21.15.84:0/4051367004 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b18011660 con 0x7f9b3007ff10 2020-01-16T05:48:04.027 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b2ffff700 1 --2- 172.21.15.84:0/4051367004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3007ff10 0x7f9b300abdd0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f9b18008910 tx=0x7f9b1800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:04.027 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b2f7fe700 1 -- 172.21.15.84:0/4051367004 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b18008c50 con 0x7f9b3007ff10 2020-01-16T05:48:04.027 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b2ffff700 1 --2- 172.21.15.84:0/4051367004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3007ff10 0x7f9b300abdd0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f9b18008910 tx=0x7f9b1800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:04.027 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b352ef700 1 -- 172.21.15.84:0/4051367004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3007ff10 msgr2=0x7f9b300abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:04.027 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b2f7fe700 1 -- 172.21.15.84:0/4051367004 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b18011c40 con 0x7f9b3007ff10 2020-01-16T05:48:04.027 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b352ef700 1 --2- 172.21.15.84:0/4051367004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3007ff10 0x7f9b300abdd0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f9b18008910 tx=0x7f9b1800fdf0).stop 2020-01-16T05:48:04.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b352ef700 1 -- 172.21.15.84:0/4051367004 shutdown_connections 2020-01-16T05:48:04.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b352ef700 1 --2- 172.21.15.84:0/4051367004 >> v2:172.21.15.142:3300/0 conn(0x7f9b300a4250 0x7f9b30066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:04.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b352ef700 1 --2- 172.21.15.84:0/4051367004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3007ff10 0x7f9b300abdd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:04.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b352ef700 1 -- 172.21.15.84:0/4051367004 shutdown_connections 2020-01-16T05:48:04.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b352ef700 1 -- 172.21.15.84:0/4051367004 wait complete. 2020-01-16T05:48:04.028 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.020+0000 7f9b352ef700 1 -- 172.21.15.84:0/4051367004 >> 172.21.15.84:0/4051367004 conn(0x7f9b300acfc0 msgr2=0x7f9b300a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:04.032 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.024+0000 7f9b352ef700 1 Processor -- start 2020-01-16T05:48:04.032 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.024+0000 7f9b352ef700 1 -- start start 2020-01-16T05:48:04.032 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.024+0000 7f9b352ef700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b30091530 0x7f9b3008ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:04.032 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.024+0000 7f9b352ef700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3009ecd0 0x7f9b3009f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:04.032 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.024+0000 7f9b352ef700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b300a3480 con 0x7f9b301263f0 2020-01-16T05:48:04.033 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.024+0000 7f9b352ef700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3008f620 con 0x7f9b30091530 2020-01-16T05:48:04.033 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.024+0000 7f9b352ef700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b30090ff0 con 0x7f9b3009ecd0 2020-01-16T05:48:04.033 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.024+0000 7f9b34aee700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b30091530 0x7f9b3008ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:04.033 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.024+0000 7f9b34aee700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b30091530 0x7f9b3008ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36356/0 (socket says 172.21.15.84:36356) 2020-01-16T05:48:04.033 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.024+0000 7f9b34aee700 1 -- 172.21.15.84:0/736380503 learned_addr learned my addr 172.21.15.84:0/736380503 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:04.033 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.024+0000 7f9b2ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9b301263f0 0x7f9b30090280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53558/0 (socket says 172.21.15.84:53558) 2020-01-16T05:48:04.033 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b36551700 1 --2- 172.21.15.84:0/736380503 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3009ecd0 0x7f9b3009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:04.034 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b34aee700 1 -- 172.21.15.84:0/736380503 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3009ecd0 msgr2=0x7f9b3009f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:04.034 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b34aee700 1 --2- 172.21.15.84:0/736380503 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3009ecd0 0x7f9b3009f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:04.034 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b34aee700 1 -- 172.21.15.84:0/736380503 >> v1:172.21.15.84:6789/0 conn(0x7f9b301263f0 legacy=0x7f9b30090280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:04.034 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b2d7fa700 1 -- 172.21.15.84:0/736380503 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990808983 0 0) 0x7f9b300a3480 con 0x7f9b301263f0 2020-01-16T05:48:04.034 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b34aee700 1 -- 172.21.15.84:0/736380503 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b30090a80 con 0x7f9b30091530 2020-01-16T05:48:04.034 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b34aee700 1 --2- 172.21.15.84:0/736380503 >> v2:172.21.15.84:3300/0 conn(0x7f9b30091530 0x7f9b3008ef10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b3008f7e0 tx=0x7f9b20013110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:04.034 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b34aee700 1 --2- 172.21.15.84:0/736380503 >> v2:172.21.15.84:3300/0 conn(0x7f9b30091530 0x7f9b3008ef10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b3008f7e0 tx=0x7f9b20013110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:04.035 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b34aee700 1 --2- 172.21.15.84:0/736380503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b30091530 0x7f9b3008ef10 secure :-1 s=READY pgs=470 cs=0 l=1 rx=0x7f9b3008f7e0 tx=0x7f9b20013110).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:04.035 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b34aee700 1 --2- 172.21.15.84:0/736380503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b30091530 0x7f9b3008ef10 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7f9b3008f7e0 tx=0x7f9b20013110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:04.035 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b2d7fa700 1 -- 172.21.15.84:0/736380503 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b20013dc0 con 0x7f9b30091530 2020-01-16T05:48:04.035 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b34aee700 1 --2- 172.21.15.84:0/736380503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b30091530 0x7f9b3008ef10 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7f9b3008f7e0 tx=0x7f9b20013110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:04.035 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b34aee700 1 --2- 172.21.15.84:0/736380503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b30091530 0x7f9b3008ef10 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7f9b3008f7e0 tx=0x7f9b20013110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:04.035 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b2d7fa700 1 -- 172.21.15.84:0/736380503 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b200139e0 con 0x7f9b30091530 2020-01-16T05:48:04.035 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b2d7fa700 1 -- 172.21.15.84:0/736380503 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b2000cdd0 con 0x7f9b30091530 2020-01-16T05:48:04.036 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b352ef700 1 -- 172.21.15.84:0/736380503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3009f650 con 0x7f9b30091530 2020-01-16T05:48:04.036 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b352ef700 1 -- 172.21.15.84:0/736380503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b300a52f0 con 0x7f9b30091530 2020-01-16T05:48:04.036 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b34aee700 1 --2- 172.21.15.84:0/736380503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b30091530 0x7f9b3008ef10 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7f9b3008f7e0 tx=0x7f9b20013110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:04.036 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b352ef700 1 -- 172.21.15.84:0/736380503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3005e1c0 con 0x7f9b30091530 2020-01-16T05:48:04.036 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b2d7fa700 1 -- 172.21.15.84:0/736380503 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f9b20010280 con 0x7f9b30091530 2020-01-16T05:48:04.036 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b34aee700 1 --2- 172.21.15.84:0/736380503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b30091530 0x7f9b3008ef10 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7f9b3008f7e0 tx=0x7f9b20013110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:04.036 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b2d7fa700 1 --2- 172.21.15.84:0/736380503 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9b1403c1f0 0x7f9b1403e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:04.036 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b2d7fa700 1 -- 172.21.15.84:0/736380503 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f9b2004cc60 con 0x7f9b30091530 2020-01-16T05:48:04.037 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b2ffff700 1 --2- 172.21.15.84:0/736380503 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9b1403c1f0 0x7f9b1403e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:04.037 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.028+0000 7f9b2ffff700 1 --2- 172.21.15.84:0/736380503 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9b1403c1f0 0x7f9b1403e700 crc :-1 s=READY pgs=182 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:04.037 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.032+0000 7f9b34aee700 1 --2- 172.21.15.84:0/736380503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b30091530 0x7f9b3008ef10 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7f9b3008f7e0 tx=0x7f9b20013110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:04.037 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.032+0000 7f9b2d7fa700 1 -- 172.21.15.84:0/736380503 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f9b20033280 con 0x7f9b30091530 2020-01-16T05:48:04.182 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.184+0000 7f9b352ef700 1 -- 172.21.15.84:0/736380503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b3005cbc0 con 0x7f9b30091530 2020-01-16T05:48:04.183 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.184+0000 7f9b34aee700 1 --2- 172.21.15.84:0/736380503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b30091530 0x7f9b3008ef10 secure :-1 s=THROTTLE_DONE pgs=470 cs=0 l=1 rx=0x7f9b3008f7e0 tx=0x7f9b20013110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:04.183 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.184+0000 7f9b2d7fa700 1 -- 172.21.15.84:0/736380503 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f9b200334e0 con 0x7f9b30091530 2020-01-16T05:48:04.183 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:04.184 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:04.186 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.188+0000 7f9b352ef700 1 -- 172.21.15.84:0/736380503 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9b1403c1f0 msgr2=0x7f9b1403e700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:04.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.188+0000 7f9b352ef700 1 --2- 172.21.15.84:0/736380503 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9b1403c1f0 0x7f9b1403e700 crc :-1 s=READY pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:04.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.188+0000 7f9b352ef700 1 -- 172.21.15.84:0/736380503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b30091530 msgr2=0x7f9b3008ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:04.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.188+0000 7f9b352ef700 1 --2- 172.21.15.84:0/736380503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b30091530 0x7f9b3008ef10 secure :-1 s=READY pgs=470 cs=0 l=1 rx=0x7f9b3008f7e0 tx=0x7f9b20013110).stop 2020-01-16T05:48:04.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.188+0000 7f9b352ef700 1 -- 172.21.15.84:0/736380503 shutdown_connections 2020-01-16T05:48:04.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.188+0000 7f9b352ef700 1 --2- 172.21.15.84:0/736380503 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9b1403c1f0 0x7f9b1403e700 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:04.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.188+0000 7f9b352ef700 1 --2- 172.21.15.84:0/736380503 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3009ecd0 0x7f9b3009f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:04.187 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.188+0000 7f9b352ef700 1 --2- 172.21.15.84:0/736380503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b30091530 0x7f9b3008ef10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:04.188 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.188+0000 7f9b352ef700 1 -- 172.21.15.84:0/736380503 shutdown_connections 2020-01-16T05:48:04.188 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.188+0000 7f9b352ef700 1 -- 172.21.15.84:0/736380503 wait complete. 2020-01-16T05:48:04.188 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:04.188+0000 7f9b352ef700 1 -- 172.21.15.84:0/736380503 >> 172.21.15.84:0/736380503 conn(0x7f9b300ab6b0 msgr2=0x7f9b3007dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:04.188 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:04.206 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:06.207 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:06.337 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff164d30700 1 Processor -- start 2020-01-16T05:48:06.337 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff164d30700 1 -- start start 2020-01-16T05:48:06.337 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff164d30700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff16005b0f0 0x7ff1600a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:06.337 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff164d30700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff16008fd80 0x7ff1601503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:06.338 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff164d30700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16007cd60 con 0x7ff1600a2f60 2020-01-16T05:48:06.338 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff164d30700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1600a3390 con 0x7ff16008fd80 2020-01-16T05:48:06.338 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff164d30700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1600905b0 con 0x7ff16005b0f0 2020-01-16T05:48:06.338 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff15f59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff16008fd80 0x7ff1601503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:06.338 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff15f59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff16008fd80 0x7ff1601503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36368/0 (socket says 172.21.15.84:36368) 2020-01-16T05:48:06.338 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff15f59e700 1 -- 172.21.15.84:0/3410844759 learned_addr learned my addr 172.21.15.84:0/3410844759 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:06.338 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff15e59c700 1 --2- 172.21.15.84:0/3410844759 >> v2:172.21.15.142:3300/0 conn(0x7ff16005b0f0 0x7ff1600a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:06.339 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff15f59e700 1 -- 172.21.15.84:0/3410844759 >> v2:172.21.15.142:3300/0 conn(0x7ff16005b0f0 msgr2=0x7ff1600a8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:06.339 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff15f59e700 1 --2- 172.21.15.84:0/3410844759 >> v2:172.21.15.142:3300/0 conn(0x7ff16005b0f0 0x7ff1600a8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:06.339 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff15f59e700 1 -- 172.21.15.84:0/3410844759 >> v1:172.21.15.142:6789/0 conn(0x7ff1600a2f60 legacy=0x7ff16007c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:06.339 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff15f59e700 1 -- 172.21.15.84:0/3410844759 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16005b520 con 0x7ff16008fd80 2020-01-16T05:48:06.339 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff15f59e700 1 --2- 172.21.15.84:0/3410844759 >> v2:172.21.15.84:3300/0 conn(0x7ff16008fd80 0x7ff1601503f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff1600a2530 tx=0x7ff158010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:06.339 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff15f59e700 1 --2- 172.21.15.84:0/3410844759 >> v2:172.21.15.84:3300/0 conn(0x7ff16008fd80 0x7ff1601503f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff1600a2530 tx=0x7ff158010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:06.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff15f59e700 1 --2- 172.21.15.84:0/3410844759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff16008fd80 0x7ff1601503f0 secure :-1 s=READY pgs=471 cs=0 l=1 rx=0x7ff1600a2530 tx=0x7ff158010230).ready entity=mon.0 client_cookie=17563d09e02a1c7b server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:06.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff15f59e700 1 --2- 172.21.15.84:0/3410844759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff16008fd80 0x7ff1601503f0 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7ff1600a2530 tx=0x7ff158010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:06.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff15f59e700 1 --2- 172.21.15.84:0/3410844759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff16008fd80 0x7ff1601503f0 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7ff1600a2530 tx=0x7ff158010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:06.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff15f59e700 1 --2- 172.21.15.84:0/3410844759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff16008fd80 0x7ff1601503f0 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7ff1600a2530 tx=0x7ff158010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:06.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff15dd9b700 1 -- 172.21.15.84:0/3410844759 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff15800a160 con 0x7ff16008fd80 2020-01-16T05:48:06.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff15dd9b700 1 -- 172.21.15.84:0/3410844759 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff158011b70 con 0x7ff16008fd80 2020-01-16T05:48:06.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff15dd9b700 1 -- 172.21.15.84:0/3410844759 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff15800a740 con 0x7ff16008fd80 2020-01-16T05:48:06.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff164d30700 1 -- 172.21.15.84:0/3410844759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff16008fd80 msgr2=0x7ff1601503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:06.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.332+0000 7ff164d30700 1 --2- 172.21.15.84:0/3410844759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff16008fd80 0x7ff1601503f0 secure :-1 s=READY pgs=471 cs=0 l=1 rx=0x7ff1600a2530 tx=0x7ff158010230).stop 2020-01-16T05:48:06.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.336+0000 7ff164d30700 1 -- 172.21.15.84:0/3410844759 shutdown_connections 2020-01-16T05:48:06.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.336+0000 7ff164d30700 1 --2- 172.21.15.84:0/3410844759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff16008fd80 0x7ff1601503f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:06.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.336+0000 7ff164d30700 1 --2- 172.21.15.84:0/3410844759 >> v2:172.21.15.142:3300/0 conn(0x7ff16005b0f0 0x7ff1600a8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:06.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.336+0000 7ff164d30700 1 -- 172.21.15.84:0/3410844759 shutdown_connections 2020-01-16T05:48:06.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.336+0000 7ff164d30700 1 -- 172.21.15.84:0/3410844759 wait complete. 2020-01-16T05:48:06.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.336+0000 7ff164d30700 1 -- 172.21.15.84:0/3410844759 >> 172.21.15.84:0/3410844759 conn(0x7ff1600abc10 msgr2=0x7ff16005a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.336+0000 7ff164d30700 1 Processor -- start 2020-01-16T05:48:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.336+0000 7ff164d30700 1 -- start start 2020-01-16T05:48:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff164d30700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff16007f400 0x7ff160066290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff164d30700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff16012b180 0x7ff16012ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff164d30700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff1600a5980 0x7ff1600a5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff164d30700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16012e740 con 0x7ff16007f400 2020-01-16T05:48:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff164d30700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16012e9e0 con 0x7ff1600a5980 2020-01-16T05:48:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff164d30700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16012ec80 con 0x7ff16012b180 2020-01-16T05:48:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15ed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff16007f400 0x7ff160066290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15ed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff16007f400 0x7ff160066290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36370/0 (socket says 172.21.15.84:36370) 2020-01-16T05:48:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15ed9d700 1 -- 172.21.15.84:0/78582615 learned_addr learned my addr 172.21.15.84:0/78582615 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15e59c700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff16012b180 0x7ff16012ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15f59e700 1 --2- 172.21.15.84:0/78582615 >> v2:172.21.15.142:3300/0 conn(0x7ff1600a5980 0x7ff1600a5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15ed9d700 1 -- 172.21.15.84:0/78582615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff16012b180 msgr2=0x7ff16012ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15ed9d700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff16012b180 0x7ff16012ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15ed9d700 1 -- 172.21.15.84:0/78582615 >> v2:172.21.15.142:3300/0 conn(0x7ff1600a5980 msgr2=0x7ff1600a5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15ed9d700 1 --2- 172.21.15.84:0/78582615 >> v2:172.21.15.142:3300/0 conn(0x7ff1600a5980 0x7ff1600a5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15ed9d700 1 -- 172.21.15.84:0/78582615 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1600640c0 con 0x7ff16007f400 2020-01-16T05:48:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15f59e700 1 --2- 172.21.15.84:0/78582615 >> v2:172.21.15.142:3300/0 conn(0x7ff1600a5980 0x7ff1600a5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:48:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15e59c700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff16012b180 0x7ff16012ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:48:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15ed9d700 1 --2- 172.21.15.84:0/78582615 >> v2:172.21.15.84:3300/0 conn(0x7ff16007f400 0x7ff160066290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff16012e900 tx=0x7ff150010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15ed9d700 1 --2- 172.21.15.84:0/78582615 >> v2:172.21.15.84:3300/0 conn(0x7ff16007f400 0x7ff160066290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff16012e900 tx=0x7ff150010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15ed9d700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff16007f400 0x7ff160066290 secure :-1 s=READY pgs=472 cs=0 l=1 rx=0x7ff16012e900 tx=0x7ff150010ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:06.350 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15ed9d700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff16007f400 0x7ff160066290 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7ff16012e900 tx=0x7ff150010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:06.350 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff1577fe700 1 -- 172.21.15.84:0/78582615 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff15000ca10 con 0x7ff16007f400 2020-01-16T05:48:06.350 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15ed9d700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff16007f400 0x7ff160066290 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7ff16012e900 tx=0x7ff150010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:06.350 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15ed9d700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff16007f400 0x7ff160066290 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7ff16012e900 tx=0x7ff150010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:06.350 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff1577fe700 1 -- 172.21.15.84:0/78582615 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15000c630 con 0x7ff16007f400 2020-01-16T05:48:06.350 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff1577fe700 1 -- 172.21.15.84:0/78582615 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1500121e0 con 0x7ff16007f400 2020-01-16T05:48:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff164d30700 1 -- 172.21.15.84:0/78582615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1600667e0 con 0x7ff16007f400 2020-01-16T05:48:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff164d30700 1 -- 172.21.15.84:0/78582615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16012f470 con 0x7ff16007f400 2020-01-16T05:48:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15ed9d700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff16007f400 0x7ff160066290 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7ff16012e900 tx=0x7ff150010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff1577fe700 1 -- 172.21.15.84:0/78582615 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7ff1500124f0 con 0x7ff16007f400 2020-01-16T05:48:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15ed9d700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff16007f400 0x7ff160066290 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7ff16012e900 tx=0x7ff150010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff1577fe700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7ff14403c2f0 0x7ff14403e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff1577fe700 1 -- 172.21.15.84:0/78582615 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7ff15004c6e0 con 0x7ff16007f400 2020-01-16T05:48:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15e59c700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7ff14403c2f0 0x7ff14403e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff164d30700 1 -- 172.21.15.84:0/78582615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16005e1c0 con 0x7ff16007f400 2020-01-16T05:48:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.340+0000 7ff15e59c700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7ff14403c2f0 0x7ff14403e800 crc :-1 s=READY pgs=183 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.344+0000 7ff15ed9d700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff16007f400 0x7ff160066290 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7ff16012e900 tx=0x7ff150010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.344+0000 7ff1577fe700 1 -- 172.21.15.84:0/78582615 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7ff150032d00 con 0x7ff16007f400 2020-01-16T05:48:06.499 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.500+0000 7ff164d30700 1 -- 172.21.15.84:0/78582615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff16008f350 con 0x7ff16007f400 2020-01-16T05:48:06.500 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.500+0000 7ff15ed9d700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff16007f400 0x7ff160066290 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7ff16012e900 tx=0x7ff150010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:06.500 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.500+0000 7ff1577fe700 1 -- 172.21.15.84:0/78582615 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7ff150032f60 con 0x7ff16007f400 2020-01-16T05:48:06.500 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:06.501 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:06.502 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.500+0000 7ff164d30700 1 -- 172.21.15.84:0/78582615 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7ff14403c2f0 msgr2=0x7ff14403e800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:06.502 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.500+0000 7ff164d30700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7ff14403c2f0 0x7ff14403e800 crc :-1 s=READY pgs=183 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:06.502 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.500+0000 7ff164d30700 1 -- 172.21.15.84:0/78582615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff16007f400 msgr2=0x7ff160066290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:06.502 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.500+0000 7ff164d30700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff16007f400 0x7ff160066290 secure :-1 s=READY pgs=472 cs=0 l=1 rx=0x7ff16012e900 tx=0x7ff150010ba0).stop 2020-01-16T05:48:06.502 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.504+0000 7ff164d30700 1 -- 172.21.15.84:0/78582615 shutdown_connections 2020-01-16T05:48:06.503 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.504+0000 7ff164d30700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7ff14403c2f0 0x7ff14403e800 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:06.503 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.504+0000 7ff164d30700 1 --2- 172.21.15.84:0/78582615 >> v2:172.21.15.142:3300/0 conn(0x7ff1600a5980 0x7ff1600a5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:06.503 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.504+0000 7ff164d30700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff16007f400 0x7ff160066290 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:06.503 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.504+0000 7ff164d30700 1 --2- 172.21.15.84:0/78582615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff16012b180 0x7ff16012ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:06.503 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.504+0000 7ff164d30700 1 -- 172.21.15.84:0/78582615 shutdown_connections 2020-01-16T05:48:06.503 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.504+0000 7ff164d30700 1 -- 172.21.15.84:0/78582615 wait complete. 2020-01-16T05:48:06.504 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:06.504+0000 7ff164d30700 1 -- 172.21.15.84:0/78582615 >> 172.21.15.84:0/78582615 conn(0x7ff16008ef10 msgr2=0x7ff16009d760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:06.504 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:06.514 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:08.514 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:08.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.640+0000 7f9f4ffff700 1 Processor -- start 2020-01-16T05:48:08.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.640+0000 7f9f4ffff700 1 -- start start 2020-01-16T05:48:08.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.640+0000 7f9f4ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f5007ff10 0x7f9f500abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:08.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.640+0000 7f9f4ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9f500a4250 0x7f9f50066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:08.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.640+0000 7f9f4ffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f50066dd0 con 0x7f9f500a9b30 2020-01-16T05:48:08.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.640+0000 7f9f4ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f500a4830 con 0x7f9f500a4250 2020-01-16T05:48:08.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.640+0000 7f9f4ffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5007f9d0 con 0x7f9f5007ff10 2020-01-16T05:48:08.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.640+0000 7f9f4f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9f500a9b30 0x7f9f500a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53584/0 (socket says 172.21.15.84:53584) 2020-01-16T05:48:08.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.640+0000 7f9f4f7fe700 1 -- 172.21.15.84:0/1132794039 learned_addr learned my addr 172.21.15.84:0/1132794039 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:08.647 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.640+0000 7f9f4effd700 1 --2- 172.21.15.84:0/1132794039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f5007ff10 0x7f9f500abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:08.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.640+0000 7f9f5585a700 1 --2- 172.21.15.84:0/1132794039 >> v2:172.21.15.142:3300/0 conn(0x7f9f500a4250 0x7f9f50066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:08.648 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.640+0000 7f9f4e7fc700 1 -- 172.21.15.84:0/1132794039 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792405279 0 0) 0x7f9f50066dd0 con 0x7f9f500a9b30 2020-01-16T05:48:08.649 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.640+0000 7f9f4e7fc700 1 -- 172.21.15.84:0/1132794039 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f3c003230 con 0x7f9f500a9b30 2020-01-16T05:48:08.649 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.640+0000 7f9f4effd700 1 -- 172.21.15.84:0/1132794039 >> v2:172.21.15.142:3300/0 conn(0x7f9f500a4250 msgr2=0x7f9f50066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:08.649 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.640+0000 7f9f4effd700 1 --2- 172.21.15.84:0/1132794039 >> v2:172.21.15.142:3300/0 conn(0x7f9f500a4250 0x7f9f50066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:08.649 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.640+0000 7f9f4effd700 1 -- 172.21.15.84:0/1132794039 >> v1:172.21.15.84:6789/0 conn(0x7f9f500a9b30 legacy=0x7f9f500a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:08.650 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.640+0000 7f9f4effd700 1 -- 172.21.15.84:0/1132794039 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f50150ce0 con 0x7f9f5007ff10 2020-01-16T05:48:08.650 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4effd700 1 --2- 172.21.15.84:0/1132794039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f5007ff10 0x7f9f500abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9f38008910 tx=0x7f9f3800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:08.650 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4effd700 1 --2- 172.21.15.84:0/1132794039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f5007ff10 0x7f9f500abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9f38008910 tx=0x7f9f3800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:08.650 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4effd700 1 --2- 172.21.15.84:0/1132794039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f5007ff10 0x7f9f500abdd0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f9f38008910 tx=0x7f9f3800fdf0).ready entity=mon.2 client_cookie=81bdec2530bf8252 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:08.650 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4effd700 1 --2- 172.21.15.84:0/1132794039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f5007ff10 0x7f9f500abdd0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f9f38008910 tx=0x7f9f3800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:08.651 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4e7fc700 1 -- 172.21.15.84:0/1132794039 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f38011660 con 0x7f9f5007ff10 2020-01-16T05:48:08.651 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4effd700 1 --2- 172.21.15.84:0/1132794039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f5007ff10 0x7f9f500abdd0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f9f38008910 tx=0x7f9f3800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:08.651 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4e7fc700 1 -- 172.21.15.84:0/1132794039 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f38008c50 con 0x7f9f5007ff10 2020-01-16T05:48:08.651 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4effd700 1 --2- 172.21.15.84:0/1132794039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f5007ff10 0x7f9f500abdd0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f9f38008910 tx=0x7f9f3800fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:08.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4e7fc700 1 -- 172.21.15.84:0/1132794039 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f38011c40 con 0x7f9f5007ff10 2020-01-16T05:48:08.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4ffff700 1 -- 172.21.15.84:0/1132794039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f5007ff10 msgr2=0x7f9f500abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:08.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4ffff700 1 --2- 172.21.15.84:0/1132794039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f5007ff10 0x7f9f500abdd0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f9f38008910 tx=0x7f9f3800fdf0).stop 2020-01-16T05:48:08.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4ffff700 1 -- 172.21.15.84:0/1132794039 shutdown_connections 2020-01-16T05:48:08.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4ffff700 1 --2- 172.21.15.84:0/1132794039 >> v2:172.21.15.142:3300/0 conn(0x7f9f500a4250 0x7f9f50066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:08.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4ffff700 1 --2- 172.21.15.84:0/1132794039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f5007ff10 0x7f9f500abdd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:08.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4ffff700 1 -- 172.21.15.84:0/1132794039 shutdown_connections 2020-01-16T05:48:08.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4ffff700 1 -- 172.21.15.84:0/1132794039 wait complete. 2020-01-16T05:48:08.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4ffff700 1 -- 172.21.15.84:0/1132794039 >> 172.21.15.84:0/1132794039 conn(0x7f9f500acfc0 msgr2=0x7f9f500a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:08.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4ffff700 1 Processor -- start 2020-01-16T05:48:08.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.644+0000 7f9f4ffff700 1 -- start start 2020-01-16T05:48:08.658 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9f500a5a00 0x7f9f501235a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:08.658 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9f500a8390 0x7f9f500a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:08.658 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4ffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f500a5fc0 con 0x7f9f500912c0 2020-01-16T05:48:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4ffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f501249b0 con 0x7f9f500a5a00 2020-01-16T05:48:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f500916f0 con 0x7f9f500a8390 2020-01-16T05:48:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9f500a5a00 0x7f9f501235a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9f500a5a00 0x7f9f501235a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36388/0 (socket says 172.21.15.84:36388) 2020-01-16T05:48:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4f7fe700 1 -- 172.21.15.84:0/2235920088 learned_addr learned my addr 172.21.15.84:0/2235920088 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f5585a700 1 --2- 172.21.15.84:0/2235920088 >> v2:172.21.15.142:3300/0 conn(0x7f9f500a8390 0x7f9f500a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4f7fe700 1 -- 172.21.15.84:0/2235920088 >> v2:172.21.15.142:3300/0 conn(0x7f9f500a8390 msgr2=0x7f9f500a87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4f7fe700 1 --2- 172.21.15.84:0/2235920088 >> v2:172.21.15.142:3300/0 conn(0x7f9f500a8390 0x7f9f500a87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:08.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4f7fe700 1 -- 172.21.15.84:0/2235920088 >> v1:172.21.15.142:6789/0 conn(0x7f9f500912c0 legacy=0x7f9f50135cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:08.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4f7fe700 1 -- 172.21.15.84:0/2235920088 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f500ab090 con 0x7f9f500a5a00 2020-01-16T05:48:08.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4f7fe700 1 --2- 172.21.15.84:0/2235920088 >> v2:172.21.15.84:3300/0 conn(0x7f9f500a5a00 0x7f9f501235a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9f40004520 tx=0x7f9f40010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:08.662 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4f7fe700 1 --2- 172.21.15.84:0/2235920088 >> v2:172.21.15.84:3300/0 conn(0x7f9f500a5a00 0x7f9f501235a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9f40004520 tx=0x7f9f40010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:08.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4f7fe700 1 --2- 172.21.15.84:0/2235920088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f500a5a00 0x7f9f501235a0 secure :-1 s=READY pgs=475 cs=0 l=1 rx=0x7f9f40004520 tx=0x7f9f40010b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:08.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4f7fe700 1 --2- 172.21.15.84:0/2235920088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f500a5a00 0x7f9f501235a0 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7f9f40004520 tx=0x7f9f40010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:08.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f47fff700 1 -- 172.21.15.84:0/2235920088 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f4000c650 con 0x7f9f500a5a00 2020-01-16T05:48:08.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4f7fe700 1 --2- 172.21.15.84:0/2235920088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f500a5a00 0x7f9f501235a0 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7f9f40004520 tx=0x7f9f40010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:08.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4ffff700 1 -- 172.21.15.84:0/2235920088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5013d110 con 0x7f9f500a5a00 2020-01-16T05:48:08.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f47fff700 1 -- 172.21.15.84:0/2235920088 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f40010170 con 0x7f9f500a5a00 2020-01-16T05:48:08.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4f7fe700 1 --2- 172.21.15.84:0/2235920088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f500a5a00 0x7f9f501235a0 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7f9f40004520 tx=0x7f9f40010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:08.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4ffff700 1 -- 172.21.15.84:0/2235920088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5013d640 con 0x7f9f500a5a00 2020-01-16T05:48:08.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f47fff700 1 -- 172.21.15.84:0/2235920088 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f4000cc30 con 0x7f9f500a5a00 2020-01-16T05:48:08.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4f7fe700 1 --2- 172.21.15.84:0/2235920088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f500a5a00 0x7f9f501235a0 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7f9f40004520 tx=0x7f9f40010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:08.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4ffff700 1 -- 172.21.15.84:0/2235920088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5005e1c0 con 0x7f9f500a5a00 2020-01-16T05:48:08.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f47fff700 1 -- 172.21.15.84:0/2235920088 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f9f400055e0 con 0x7f9f500a5a00 2020-01-16T05:48:08.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.648+0000 7f9f4f7fe700 1 --2- 172.21.15.84:0/2235920088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f500a5a00 0x7f9f501235a0 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7f9f40004520 tx=0x7f9f40010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:08.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.652+0000 7f9f47fff700 1 --2- 172.21.15.84:0/2235920088 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9f3403c250 0x7f9f3403e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:08.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.652+0000 7f9f47fff700 1 -- 172.21.15.84:0/2235920088 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f9f4004c900 con 0x7f9f500a5a00 2020-01-16T05:48:08.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.652+0000 7f9f4effd700 1 --2- 172.21.15.84:0/2235920088 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9f3403c250 0x7f9f3403e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:08.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.652+0000 7f9f4effd700 1 --2- 172.21.15.84:0/2235920088 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9f3403c250 0x7f9f3403e760 crc :-1 s=READY pgs=184 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:08.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.656+0000 7f9f4f7fe700 1 --2- 172.21.15.84:0/2235920088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f500a5a00 0x7f9f501235a0 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7f9f40004520 tx=0x7f9f40010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:08.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.656+0000 7f9f47fff700 1 -- 172.21.15.84:0/2235920088 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f9f40030350 con 0x7f9f500a5a00 2020-01-16T05:48:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.808+0000 7f9f4ffff700 1 -- 172.21.15.84:0/2235920088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f500a8f40 con 0x7f9f500a5a00 2020-01-16T05:48:08.810 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.808+0000 7f9f4f7fe700 1 --2- 172.21.15.84:0/2235920088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f500a5a00 0x7f9f501235a0 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7f9f40004520 tx=0x7f9f40010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:08.810 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.808+0000 7f9f47fff700 1 -- 172.21.15.84:0/2235920088 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f9f40032f00 con 0x7f9f500a5a00 2020-01-16T05:48:08.810 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:08.810 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.812+0000 7f9f4ffff700 1 -- 172.21.15.84:0/2235920088 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9f3403c250 msgr2=0x7f9f3403e760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.812+0000 7f9f4ffff700 1 --2- 172.21.15.84:0/2235920088 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9f3403c250 0x7f9f3403e760 crc :-1 s=READY pgs=184 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.812+0000 7f9f4ffff700 1 -- 172.21.15.84:0/2235920088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f500a5a00 msgr2=0x7f9f501235a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.812+0000 7f9f4ffff700 1 --2- 172.21.15.84:0/2235920088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f500a5a00 0x7f9f501235a0 secure :-1 s=READY pgs=475 cs=0 l=1 rx=0x7f9f40004520 tx=0x7f9f40010b80).stop 2020-01-16T05:48:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.812+0000 7f9f4ffff700 1 -- 172.21.15.84:0/2235920088 shutdown_connections 2020-01-16T05:48:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.812+0000 7f9f4ffff700 1 --2- 172.21.15.84:0/2235920088 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9f3403c250 0x7f9f3403e760 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.812+0000 7f9f4ffff700 1 --2- 172.21.15.84:0/2235920088 >> v2:172.21.15.142:3300/0 conn(0x7f9f500a8390 0x7f9f500a87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.812+0000 7f9f4ffff700 1 --2- 172.21.15.84:0/2235920088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f500a5a00 0x7f9f501235a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.812+0000 7f9f4ffff700 1 -- 172.21.15.84:0/2235920088 shutdown_connections 2020-01-16T05:48:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.812+0000 7f9f4ffff700 1 -- 172.21.15.84:0/2235920088 wait complete. 2020-01-16T05:48:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:08.812+0000 7f9f4ffff700 1 -- 172.21.15.84:0/2235920088 >> 172.21.15.84:0/2235920088 conn(0x7f9f500a9b30 msgr2=0x7f9f5007dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:08.823 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:48:09.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~222s 2020-01-16T05:48:10.824 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:10.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1207208700 1 Processor -- start 2020-01-16T05:48:10.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1207208700 1 -- start start 2020-01-16T05:48:10.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1207208700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f12000a9b30 0x7f12000abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:10.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1207208700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f120007ff10 0x7f1200066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:10.953 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1207208700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12000a4250 0x7f12000a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:10.953 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1207208700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12000a4830 con 0x7f120007ff10 2020-01-16T05:48:10.953 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1207208700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120007f9d0 con 0x7f12000a9b30 2020-01-16T05:48:10.953 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1207208700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120007fc70 con 0x7f12000a4250 2020-01-16T05:48:10.953 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1206206700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f120007ff10 0x7f1200066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:10.953 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1206206700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f120007ff10 0x7f1200066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36398/0 (socket says 172.21.15.84:36398) 2020-01-16T05:48:10.954 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1206206700 1 -- 172.21.15.84:0/1237239993 learned_addr learned my addr 172.21.15.84:0/1237239993 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:10.954 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1206a07700 1 --2- 172.21.15.84:0/1237239993 >> v2:172.21.15.142:3300/0 conn(0x7f12000a9b30 0x7f12000abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:10.954 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f120846a700 1 --2- 172.21.15.84:0/1237239993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12000a4250 0x7f12000a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:10.954 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1206206700 1 -- 172.21.15.84:0/1237239993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12000a4250 msgr2=0x7f12000a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:10.954 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1206206700 1 --2- 172.21.15.84:0/1237239993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12000a4250 0x7f12000a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:10.954 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1206206700 1 -- 172.21.15.84:0/1237239993 >> v2:172.21.15.142:3300/0 conn(0x7f12000a9b30 msgr2=0x7f12000abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1206206700 1 --2- 172.21.15.84:0/1237239993 >> v2:172.21.15.142:3300/0 conn(0x7f12000a9b30 0x7f12000abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1206206700 1 -- 172.21.15.84:0/1237239993 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1200066dd0 con 0x7f120007ff10 2020-01-16T05:48:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1206a07700 1 --2- 172.21.15.84:0/1237239993 >> v2:172.21.15.142:3300/0 conn(0x7f12000a9b30 0x7f12000abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:48:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1206206700 1 --2- 172.21.15.84:0/1237239993 >> v2:172.21.15.84:3300/0 conn(0x7f120007ff10 0x7f1200066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f12000a49f0 tx=0x7f11f400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1206206700 1 --2- 172.21.15.84:0/1237239993 >> v2:172.21.15.84:3300/0 conn(0x7f120007ff10 0x7f1200066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f12000a49f0 tx=0x7f11f400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1206206700 1 --2- 172.21.15.84:0/1237239993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f120007ff10 0x7f1200066880 secure :-1 s=READY pgs=476 cs=0 l=1 rx=0x7f12000a49f0 tx=0x7f11f400ff30).ready entity=mon.0 client_cookie=afdc1204f2d88606 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:10.956 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1206206700 1 --2- 172.21.15.84:0/1237239993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f120007ff10 0x7f1200066880 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f12000a49f0 tx=0x7f11f400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:10.956 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1205a05700 1 -- 172.21.15.84:0/1237239993 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11f4011760 con 0x7f120007ff10 2020-01-16T05:48:10.956 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1206206700 1 --2- 172.21.15.84:0/1237239993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f120007ff10 0x7f1200066880 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f12000a49f0 tx=0x7f11f400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:10.956 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1206206700 1 --2- 172.21.15.84:0/1237239993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f120007ff10 0x7f1200066880 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7f12000a49f0 tx=0x7f11f400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:10.956 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1205a05700 1 -- 172.21.15.84:0/1237239993 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f4008d30 con 0x7f120007ff10 2020-01-16T05:48:10.957 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1205a05700 1 -- 172.21.15.84:0/1237239993 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11f4011d40 con 0x7f120007ff10 2020-01-16T05:48:10.957 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1207208700 1 -- 172.21.15.84:0/1237239993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f120007ff10 msgr2=0x7f1200066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:10.957 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1207208700 1 --2- 172.21.15.84:0/1237239993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f120007ff10 0x7f1200066880 secure :-1 s=READY pgs=476 cs=0 l=1 rx=0x7f12000a49f0 tx=0x7f11f400ff30).stop 2020-01-16T05:48:10.957 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1207208700 1 -- 172.21.15.84:0/1237239993 shutdown_connections 2020-01-16T05:48:10.957 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1207208700 1 --2- 172.21.15.84:0/1237239993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12000a4250 0x7f12000a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:10.957 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1207208700 1 --2- 172.21.15.84:0/1237239993 >> v2:172.21.15.142:3300/0 conn(0x7f12000a9b30 0x7f12000abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:10.958 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1207208700 1 --2- 172.21.15.84:0/1237239993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f120007ff10 0x7f1200066880 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:10.958 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1207208700 1 -- 172.21.15.84:0/1237239993 shutdown_connections 2020-01-16T05:48:10.958 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1207208700 1 -- 172.21.15.84:0/1237239993 wait complete. 2020-01-16T05:48:10.958 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.948+0000 7f1207208700 1 -- 172.21.15.84:0/1237239993 >> 172.21.15.84:0/1237239993 conn(0x7f12000acfc0 msgr2=0x7f12000a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:10.958 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f1207208700 1 Processor -- start 2020-01-16T05:48:10.958 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f1207208700 1 -- start start 2020-01-16T05:48:10.959 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f1207208700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1200134860 0x7f12001401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:10.959 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f1207208700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120012aa20 con 0x7f1200066080 2020-01-16T05:48:10.959 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f1207208700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1200124030 con 0x7f12000a2ef0 2020-01-16T05:48:10.959 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f1207208700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120009fb80 con 0x7f1200134860 2020-01-16T05:48:10.959 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f1206a07700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1200066080 0x7f1200124760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53602/0 (socket says 172.21.15.84:53602) 2020-01-16T05:48:10.959 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f1206a07700 1 -- 172.21.15.84:0/2168343720 learned_addr learned my addr 172.21.15.84:0/2168343720 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:10.959 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f120846a700 1 --2- 172.21.15.84:0/2168343720 >> v2:172.21.15.142:3300/0 conn(0x7f1200134860 0x7f12001401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:10.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f11ff7fe700 1 -- 172.21.15.84:0/2168343720 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476790472 0 0) 0x7f120012aa20 con 0x7f1200066080 2020-01-16T05:48:10.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f11ff7fe700 1 -- 172.21.15.84:0/2168343720 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11e0003230 con 0x7f1200066080 2020-01-16T05:48:10.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f11ff7fe700 1 -- 172.21.15.84:0/2168343720 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1684785353 0 0) 0x7f11e0003230 con 0x7f1200066080 2020-01-16T05:48:10.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f11ff7fe700 1 -- 172.21.15.84:0/2168343720 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f120012aa20 con 0x7f1200066080 2020-01-16T05:48:10.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f11ff7fe700 1 -- 172.21.15.84:0/2168343720 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f11f8002940 con 0x7f1200066080 2020-01-16T05:48:10.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f120846a700 1 -- 172.21.15.84:0/2168343720 >> v1:172.21.15.142:6789/0 conn(0x7f12000a2ef0 legacy=0x7f120012a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:10.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f120846a700 1 -- 172.21.15.84:0/2168343720 >> v1:172.21.15.84:6789/0 conn(0x7f1200066080 legacy=0x7f1200124760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:10.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f120846a700 1 -- 172.21.15.84:0/2168343720 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1200122cf0 con 0x7f1200134860 2020-01-16T05:48:10.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f120846a700 1 --2- 172.21.15.84:0/2168343720 >> v2:172.21.15.142:3300/0 conn(0x7f1200134860 0x7f12001401a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f11f40084f0 tx=0x7f11f8003370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:10.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f120846a700 1 --2- 172.21.15.84:0/2168343720 >> v2:172.21.15.142:3300/0 conn(0x7f1200134860 0x7f12001401a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f11f40084f0 tx=0x7f11f8003370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.952+0000 7f120846a700 1 --2- 172.21.15.84:0/2168343720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1200134860 0x7f12001401a0 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7f11f40084f0 tx=0x7f11f8003370).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.956+0000 7f120846a700 1 --2- 172.21.15.84:0/2168343720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1200134860 0x7f12001401a0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f11f40084f0 tx=0x7f11f8003370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.956+0000 7f11ff7fe700 1 -- 172.21.15.84:0/2168343720 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11f000be00 con 0x7f1200134860 2020-01-16T05:48:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.956+0000 7f120846a700 1 --2- 172.21.15.84:0/2168343720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1200134860 0x7f12001401a0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f11f40084f0 tx=0x7f11f8003370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.956+0000 7f120846a700 1 --2- 172.21.15.84:0/2168343720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1200134860 0x7f12001401a0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f11f40084f0 tx=0x7f11f8003370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.956+0000 7f11ff7fe700 1 -- 172.21.15.84:0/2168343720 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f000d160 con 0x7f1200134860 2020-01-16T05:48:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.956+0000 7f1207208700 1 -- 172.21.15.84:0/2168343720 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12001406f0 con 0x7f1200134860 2020-01-16T05:48:10.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.956+0000 7f11ff7fe700 1 -- 172.21.15.84:0/2168343720 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11f000d920 con 0x7f1200134860 2020-01-16T05:48:10.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.956+0000 7f1207208700 1 -- 172.21.15.84:0/2168343720 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1200140900 con 0x7f1200134860 2020-01-16T05:48:10.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.956+0000 7f120846a700 1 --2- 172.21.15.84:0/2168343720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1200134860 0x7f12001401a0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f11f40084f0 tx=0x7f11f8003370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:10.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.956+0000 7f1207208700 1 -- 172.21.15.84:0/2168343720 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120005e1c0 con 0x7f1200134860 2020-01-16T05:48:10.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.956+0000 7f11ff7fe700 1 -- 172.21.15.84:0/2168343720 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f11f0007170 con 0x7f1200134860 2020-01-16T05:48:10.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.956+0000 7f120846a700 1 --2- 172.21.15.84:0/2168343720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1200134860 0x7f12001401a0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f11f40084f0 tx=0x7f11f8003370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:10.965 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.956+0000 7f11ff7fe700 1 --2- 172.21.15.84:0/2168343720 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f11e003cbb0 0x7f11e003f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:10.966 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.956+0000 7f11ff7fe700 1 -- 172.21.15.84:0/2168343720 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f11f004c110 con 0x7f1200134860 2020-01-16T05:48:10.966 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.956+0000 7f1206a07700 1 --2- 172.21.15.84:0/2168343720 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f11e003cbb0 0x7f11e003f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:10.966 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.956+0000 7f1206a07700 1 --2- 172.21.15.84:0/2168343720 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f11e003cbb0 0x7f11e003f0c0 crc :-1 s=READY pgs=185 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:10.966 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.964+0000 7f120846a700 1 --2- 172.21.15.84:0/2168343720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1200134860 0x7f12001401a0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f11f40084f0 tx=0x7f11f8003370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:10.966 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:10.964+0000 7f11ff7fe700 1 -- 172.21.15.84:0/2168343720 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f11f0032730 con 0x7f1200134860 2020-01-16T05:48:11.115 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:11.116+0000 7f1207208700 1 -- 172.21.15.84:0/2168343720 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1200123110 con 0x7f1200134860 2020-01-16T05:48:11.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:11.116+0000 7f120846a700 1 --2- 172.21.15.84:0/2168343720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1200134860 0x7f12001401a0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f11f40084f0 tx=0x7f11f8003370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:11.116 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:11.116+0000 7f11ff7fe700 1 -- 172.21.15.84:0/2168343720 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f11f0032990 con 0x7f1200134860 2020-01-16T05:48:11.117 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:11.117 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:11.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:11.116+0000 7f1207208700 1 -- 172.21.15.84:0/2168343720 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f11e003cbb0 msgr2=0x7f11e003f0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:11.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:11.116+0000 7f1207208700 1 --2- 172.21.15.84:0/2168343720 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f11e003cbb0 0x7f11e003f0c0 crc :-1 s=READY pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:11.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:11.116+0000 7f1207208700 1 -- 172.21.15.84:0/2168343720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1200134860 msgr2=0x7f12001401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:11.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:11.116+0000 7f1207208700 1 --2- 172.21.15.84:0/2168343720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1200134860 0x7f12001401a0 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7f11f40084f0 tx=0x7f11f8003370).stop 2020-01-16T05:48:11.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:11.120+0000 7f1207208700 1 -- 172.21.15.84:0/2168343720 shutdown_connections 2020-01-16T05:48:11.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:11.120+0000 7f1207208700 1 --2- 172.21.15.84:0/2168343720 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f11e003cbb0 0x7f11e003f0c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:11.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:11.120+0000 7f1207208700 1 --2- 172.21.15.84:0/2168343720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1200134860 0x7f12001401a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:11.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:11.120+0000 7f1207208700 1 -- 172.21.15.84:0/2168343720 shutdown_connections 2020-01-16T05:48:11.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:11.120+0000 7f1207208700 1 -- 172.21.15.84:0/2168343720 wait complete. 2020-01-16T05:48:11.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:11.120+0000 7f1207208700 1 -- 172.21.15.84:0/2168343720 >> 172.21.15.84:0/2168343720 conn(0x7f120005ee80 msgr2=0x7f12000a6050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:11.120 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:11.130 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:13.130 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:13.255 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.248+0000 7f25b8b3c700 1 Processor -- start 2020-01-16T05:48:13.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.248+0000 7f25b8b3c700 1 -- start start 2020-01-16T05:48:13.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b8b3c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b40a2f60 0x7f25b405b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:13.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b8b3c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f25b40a8ff0 0x7f25b408fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:13.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b8b3c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f25b407c560 0x7f25b407c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:13.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b8b3c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b40a3390 con 0x7f25b407c560 2020-01-16T05:48:13.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b8b3c700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b40905b0 con 0x7f25b40a8ff0 2020-01-16T05:48:13.256 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b8b3c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b40a2a20 con 0x7f25b40a2f60 2020-01-16T05:48:13.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b359e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f25b407c560 0x7f25b407c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:13.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b359e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f25b407c560 0x7f25b407c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36416/0 (socket says 172.21.15.84:36416) 2020-01-16T05:48:13.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b359e700 1 -- 172.21.15.84:0/459067186 learned_addr learned my addr 172.21.15.84:0/459067186 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:13.257 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b259c700 1 --2- 172.21.15.84:0/459067186 >> v2:172.21.15.142:3300/0 conn(0x7f25b40a8ff0 0x7f25b408fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:13.258 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b2d9d700 1 --2- 172.21.15.84:0/459067186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b40a2f60 0x7f25b405b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:13.258 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b359e700 1 -- 172.21.15.84:0/459067186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b40a2f60 msgr2=0x7f25b405b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:13.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b359e700 1 --2- 172.21.15.84:0/459067186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b40a2f60 0x7f25b405b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:13.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b359e700 1 -- 172.21.15.84:0/459067186 >> v2:172.21.15.142:3300/0 conn(0x7f25b40a8ff0 msgr2=0x7f25b408fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:13.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b359e700 1 --2- 172.21.15.84:0/459067186 >> v2:172.21.15.142:3300/0 conn(0x7f25b40a8ff0 0x7f25b408fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:13.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b359e700 1 -- 172.21.15.84:0/459067186 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b40902d0 con 0x7f25b407c560 2020-01-16T05:48:13.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b359e700 1 --2- 172.21.15.84:0/459067186 >> v2:172.21.15.84:3300/0 conn(0x7f25b407c560 0x7f25b407c990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f25b4090770 tx=0x7f25a400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:13.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b359e700 1 --2- 172.21.15.84:0/459067186 >> v2:172.21.15.84:3300/0 conn(0x7f25b407c560 0x7f25b407c990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f25b4090770 tx=0x7f25a400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:13.259 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b359e700 1 --2- 172.21.15.84:0/459067186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25b407c560 0x7f25b407c990 secure :-1 s=READY pgs=480 cs=0 l=1 rx=0x7f25b4090770 tx=0x7f25a400ff30).ready entity=mon.0 client_cookie=828b753e99513104 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:13.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b359e700 1 --2- 172.21.15.84:0/459067186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25b407c560 0x7f25b407c990 secure :-1 s=THROTTLE_DONE pgs=480 cs=0 l=1 rx=0x7f25b4090770 tx=0x7f25a400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:13.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b1d9b700 1 -- 172.21.15.84:0/459067186 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25a4011760 con 0x7f25b407c560 2020-01-16T05:48:13.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b359e700 1 --2- 172.21.15.84:0/459067186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25b407c560 0x7f25b407c990 secure :-1 s=THROTTLE_DONE pgs=480 cs=0 l=1 rx=0x7f25b4090770 tx=0x7f25a400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:13.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b1d9b700 1 -- 172.21.15.84:0/459067186 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a4008d30 con 0x7f25b407c560 2020-01-16T05:48:13.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b359e700 1 --2- 172.21.15.84:0/459067186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25b407c560 0x7f25b407c990 secure :-1 s=THROTTLE_DONE pgs=480 cs=0 l=1 rx=0x7f25b4090770 tx=0x7f25a400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:13.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b8b3c700 1 -- 172.21.15.84:0/459067186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25b407c560 msgr2=0x7f25b407c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:13.260 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b1d9b700 1 -- 172.21.15.84:0/459067186 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25a4011d40 con 0x7f25b407c560 2020-01-16T05:48:13.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b8b3c700 1 --2- 172.21.15.84:0/459067186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25b407c560 0x7f25b407c990 secure :-1 s=READY pgs=480 cs=0 l=1 rx=0x7f25b4090770 tx=0x7f25a400ff30).stop 2020-01-16T05:48:13.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b8b3c700 1 -- 172.21.15.84:0/459067186 shutdown_connections 2020-01-16T05:48:13.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b8b3c700 1 --2- 172.21.15.84:0/459067186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25b407c560 0x7f25b407c990 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:13.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b8b3c700 1 --2- 172.21.15.84:0/459067186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b40a2f60 0x7f25b405b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:13.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b8b3c700 1 --2- 172.21.15.84:0/459067186 >> v2:172.21.15.142:3300/0 conn(0x7f25b40a8ff0 0x7f25b408fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:13.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b8b3c700 1 -- 172.21.15.84:0/459067186 shutdown_connections 2020-01-16T05:48:13.261 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b8b3c700 1 -- 172.21.15.84:0/459067186 wait complete. 2020-01-16T05:48:13.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.252+0000 7f25b8b3c700 1 -- 172.21.15.84:0/459067186 >> 172.21.15.84:0/459067186 conn(0x7f25b40abc10 msgr2=0x7f25b405a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:13.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b8b3c700 1 Processor -- start 2020-01-16T05:48:13.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b8b3c700 1 -- start start 2020-01-16T05:48:13.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b8b3c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f25b4122b30 0x7f25b407f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:13.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b8b3c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b407fcd0 con 0x7f25b40a12c0 2020-01-16T05:48:13.262 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b8b3c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b4132c30 con 0x7f25b4132800 2020-01-16T05:48:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b8b3c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b407f240 con 0x7f25b4122b30 2020-01-16T05:48:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b359e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f25b4122b30 0x7f25b407f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b359e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f25b4122b30 0x7f25b407f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36422/0 (socket says 172.21.15.84:36422) 2020-01-16T05:48:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b359e700 1 -- 172.21.15.84:0/3548968874 learned_addr learned my addr 172.21.15.84:0/3548968874 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:13.266 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b359e700 1 -- 172.21.15.84:0/3548968874 >> v1:172.21.15.142:6789/0 conn(0x7f25b4132800 legacy=0x7f25b4122330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:13.266 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b359e700 1 -- 172.21.15.84:0/3548968874 >> v1:172.21.15.84:6789/0 conn(0x7f25b40a12c0 legacy=0x7f25b407e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:13.266 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b359e700 1 -- 172.21.15.84:0/3548968874 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b4140240 con 0x7f25b4122b30 2020-01-16T05:48:13.266 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b359e700 1 --2- 172.21.15.84:0/3548968874 >> v2:172.21.15.84:3300/0 conn(0x7f25b4122b30 0x7f25b407f780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25b4136e00 tx=0x7f25a4011570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:13.266 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b359e700 1 --2- 172.21.15.84:0/3548968874 >> v2:172.21.15.84:3300/0 conn(0x7f25b4122b30 0x7f25b407f780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25b4136e00 tx=0x7f25a4011570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:13.266 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b359e700 1 --2- 172.21.15.84:0/3548968874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25b4122b30 0x7f25b407f780 secure :-1 s=READY pgs=482 cs=0 l=1 rx=0x7f25b4136e00 tx=0x7f25a4011570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:13.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b359e700 1 --2- 172.21.15.84:0/3548968874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25b4122b30 0x7f25b407f780 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7f25b4136e00 tx=0x7f25a4011570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:13.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b359e700 1 --2- 172.21.15.84:0/3548968874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25b4122b30 0x7f25b407f780 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7f25b4136e00 tx=0x7f25a4011570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:13.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25a37fe700 1 -- 172.21.15.84:0/3548968874 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25a400f760 con 0x7f25b4122b30 2020-01-16T05:48:13.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b359e700 1 --2- 172.21.15.84:0/3548968874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25b4122b30 0x7f25b407f780 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7f25b4136e00 tx=0x7f25a4011570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:13.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25a37fe700 1 -- 172.21.15.84:0/3548968874 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a4011960 con 0x7f25b4122b30 2020-01-16T05:48:13.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25a37fe700 1 -- 172.21.15.84:0/3548968874 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25a4007530 con 0x7f25b4122b30 2020-01-16T05:48:13.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b8b3c700 1 -- 172.21.15.84:0/3548968874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b413e220 con 0x7f25b4122b30 2020-01-16T05:48:13.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.256+0000 7f25b8b3c700 1 -- 172.21.15.84:0/3548968874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b413e580 con 0x7f25b4122b30 2020-01-16T05:48:13.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.260+0000 7f25b359e700 1 --2- 172.21.15.84:0/3548968874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25b4122b30 0x7f25b407f780 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7f25b4136e00 tx=0x7f25a4011570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:13.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.260+0000 7f25b8b3c700 1 -- 172.21.15.84:0/3548968874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b405e1c0 con 0x7f25b4122b30 2020-01-16T05:48:13.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.260+0000 7f25a37fe700 1 -- 172.21.15.84:0/3548968874 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f25a40056c0 con 0x7f25b4122b30 2020-01-16T05:48:13.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.260+0000 7f25b359e700 1 --2- 172.21.15.84:0/3548968874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25b4122b30 0x7f25b407f780 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7f25b4136e00 tx=0x7f25a4011570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:13.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.260+0000 7f25a37fe700 1 --2- 172.21.15.84:0/3548968874 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f259803c280 0x7f259803e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:13.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.260+0000 7f25a37fe700 1 -- 172.21.15.84:0/3548968874 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f25a4090ff0 con 0x7f25b4122b30 2020-01-16T05:48:13.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.260+0000 7f25b2d9d700 1 --2- 172.21.15.84:0/3548968874 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f259803c280 0x7f259803e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:13.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.260+0000 7f25b2d9d700 1 --2- 172.21.15.84:0/3548968874 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f259803c280 0x7f259803e790 crc :-1 s=READY pgs=186 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:13.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.264+0000 7f25b359e700 1 --2- 172.21.15.84:0/3548968874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25b4122b30 0x7f25b407f780 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7f25b4136e00 tx=0x7f25a4011570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:13.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.264+0000 7f25a37fe700 1 -- 172.21.15.84:0/3548968874 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f25a4094de0 con 0x7f25b4122b30 2020-01-16T05:48:13.418 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.420+0000 7f25b8b3c700 1 -- 172.21.15.84:0/3548968874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25b408f350 con 0x7f25b4122b30 2020-01-16T05:48:13.419 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.420+0000 7f25b359e700 1 --2- 172.21.15.84:0/3548968874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25b4122b30 0x7f25b407f780 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7f25b4136e00 tx=0x7f25a4011570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:13.419 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.420+0000 7f25a37fe700 1 -- 172.21.15.84:0/3548968874 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f25a4077610 con 0x7f25b4122b30 2020-01-16T05:48:13.419 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:13.419 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:13.420 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.420+0000 7f25b8b3c700 1 -- 172.21.15.84:0/3548968874 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f259803c280 msgr2=0x7f259803e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:13.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.420+0000 7f25b8b3c700 1 --2- 172.21.15.84:0/3548968874 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f259803c280 0x7f259803e790 crc :-1 s=READY pgs=186 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:13.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.420+0000 7f25b8b3c700 1 -- 172.21.15.84:0/3548968874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25b4122b30 msgr2=0x7f25b407f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:13.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.420+0000 7f25b8b3c700 1 --2- 172.21.15.84:0/3548968874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25b4122b30 0x7f25b407f780 secure :-1 s=READY pgs=482 cs=0 l=1 rx=0x7f25b4136e00 tx=0x7f25a4011570).stop 2020-01-16T05:48:13.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.420+0000 7f25b8b3c700 1 -- 172.21.15.84:0/3548968874 shutdown_connections 2020-01-16T05:48:13.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.420+0000 7f25b8b3c700 1 --2- 172.21.15.84:0/3548968874 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f259803c280 0x7f259803e790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:13.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.420+0000 7f25b8b3c700 1 --2- 172.21.15.84:0/3548968874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25b4122b30 0x7f25b407f780 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:13.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.420+0000 7f25b8b3c700 1 -- 172.21.15.84:0/3548968874 shutdown_connections 2020-01-16T05:48:13.422 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.420+0000 7f25b8b3c700 1 -- 172.21.15.84:0/3548968874 wait complete. 2020-01-16T05:48:13.422 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:13.420+0000 7f25b8b3c700 1 -- 172.21.15.84:0/3548968874 >> 172.21.15.84:0/3548968874 conn(0x7f25b405a750 msgr2=0x7f25b4129de0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:13.422 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:13.432 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:14.578 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:48:14.580 INFO:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:48:15.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~228s 2020-01-16T05:48:15.434 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:15.559 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.552+0000 7f92dc8e7700 1 Processor -- start 2020-01-16T05:48:15.559 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.552+0000 7f92dc8e7700 1 -- start start 2020-01-16T05:48:15.559 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92dc8e7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d80a9b30 0x7f92d80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:15.559 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92dc8e7700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f92d807ff10 0x7f92d8066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:15.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92dc8e7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d8066dd0 con 0x7f92d80a4250 2020-01-16T05:48:15.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92dc8e7700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d80a4830 con 0x7f92d807ff10 2020-01-16T05:48:15.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92dc8e7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d807f9d0 con 0x7f92d80a9b30 2020-01-16T05:48:15.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92ddb49700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f92d80a4250 0x7f92d80a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53630/0 (socket says 172.21.15.84:53630) 2020-01-16T05:48:15.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92ddb49700 1 -- 172.21.15.84:0/1469498103 learned_addr learned my addr 172.21.15.84:0/1469498103 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:15.560 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d7fff700 1 --2- 172.21.15.84:0/1469498103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d80a9b30 0x7f92d80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:15.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d77fe700 1 --2- 172.21.15.84:0/1469498103 >> v2:172.21.15.142:3300/0 conn(0x7f92d807ff10 0x7f92d8066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:15.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 -- 172.21.15.84:0/1469498103 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701933705 0 0) 0x7f92d8066dd0 con 0x7f92d80a4250 2020-01-16T05:48:15.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 -- 172.21.15.84:0/1469498103 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92b8003230 con 0x7f92d80a4250 2020-01-16T05:48:15.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 -- 172.21.15.84:0/1469498103 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 585276960 0 0) 0x7f92b8003230 con 0x7f92d80a4250 2020-01-16T05:48:15.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 -- 172.21.15.84:0/1469498103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d80a9b30 msgr2=0x7f92d80abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:15.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 --2- 172.21.15.84:0/1469498103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d80a9b30 0x7f92d80abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:15.561 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 -- 172.21.15.84:0/1469498103 >> v2:172.21.15.142:3300/0 conn(0x7f92d807ff10 msgr2=0x7f92d8066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:15.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 --2- 172.21.15.84:0/1469498103 >> v2:172.21.15.142:3300/0 conn(0x7f92d807ff10 0x7f92d8066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:15.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 -- 172.21.15.84:0/1469498103 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d8150ce0 con 0x7f92d80a4250 2020-01-16T05:48:15.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 -- 172.21.15.84:0/1469498103 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f92c0001750 con 0x7f92d80a4250 2020-01-16T05:48:15.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 -- 172.21.15.84:0/1469498103 >> v1:172.21.15.84:6789/0 conn(0x7f92d80a4250 legacy=0x7f92d80a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:15.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 --2- 172.21.15.84:0/1469498103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92b8003860 0x7f92b8003cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:15.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 --2- 172.21.15.84:0/1469498103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92b80045a0 0x7f92b80049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:15.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 --2- 172.21.15.84:0/1469498103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92b8004f20 0x7f92b804f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:15.562 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 -- 172.21.15.84:0/1469498103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80a4830 con 0x7f92b8004f20 2020-01-16T05:48:15.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 -- 172.21.15.84:0/1469498103 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d807f9d0 con 0x7f92b8003860 2020-01-16T05:48:15.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 -- 172.21.15.84:0/1469498103 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b8005380 con 0x7f92b80045a0 2020-01-16T05:48:15.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92ddb49700 1 --2- 172.21.15.84:0/1469498103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92b8004f20 0x7f92b804f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:15.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d7fff700 1 --2- 172.21.15.84:0/1469498103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92b8003860 0x7f92b8003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:15.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d77fe700 1 --2- 172.21.15.84:0/1469498103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92b80045a0 0x7f92b80049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:15.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92ddb49700 1 -- 172.21.15.84:0/1469498103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92b80045a0 msgr2=0x7f92b80049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:15.563 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92ddb49700 1 --2- 172.21.15.84:0/1469498103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92b80045a0 0x7f92b80049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:15.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92ddb49700 1 -- 172.21.15.84:0/1469498103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92b8003860 msgr2=0x7f92b8003cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:15.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92ddb49700 1 --2- 172.21.15.84:0/1469498103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92b8003860 0x7f92b8003cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:15.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92ddb49700 1 -- 172.21.15.84:0/1469498103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b804fe40 con 0x7f92b8004f20 2020-01-16T05:48:15.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d7fff700 1 --2- 172.21.15.84:0/1469498103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92b8003860 0x7f92b8003cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:48:15.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92ddb49700 1 --2- 172.21.15.84:0/1469498103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92b8004f20 0x7f92b804f800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f92c0001a50 tx=0x7f92c000c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:15.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92ddb49700 1 --2- 172.21.15.84:0/1469498103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92b8004f20 0x7f92b804f800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f92c0001a50 tx=0x7f92c000c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:15.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92ddb49700 1 --2- 172.21.15.84:0/1469498103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92b8004f20 0x7f92b804f800 secure :-1 s=READY pgs=484 cs=0 l=1 rx=0x7f92c0001a50 tx=0x7f92c000c3a0).ready entity=mon.0 client_cookie=f9951a1771776370 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:15.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92ddb49700 1 --2- 172.21.15.84:0/1469498103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92b8004f20 0x7f92b804f800 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f92c0001a50 tx=0x7f92c000c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:15.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 -- 172.21.15.84:0/1469498103 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92c000b450 con 0x7f92b8004f20 2020-01-16T05:48:15.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92ddb49700 1 --2- 172.21.15.84:0/1469498103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92b8004f20 0x7f92b804f800 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f92c0001a50 tx=0x7f92c000c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:15.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92ddb49700 1 --2- 172.21.15.84:0/1469498103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92b8004f20 0x7f92b804f800 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f92c0001a50 tx=0x7f92c000c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:15.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 -- 172.21.15.84:0/1469498103 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c000b070 con 0x7f92b8004f20 2020-01-16T05:48:15.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92d6ffd700 1 -- 172.21.15.84:0/1469498103 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92c000aa70 con 0x7f92b8004f20 2020-01-16T05:48:15.565 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92dc8e7700 1 -- 172.21.15.84:0/1469498103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92b8004f20 msgr2=0x7f92b804f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:15.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92dc8e7700 1 --2- 172.21.15.84:0/1469498103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92b8004f20 0x7f92b804f800 secure :-1 s=READY pgs=484 cs=0 l=1 rx=0x7f92c0001a50 tx=0x7f92c000c3a0).stop 2020-01-16T05:48:15.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92ddb49700 1 -- 172.21.15.84:0/1469498103 reap_dead start 2020-01-16T05:48:15.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92dc8e7700 1 -- 172.21.15.84:0/1469498103 shutdown_connections 2020-01-16T05:48:15.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92dc8e7700 1 -- 172.21.15.84:0/1469498103 shutdown_connections 2020-01-16T05:48:15.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92dc8e7700 1 -- 172.21.15.84:0/1469498103 wait complete. 2020-01-16T05:48:15.566 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.556+0000 7f92dc8e7700 1 -- 172.21.15.84:0/1469498103 >> 172.21.15.84:0/1469498103 conn(0x7f92d80acfc0 msgr2=0x7f92d80a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:15.569 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.560+0000 7f92dc8e7700 1 Processor -- start 2020-01-16T05:48:15.569 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.560+0000 7f92dc8e7700 1 -- start start 2020-01-16T05:48:15.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92dc8e7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f92d80a8140 0x7f92d80a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:15.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92dc8e7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d8139d30 0x7f92d813c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:15.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92dc8e7700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d809fc80 con 0x7f92d80a2240 2020-01-16T05:48:15.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92dc8e7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d8090fa0 con 0x7f92d80a8140 2020-01-16T05:48:15.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92dc8e7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d8091240 con 0x7f92d8139d30 2020-01-16T05:48:15.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f92d80a8140 0x7f92d80a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:15.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f92d80a8140 0x7f92d80a1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36438/0 (socket says 172.21.15.84:36438) 2020-01-16T05:48:15.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d7fff700 1 -- 172.21.15.84:0/1679025613 learned_addr learned my addr 172.21.15.84:0/1679025613 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:15.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92ddb49700 1 --2- 172.21.15.84:0/1679025613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d8139d30 0x7f92d813c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:15.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d7fff700 1 -- 172.21.15.84:0/1679025613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d8139d30 msgr2=0x7f92d813c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:15.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d7fff700 1 --2- 172.21.15.84:0/1679025613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d8139d30 0x7f92d813c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:15.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d7fff700 1 -- 172.21.15.84:0/1679025613 >> v1:172.21.15.142:6789/0 conn(0x7f92d80a2240 legacy=0x7f92d809f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:15.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d7fff700 1 -- 172.21.15.84:0/1679025613 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d805f340 con 0x7f92d80a8140 2020-01-16T05:48:15.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d7fff700 1 --2- 172.21.15.84:0/1679025613 >> v2:172.21.15.84:3300/0 conn(0x7f92d80a8140 0x7f92d80a1cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f92d8091160 tx=0x7f92d0010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:15.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d7fff700 1 --2- 172.21.15.84:0/1679025613 >> v2:172.21.15.84:3300/0 conn(0x7f92d80a8140 0x7f92d80a1cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f92d8091160 tx=0x7f92d0010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:15.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d7fff700 1 --2- 172.21.15.84:0/1679025613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d80a8140 0x7f92d80a1cf0 secure :-1 s=READY pgs=485 cs=0 l=1 rx=0x7f92d8091160 tx=0x7f92d0010f80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:15.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d7fff700 1 --2- 172.21.15.84:0/1679025613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d80a8140 0x7f92d80a1cf0 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7f92d8091160 tx=0x7f92d0010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:15.573 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d7fff700 1 --2- 172.21.15.84:0/1679025613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d80a8140 0x7f92d80a1cf0 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7f92d8091160 tx=0x7f92d0010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:15.573 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d4ff9700 1 -- 172.21.15.84:0/1679025613 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92d0005c30 con 0x7f92d80a8140 2020-01-16T05:48:15.573 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d7fff700 1 --2- 172.21.15.84:0/1679025613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d80a8140 0x7f92d80a1cf0 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7f92d8091160 tx=0x7f92d0010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:15.573 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d4ff9700 1 -- 172.21.15.84:0/1679025613 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d000e160 con 0x7f92d80a8140 2020-01-16T05:48:15.573 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d4ff9700 1 -- 172.21.15.84:0/1679025613 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92d0012dd0 con 0x7f92d80a8140 2020-01-16T05:48:15.573 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92dc8e7700 1 -- 172.21.15.84:0/1679025613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d80a0b50 con 0x7f92d80a8140 2020-01-16T05:48:15.574 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92dc8e7700 1 -- 172.21.15.84:0/1679025613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d8066560 con 0x7f92d80a8140 2020-01-16T05:48:15.574 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d7fff700 1 --2- 172.21.15.84:0/1679025613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d80a8140 0x7f92d80a1cf0 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7f92d8091160 tx=0x7f92d0010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:15.574 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92dc8e7700 1 -- 172.21.15.84:0/1679025613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d805e1c0 con 0x7f92d80a8140 2020-01-16T05:48:15.574 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d4ff9700 1 -- 172.21.15.84:0/1679025613 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f92d0007180 con 0x7f92d80a8140 2020-01-16T05:48:15.574 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.564+0000 7f92d7fff700 1 --2- 172.21.15.84:0/1679025613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d80a8140 0x7f92d80a1cf0 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7f92d8091160 tx=0x7f92d0010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:15.575 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.568+0000 7f92d4ff9700 1 --2- 172.21.15.84:0/1679025613 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f92b003c290 0x7f92b003e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:15.575 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.568+0000 7f92d4ff9700 1 -- 172.21.15.84:0/1679025613 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f92d004c9f0 con 0x7f92d80a8140 2020-01-16T05:48:15.575 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.568+0000 7f92d77fe700 1 --2- 172.21.15.84:0/1679025613 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f92b003c290 0x7f92b003e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:15.575 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.568+0000 7f92d77fe700 1 --2- 172.21.15.84:0/1679025613 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f92b003c290 0x7f92b003e7a0 crc :-1 s=READY pgs=187 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:15.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.576+0000 7f92d7fff700 1 --2- 172.21.15.84:0/1679025613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d80a8140 0x7f92d80a1cf0 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7f92d8091160 tx=0x7f92d0010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:15.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.576+0000 7f92d4ff9700 1 -- 172.21.15.84:0/1679025613 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f92d0033010 con 0x7f92d80a8140 2020-01-16T05:48:15.725 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.724+0000 7f92dc8e7700 1 -- 172.21.15.84:0/1679025613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92d80a8d00 con 0x7f92d80a8140 2020-01-16T05:48:15.726 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.728+0000 7f92d7fff700 1 --2- 172.21.15.84:0/1679025613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d80a8140 0x7f92d80a1cf0 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7f92d8091160 tx=0x7f92d0010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:15.727 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.728+0000 7f92d4ff9700 1 -- 172.21.15.84:0/1679025613 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f92d0033270 con 0x7f92d80a8140 2020-01-16T05:48:15.727 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:15.727 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:15.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.728+0000 7f92dc8e7700 1 -- 172.21.15.84:0/1679025613 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f92b003c290 msgr2=0x7f92b003e7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:15.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.728+0000 7f92dc8e7700 1 --2- 172.21.15.84:0/1679025613 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f92b003c290 0x7f92b003e7a0 crc :-1 s=READY pgs=187 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:15.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.728+0000 7f92dc8e7700 1 -- 172.21.15.84:0/1679025613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d80a8140 msgr2=0x7f92d80a1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:15.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.728+0000 7f92dc8e7700 1 --2- 172.21.15.84:0/1679025613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d80a8140 0x7f92d80a1cf0 secure :-1 s=READY pgs=485 cs=0 l=1 rx=0x7f92d8091160 tx=0x7f92d0010f80).stop 2020-01-16T05:48:15.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.728+0000 7f92dc8e7700 1 -- 172.21.15.84:0/1679025613 shutdown_connections 2020-01-16T05:48:15.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.728+0000 7f92dc8e7700 1 --2- 172.21.15.84:0/1679025613 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f92b003c290 0x7f92b003e7a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:15.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.728+0000 7f92dc8e7700 1 --2- 172.21.15.84:0/1679025613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d8139d30 0x7f92d813c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:15.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.728+0000 7f92dc8e7700 1 --2- 172.21.15.84:0/1679025613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d80a8140 0x7f92d80a1cf0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:15.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.728+0000 7f92dc8e7700 1 -- 172.21.15.84:0/1679025613 shutdown_connections 2020-01-16T05:48:15.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.728+0000 7f92dc8e7700 1 -- 172.21.15.84:0/1679025613 wait complete. 2020-01-16T05:48:15.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:15.728+0000 7f92dc8e7700 1 -- 172.21.15.84:0/1679025613 >> 172.21.15.84:0/1679025613 conn(0x7f92d80a9b30 msgr2=0x7f92d8024d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:15.731 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:15.739 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:17.740 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:17.861 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e759e700 1 Processor -- start 2020-01-16T05:48:17.862 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e759e700 1 -- start start 2020-01-16T05:48:17.862 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f83e807ff10 0x7f83e80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:17.862 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83e80a4250 0x7f83e8066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:17.862 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e759e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e8066dd0 con 0x7f83e80a9b30 2020-01-16T05:48:17.862 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e759e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e80a4830 con 0x7f83e807ff10 2020-01-16T05:48:17.862 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e807f9d0 con 0x7f83e80a4250 2020-01-16T05:48:17.863 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f83e807ff10 0x7f83e80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:17.863 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f83e807ff10 0x7f83e80abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36452/0 (socket says 172.21.15.84:36452) 2020-01-16T05:48:17.863 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e659c700 1 -- 172.21.15.84:0/2731417682 learned_addr learned my addr 172.21.15.84:0/2731417682 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:17.863 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83ecac4700 1 --2- 172.21.15.84:0/2731417682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83e80a4250 0x7f83e8066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:17.863 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e659c700 1 -- 172.21.15.84:0/2731417682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83e80a4250 msgr2=0x7f83e8066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:17.863 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e659c700 1 --2- 172.21.15.84:0/2731417682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83e80a4250 0x7f83e8066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:17.863 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e659c700 1 -- 172.21.15.84:0/2731417682 >> v1:172.21.15.142:6789/0 conn(0x7f83e80a9b30 legacy=0x7f83e80a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:17.864 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e659c700 1 -- 172.21.15.84:0/2731417682 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e8150ce0 con 0x7f83e807ff10 2020-01-16T05:48:17.864 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e659c700 1 --2- 172.21.15.84:0/2731417682 >> v2:172.21.15.84:3300/0 conn(0x7f83e807ff10 0x7f83e80abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f83e80a49f0 tx=0x7f83d800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:17.864 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e659c700 1 --2- 172.21.15.84:0/2731417682 >> v2:172.21.15.84:3300/0 conn(0x7f83e807ff10 0x7f83e80abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f83e80a49f0 tx=0x7f83d800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:17.864 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e659c700 1 --2- 172.21.15.84:0/2731417682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83e807ff10 0x7f83e80abdd0 secure :-1 s=READY pgs=486 cs=0 l=1 rx=0x7f83e80a49f0 tx=0x7f83d800feb0).ready entity=mon.0 client_cookie=df5c2a0a3a2afc23 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:17.864 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e659c700 1 --2- 172.21.15.84:0/2731417682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83e807ff10 0x7f83e80abdd0 secure :-1 s=THROTTLE_DONE pgs=486 cs=0 l=1 rx=0x7f83e80a49f0 tx=0x7f83d800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:17.864 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e5d9b700 1 -- 172.21.15.84:0/2731417682 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d8011720 con 0x7f83e807ff10 2020-01-16T05:48:17.864 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e659c700 1 --2- 172.21.15.84:0/2731417682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83e807ff10 0x7f83e80abdd0 secure :-1 s=THROTTLE_DONE pgs=486 cs=0 l=1 rx=0x7f83e80a49f0 tx=0x7f83d800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:17.865 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e659c700 1 --2- 172.21.15.84:0/2731417682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83e807ff10 0x7f83e80abdd0 secure :-1 s=THROTTLE_DONE pgs=486 cs=0 l=1 rx=0x7f83e80a49f0 tx=0x7f83d800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:17.865 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e5d9b700 1 -- 172.21.15.84:0/2731417682 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d8008d30 con 0x7f83e807ff10 2020-01-16T05:48:17.865 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e5d9b700 1 -- 172.21.15.84:0/2731417682 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d8011d00 con 0x7f83e807ff10 2020-01-16T05:48:17.865 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e759e700 1 -- 172.21.15.84:0/2731417682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83e807ff10 msgr2=0x7f83e80abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:17.865 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e759e700 1 --2- 172.21.15.84:0/2731417682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83e807ff10 0x7f83e80abdd0 secure :-1 s=READY pgs=486 cs=0 l=1 rx=0x7f83e80a49f0 tx=0x7f83d800feb0).stop 2020-01-16T05:48:17.865 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e759e700 1 -- 172.21.15.84:0/2731417682 shutdown_connections 2020-01-16T05:48:17.865 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e759e700 1 --2- 172.21.15.84:0/2731417682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83e80a4250 0x7f83e8066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:17.865 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e759e700 1 --2- 172.21.15.84:0/2731417682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83e807ff10 0x7f83e80abdd0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:17.866 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e759e700 1 -- 172.21.15.84:0/2731417682 shutdown_connections 2020-01-16T05:48:17.866 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e759e700 1 -- 172.21.15.84:0/2731417682 wait complete. 2020-01-16T05:48:17.866 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.860+0000 7f83e759e700 1 -- 172.21.15.84:0/2731417682 >> 172.21.15.84:0/2731417682 conn(0x7f83e80acfc0 msgr2=0x7f83e80a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:17.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83e759e700 1 Processor -- start 2020-01-16T05:48:17.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83e759e700 1 -- start start 2020-01-16T05:48:17.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83e759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f83e813e2e0 0x7f83e8140720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:17.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83e759e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e8024a50 con 0x7f83e80252d0 2020-01-16T05:48:17.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83e759e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e8124ab0 con 0x7f83e8065650 2020-01-16T05:48:17.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83e759e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e80ab090 con 0x7f83e813e2e0 2020-01-16T05:48:17.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83e6d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f83e80252d0 0x7f83e809f350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53658/0 (socket says 172.21.15.84:53658) 2020-01-16T05:48:17.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83e6d9d700 1 -- 172.21.15.84:0/312695454 learned_addr learned my addr 172.21.15.84:0/312695454 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:17.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83ecac4700 1 --2- 172.21.15.84:0/312695454 >> v2:172.21.15.142:3300/0 conn(0x7f83e813e2e0 0x7f83e8140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:17.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83df7fe700 1 -- 172.21.15.84:0/312695454 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258527417 0 0) 0x7f83e8024a50 con 0x7f83e80252d0 2020-01-16T05:48:17.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83df7fe700 1 -- 172.21.15.84:0/312695454 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83cc003230 con 0x7f83e80252d0 2020-01-16T05:48:17.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83df7fe700 1 -- 172.21.15.84:0/312695454 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1630153455 0 0) 0x7f83cc003230 con 0x7f83e80252d0 2020-01-16T05:48:17.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83df7fe700 1 -- 172.21.15.84:0/312695454 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f83e8024a50 con 0x7f83e80252d0 2020-01-16T05:48:17.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83df7fe700 1 -- 172.21.15.84:0/312695454 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f83d0001a60 con 0x7f83e80252d0 2020-01-16T05:48:17.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83df7fe700 1 -- 172.21.15.84:0/312695454 >> v2:172.21.15.142:3300/0 conn(0x7f83e813e2e0 msgr2=0x7f83e8140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:17.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83df7fe700 1 --2- 172.21.15.84:0/312695454 >> v2:172.21.15.142:3300/0 conn(0x7f83e813e2e0 0x7f83e8140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:17.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83df7fe700 1 -- 172.21.15.84:0/312695454 >> v1:172.21.15.142:6789/0 conn(0x7f83e8065650 legacy=0x7f83e8065a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:17.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83df7fe700 1 -- 172.21.15.84:0/312695454 >> v1:172.21.15.84:6789/0 conn(0x7f83e80252d0 legacy=0x7f83e809f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:17.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83df7fe700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83cc003a20 0x7f83cc003e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:17.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83df7fe700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83cc0045a0 0x7f83cc004a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:17.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83df7fe700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc005070 0x7f83cc00b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:17.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83df7fe700 1 -- 172.21.15.84:0/312695454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e80ab090 con 0x7f83cc005070 2020-01-16T05:48:17.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83df7fe700 1 -- 172.21.15.84:0/312695454 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc00be70 con 0x7f83cc0045a0 2020-01-16T05:48:17.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83df7fe700 1 -- 172.21.15.84:0/312695454 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc00c0b0 con 0x7f83cc003a20 2020-01-16T05:48:17.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83ecac4700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc005070 0x7f83cc00b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:17.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83e659c700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83cc0045a0 0x7f83cc004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83e6d9d700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83cc003a20 0x7f83cc003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83ecac4700 1 -- 172.21.15.84:0/312695454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83cc003a20 msgr2=0x7f83cc003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83ecac4700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83cc003a20 0x7f83cc003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83ecac4700 1 -- 172.21.15.84:0/312695454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83cc0045a0 msgr2=0x7f83cc004a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83ecac4700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83cc0045a0 0x7f83cc004a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83ecac4700 1 -- 172.21.15.84:0/312695454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e80246e0 con 0x7f83cc005070 2020-01-16T05:48:17.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83e759e700 1 -- 172.21.15.84:0/312695454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e8125070 con 0x7f83cc005070 2020-01-16T05:48:17.876 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83ecac4700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc005070 0x7f83cc00b7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f83e00032b0 tx=0x7f83e0011180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:17.876 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83e6d9d700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83cc003a20 0x7f83cc003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-01-16T05:48:17.876 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83e759e700 1 -- 172.21.15.84:0/312695454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e809fb50 con 0x7f83cc005070 2020-01-16T05:48:17.876 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83ecac4700 1 -- 172.21.15.84:0/312695454 reap_dead start 2020-01-16T05:48:17.876 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83ecac4700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc005070 0x7f83cc00b7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f83e00032b0 tx=0x7f83e0011180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:17.876 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83ecac4700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc005070 0x7f83cc00b7f0 secure :-1 s=READY pgs=488 cs=0 l=1 rx=0x7f83e00032b0 tx=0x7f83e0011180).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:17.876 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83ecac4700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc005070 0x7f83cc00b7f0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f83e00032b0 tx=0x7f83e0011180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:17.877 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83df7fe700 1 -- 172.21.15.84:0/312695454 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83e0005a40 con 0x7f83cc005070 2020-01-16T05:48:17.877 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83ecac4700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc005070 0x7f83cc00b7f0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f83e00032b0 tx=0x7f83e0011180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:17.877 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83ecac4700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc005070 0x7f83cc00b7f0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f83e00032b0 tx=0x7f83e0011180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:17.877 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83df7fe700 1 -- 172.21.15.84:0/312695454 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e0011ad0 con 0x7f83cc005070 2020-01-16T05:48:17.877 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.864+0000 7f83df7fe700 1 -- 172.21.15.84:0/312695454 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83e0007340 con 0x7f83cc005070 2020-01-16T05:48:17.877 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.868+0000 7f83ecac4700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc005070 0x7f83cc00b7f0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f83e00032b0 tx=0x7f83e0011180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:17.877 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.868+0000 7f83e759e700 1 -- 172.21.15.84:0/312695454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c0003360 con 0x7f83cc005070 2020-01-16T05:48:17.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.868+0000 7f83df7fe700 1 -- 172.21.15.84:0/312695454 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f83e0007540 con 0x7f83cc005070 2020-01-16T05:48:17.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.868+0000 7f83ecac4700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc005070 0x7f83cc00b7f0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f83e00032b0 tx=0x7f83e0011180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:17.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.868+0000 7f83df7fe700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f83cc03ffd0 0x7f83cc0424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:17.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.868+0000 7f83df7fe700 1 -- 172.21.15.84:0/312695454 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f83e004c600 con 0x7f83cc005070 2020-01-16T05:48:17.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.868+0000 7f83e6d9d700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f83cc03ffd0 0x7f83cc0424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:17.878 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.868+0000 7f83e6d9d700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f83cc03ffd0 0x7f83cc0424e0 crc :-1 s=READY pgs=188 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:17.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.872+0000 7f83ecac4700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc005070 0x7f83cc00b7f0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f83e00032b0 tx=0x7f83e0011180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:17.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:17.872+0000 7f83df7fe700 1 -- 172.21.15.84:0/312695454 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f83e00303e0 con 0x7f83cc005070 2020-01-16T05:48:18.021 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:18.020+0000 7f83e759e700 1 -- 172.21.15.84:0/312695454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83c0003790 con 0x7f83cc005070 2020-01-16T05:48:18.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:18.024+0000 7f83ecac4700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc005070 0x7f83cc00b7f0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f83e00032b0 tx=0x7f83e0011180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:18.022 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:18.024+0000 7f83df7fe700 1 -- 172.21.15.84:0/312695454 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f83e00344f0 con 0x7f83cc005070 2020-01-16T05:48:18.023 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:18.023 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:18.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:18.024+0000 7f83e759e700 1 -- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f83cc03ffd0 msgr2=0x7f83cc0424e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:18.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:18.024+0000 7f83e759e700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f83cc03ffd0 0x7f83cc0424e0 crc :-1 s=READY pgs=188 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:18.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:18.024+0000 7f83e759e700 1 -- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc005070 msgr2=0x7f83cc00b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:18.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:18.024+0000 7f83e759e700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc005070 0x7f83cc00b7f0 secure :-1 s=READY pgs=488 cs=0 l=1 rx=0x7f83e00032b0 tx=0x7f83e0011180).stop 2020-01-16T05:48:18.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:18.024+0000 7f83e759e700 1 -- 172.21.15.84:0/312695454 shutdown_connections 2020-01-16T05:48:18.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:18.024+0000 7f83e759e700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f83cc03ffd0 0x7f83cc0424e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:18.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:18.024+0000 7f83e759e700 1 --2- 172.21.15.84:0/312695454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc005070 0x7f83cc00b7f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:18.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:18.024+0000 7f83e759e700 1 -- 172.21.15.84:0/312695454 shutdown_connections 2020-01-16T05:48:18.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:18.024+0000 7f83e759e700 1 -- 172.21.15.84:0/312695454 wait complete. 2020-01-16T05:48:18.026 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:18.024+0000 7f83e759e700 1 -- 172.21.15.84:0/312695454 >> 172.21.15.84:0/312695454 conn(0x7f83e80ab6b0 msgr2=0x7f83e80665b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:18.043 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:20.043 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:20.167 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.160+0000 7fdca70f5700 1 Processor -- start 2020-01-16T05:48:20.167 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.160+0000 7fdca70f5700 1 -- start start 2020-01-16T05:48:20.167 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca70f5700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdca00a9b30 0x7fdca00abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:20.167 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca70f5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdca00a4250 0x7fdca0066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:20.167 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca70f5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca0066dd0 con 0x7fdca007ff10 2020-01-16T05:48:20.167 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca70f5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca00a4830 con 0x7fdca00a4250 2020-01-16T05:48:20.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca70f5700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca007f9d0 con 0x7fdca00a9b30 2020-01-16T05:48:20.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca8357700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdca00a4250 0x7fdca0066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:20.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca8357700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdca00a4250 0x7fdca0066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36474/0 (socket says 172.21.15.84:36474) 2020-01-16T05:48:20.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca8357700 1 -- 172.21.15.84:0/499431832 learned_addr learned my addr 172.21.15.84:0/499431832 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:20.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca68f4700 1 --2- 172.21.15.84:0/499431832 >> v2:172.21.15.142:3300/0 conn(0x7fdca00a9b30 0x7fdca00abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:20.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca8357700 1 -- 172.21.15.84:0/499431832 >> v2:172.21.15.142:3300/0 conn(0x7fdca00a9b30 msgr2=0x7fdca00abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:20.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca8357700 1 --2- 172.21.15.84:0/499431832 >> v2:172.21.15.142:3300/0 conn(0x7fdca00a9b30 0x7fdca00abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:20.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca8357700 1 -- 172.21.15.84:0/499431832 >> v1:172.21.15.142:6789/0 conn(0x7fdca007ff10 legacy=0x7fdca00a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:20.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca8357700 1 -- 172.21.15.84:0/499431832 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0150ce0 con 0x7fdca00a4250 2020-01-16T05:48:20.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca8357700 1 --2- 172.21.15.84:0/499431832 >> v2:172.21.15.84:3300/0 conn(0x7fdca00a4250 0x7fdca0066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdca00a49f0 tx=0x7fdc98010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:20.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca8357700 1 --2- 172.21.15.84:0/499431832 >> v2:172.21.15.84:3300/0 conn(0x7fdca00a4250 0x7fdca0066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdca00a49f0 tx=0x7fdc98010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:20.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca8357700 1 --2- 172.21.15.84:0/499431832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca00a4250 0x7fdca0066880 secure :-1 s=READY pgs=489 cs=0 l=1 rx=0x7fdca00a49f0 tx=0x7fdc98010230).ready entity=mon.0 client_cookie=11f0ea87f7a7b75e server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:20.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca8357700 1 --2- 172.21.15.84:0/499431832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca00a4250 0x7fdca0066880 secure :-1 s=THROTTLE_DONE pgs=489 cs=0 l=1 rx=0x7fdca00a49f0 tx=0x7fdc98010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:20.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca58f2700 1 -- 172.21.15.84:0/499431832 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc9800a160 con 0x7fdca00a4250 2020-01-16T05:48:20.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca8357700 1 --2- 172.21.15.84:0/499431832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca00a4250 0x7fdca0066880 secure :-1 s=THROTTLE_DONE pgs=489 cs=0 l=1 rx=0x7fdca00a49f0 tx=0x7fdc98010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:20.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca8357700 1 --2- 172.21.15.84:0/499431832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca00a4250 0x7fdca0066880 secure :-1 s=THROTTLE_DONE pgs=489 cs=0 l=1 rx=0x7fdca00a49f0 tx=0x7fdc98010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:20.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca58f2700 1 -- 172.21.15.84:0/499431832 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc98011b70 con 0x7fdca00a4250 2020-01-16T05:48:20.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca58f2700 1 -- 172.21.15.84:0/499431832 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc9800a740 con 0x7fdca00a4250 2020-01-16T05:48:20.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca70f5700 1 -- 172.21.15.84:0/499431832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca00a4250 msgr2=0x7fdca0066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:20.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca70f5700 1 --2- 172.21.15.84:0/499431832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca00a4250 0x7fdca0066880 secure :-1 s=READY pgs=489 cs=0 l=1 rx=0x7fdca00a49f0 tx=0x7fdc98010230).stop 2020-01-16T05:48:20.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca70f5700 1 -- 172.21.15.84:0/499431832 shutdown_connections 2020-01-16T05:48:20.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca70f5700 1 --2- 172.21.15.84:0/499431832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca00a4250 0x7fdca0066880 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:20.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca70f5700 1 --2- 172.21.15.84:0/499431832 >> v2:172.21.15.142:3300/0 conn(0x7fdca00a9b30 0x7fdca00abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:20.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca70f5700 1 -- 172.21.15.84:0/499431832 shutdown_connections 2020-01-16T05:48:20.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca70f5700 1 -- 172.21.15.84:0/499431832 wait complete. 2020-01-16T05:48:20.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.164+0000 7fdca70f5700 1 -- 172.21.15.84:0/499431832 >> 172.21.15.84:0/499431832 conn(0x7fdca00acfc0 msgr2=0x7fdca00a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:20.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.168+0000 7fdca70f5700 1 Processor -- start 2020-01-16T05:48:20.174 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.168+0000 7fdca70f5700 1 -- start start 2020-01-16T05:48:20.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca70f5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdca00a03f0 0x7fdca00a2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:20.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca70f5700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdca0132830 0x7fdca013d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:20.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca70f5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca0125d00 con 0x7fdca00a90e0 2020-01-16T05:48:20.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca70f5700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca00a1310 con 0x7fdca0132830 2020-01-16T05:48:20.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca70f5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca00a1ae0 con 0x7fdca00a03f0 2020-01-16T05:48:20.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca8357700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdca0132830 0x7fdca013d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:20.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca68f4700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fdca00a90e0 0x7fdca00910e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:51904/0 (socket says 172.21.15.84:51904) 2020-01-16T05:48:20.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca60f3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdca00a03f0 0x7fdca00a2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:20.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca68f4700 1 -- 172.21.15.84:0/1764383436 learned_addr learned my addr 172.21.15.84:0/1764383436 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:20.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca60f3700 1 -- 172.21.15.84:0/1764383436 >> v2:172.21.15.142:3300/0 conn(0x7fdca0132830 msgr2=0x7fdca013d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:20.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca60f3700 1 --2- 172.21.15.84:0/1764383436 >> v2:172.21.15.142:3300/0 conn(0x7fdca0132830 0x7fdca013d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:20.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca60f3700 1 -- 172.21.15.84:0/1764383436 >> v1:172.21.15.142:6789/0 conn(0x7fdca00a90e0 legacy=0x7fdca00910e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:20.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca60f3700 1 -- 172.21.15.84:0/1764383436 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0091a70 con 0x7fdca00a03f0 2020-01-16T05:48:20.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca8357700 1 --2- 172.21.15.84:0/1764383436 >> v2:172.21.15.142:3300/0 conn(0x7fdca0132830 0x7fdca013d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:48:20.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca60f3700 1 --2- 172.21.15.84:0/1764383436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdca00a03f0 0x7fdca00a2020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdc90002ef0 tx=0x7fdc90010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:20.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca60f3700 1 --2- 172.21.15.84:0/1764383436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdca00a03f0 0x7fdca00a2020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdc90002ef0 tx=0x7fdc90010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:20.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca60f3700 1 --2- 172.21.15.84:0/1764383436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdca00a03f0 0x7fdca00a2020 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7fdc90002ef0 tx=0x7fdc90010a10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:20.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca60f3700 1 --2- 172.21.15.84:0/1764383436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdca00a03f0 0x7fdca00a2020 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fdc90002ef0 tx=0x7fdc90010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:20.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca60f3700 1 --2- 172.21.15.84:0/1764383436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdca00a03f0 0x7fdca00a2020 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fdc90002ef0 tx=0x7fdc90010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdc977fe700 1 -- 172.21.15.84:0/1764383436 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc90005940 con 0x7fdca00a03f0 2020-01-16T05:48:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca60f3700 1 --2- 172.21.15.84:0/1764383436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdca00a03f0 0x7fdca00a2020 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fdc90002ef0 tx=0x7fdc90010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdc977fe700 1 -- 172.21.15.84:0/1764383436 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc90007160 con 0x7fdca00a03f0 2020-01-16T05:48:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca70f5700 1 -- 172.21.15.84:0/1764383436 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca00a0a20 con 0x7fdca00a03f0 2020-01-16T05:48:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdc977fe700 1 -- 172.21.15.84:0/1764383436 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc900088b0 con 0x7fdca00a03f0 2020-01-16T05:48:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca70f5700 1 -- 172.21.15.84:0/1764383436 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca0132c60 con 0x7fdca00a03f0 2020-01-16T05:48:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.172+0000 7fdca60f3700 1 --2- 172.21.15.84:0/1764383436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdca00a03f0 0x7fdca00a2020 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fdc90002ef0 tx=0x7fdc90010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.176+0000 7fdc977fe700 1 -- 172.21.15.84:0/1764383436 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fdc90008bc0 con 0x7fdca00a03f0 2020-01-16T05:48:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.176+0000 7fdca60f3700 1 --2- 172.21.15.84:0/1764383436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdca00a03f0 0x7fdca00a2020 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fdc90002ef0 tx=0x7fdc90010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.176+0000 7fdca70f5700 1 -- 172.21.15.84:0/1764383436 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca00a0820 con 0x7fdca00a03f0 2020-01-16T05:48:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.176+0000 7fdc977fe700 1 --2- 172.21.15.84:0/1764383436 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdc8803c2d0 0x7fdc8803e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.176+0000 7fdc977fe700 1 -- 172.21.15.84:0/1764383436 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fdc9004c7a0 con 0x7fdca00a03f0 2020-01-16T05:48:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.176+0000 7fdca68f4700 1 --2- 172.21.15.84:0/1764383436 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdc8803c2d0 0x7fdc8803e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.176+0000 7fdca68f4700 1 --2- 172.21.15.84:0/1764383436 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdc8803c2d0 0x7fdc8803e7e0 crc :-1 s=READY pgs=189 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:20.184 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.184+0000 7fdca60f3700 1 --2- 172.21.15.84:0/1764383436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdca00a03f0 0x7fdca00a2020 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fdc90002ef0 tx=0x7fdc90010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.184+0000 7fdc977fe700 1 -- 172.21.15.84:0/1764383436 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fdc90032dc0 con 0x7fdca00a03f0 2020-01-16T05:48:20.337 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.336+0000 7fdca70f5700 1 -- 172.21.15.84:0/1764383436 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdca005e1c0 con 0x7fdca00a03f0 2020-01-16T05:48:20.338 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.340+0000 7fdca60f3700 1 --2- 172.21.15.84:0/1764383436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdca00a03f0 0x7fdca00a2020 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fdc90002ef0 tx=0x7fdc90010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:20.338 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.340+0000 7fdc977fe700 1 -- 172.21.15.84:0/1764383436 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fdc90033020 con 0x7fdca00a03f0 2020-01-16T05:48:20.339 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:20.339 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.340+0000 7fdca70f5700 1 -- 172.21.15.84:0/1764383436 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdc8803c2d0 msgr2=0x7fdc8803e7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.340+0000 7fdca70f5700 1 --2- 172.21.15.84:0/1764383436 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdc8803c2d0 0x7fdc8803e7e0 crc :-1 s=READY pgs=189 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.340+0000 7fdca70f5700 1 -- 172.21.15.84:0/1764383436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdca00a03f0 msgr2=0x7fdca00a2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.340+0000 7fdca70f5700 1 --2- 172.21.15.84:0/1764383436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdca00a03f0 0x7fdca00a2020 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7fdc90002ef0 tx=0x7fdc90010a10).stop 2020-01-16T05:48:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.340+0000 7fdca70f5700 1 -- 172.21.15.84:0/1764383436 shutdown_connections 2020-01-16T05:48:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.340+0000 7fdca70f5700 1 --2- 172.21.15.84:0/1764383436 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdc8803c2d0 0x7fdc8803e7e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.340+0000 7fdca70f5700 1 --2- 172.21.15.84:0/1764383436 >> v2:172.21.15.142:3300/0 conn(0x7fdca0132830 0x7fdca013d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.340+0000 7fdca70f5700 1 --2- 172.21.15.84:0/1764383436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdca00a03f0 0x7fdca00a2020 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.340+0000 7fdca70f5700 1 -- 172.21.15.84:0/1764383436 shutdown_connections 2020-01-16T05:48:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.340+0000 7fdca70f5700 1 -- 172.21.15.84:0/1764383436 wait complete. 2020-01-16T05:48:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:20.340+0000 7fdca70f5700 1 -- 172.21.15.84:0/1764383436 >> 172.21.15.84:0/1764383436 conn(0x7fdca00ab6b0 msgr2=0x7fdca00246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:20.343 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:20.352 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:48:21.645 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~234s 2020-01-16T05:48:22.353 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:22.475 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744cddf700 1 Processor -- start 2020-01-16T05:48:22.475 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744cddf700 1 -- start start 2020-01-16T05:48:22.475 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744cddf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f744805b0f0 0x7f74480a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:22.475 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744cddf700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f744808fd80 0x7f74481503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:22.476 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744cddf700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744807cd60 con 0x7f74480a2f60 2020-01-16T05:48:22.476 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744cddf700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74480a3390 con 0x7f744805b0f0 2020-01-16T05:48:22.476 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744cddf700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74480905b0 con 0x7f744808fd80 2020-01-16T05:48:22.476 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f744805b0f0 0x7f74480a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:22.477 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f7446d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f74480a2f60 0x7f744807c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53688/0 (socket says 172.21.15.84:53688) 2020-01-16T05:48:22.477 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f744805b0f0 0x7f74480a8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36486/0 (socket says 172.21.15.84:36486) 2020-01-16T05:48:22.477 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f7446d9d700 1 -- 172.21.15.84:0/4186605066 learned_addr learned my addr 172.21.15.84:0/4186605066 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:22.477 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744759e700 1 --2- 172.21.15.84:0/4186605066 >> v2:172.21.15.142:3300/0 conn(0x7f744808fd80 0x7f74481503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:22.478 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744659c700 1 -- 172.21.15.84:0/4186605066 >> v2:172.21.15.142:3300/0 conn(0x7f744808fd80 msgr2=0x7f74481503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:22.478 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744659c700 1 --2- 172.21.15.84:0/4186605066 >> v2:172.21.15.142:3300/0 conn(0x7f744808fd80 0x7f74481503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:22.478 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744659c700 1 -- 172.21.15.84:0/4186605066 >> v1:172.21.15.84:6789/0 conn(0x7f74480a2f60 legacy=0x7f744807c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:22.478 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744659c700 1 -- 172.21.15.84:0/4186605066 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744805b520 con 0x7f744805b0f0 2020-01-16T05:48:22.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744759e700 1 --2- 172.21.15.84:0/4186605066 >> v2:172.21.15.142:3300/0 conn(0x7f744808fd80 0x7f74481503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:48:22.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f7445d9b700 1 -- 172.21.15.84:0/4186605066 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177441440 0 0) 0x7f744807cd60 con 0x7f74480a2f60 2020-01-16T05:48:22.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744659c700 1 --2- 172.21.15.84:0/4186605066 >> v2:172.21.15.84:3300/0 conn(0x7f744805b0f0 0x7f74480a8ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f74480a2530 tx=0x7f7438010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:22.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744659c700 1 --2- 172.21.15.84:0/4186605066 >> v2:172.21.15.84:3300/0 conn(0x7f744805b0f0 0x7f74480a8ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f74480a2530 tx=0x7f7438010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:22.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744659c700 1 --2- 172.21.15.84:0/4186605066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f744805b0f0 0x7f74480a8ff0 secure :-1 s=READY pgs=491 cs=0 l=1 rx=0x7f74480a2530 tx=0x7f7438010170).ready entity=mon.0 client_cookie=9925eff3aec3a12b server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:22.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744659c700 1 --2- 172.21.15.84:0/4186605066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f744805b0f0 0x7f74480a8ff0 secure :-1 s=THROTTLE_DONE pgs=491 cs=0 l=1 rx=0x7f74480a2530 tx=0x7f7438010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:22.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744659c700 1 --2- 172.21.15.84:0/4186605066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f744805b0f0 0x7f74480a8ff0 secure :-1 s=THROTTLE_DONE pgs=491 cs=0 l=1 rx=0x7f74480a2530 tx=0x7f7438010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:22.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f7445d9b700 1 -- 172.21.15.84:0/4186605066 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f743800a160 con 0x7f744805b0f0 2020-01-16T05:48:22.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744659c700 1 --2- 172.21.15.84:0/4186605066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f744805b0f0 0x7f74480a8ff0 secure :-1 s=THROTTLE_DONE pgs=491 cs=0 l=1 rx=0x7f74480a2530 tx=0x7f7438010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:22.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f7445d9b700 1 -- 172.21.15.84:0/4186605066 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7438011ab0 con 0x7f744805b0f0 2020-01-16T05:48:22.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f7445d9b700 1 -- 172.21.15.84:0/4186605066 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f743800a740 con 0x7f744805b0f0 2020-01-16T05:48:22.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744cddf700 1 -- 172.21.15.84:0/4186605066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f744805b0f0 msgr2=0x7f74480a8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:22.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.472+0000 7f744cddf700 1 --2- 172.21.15.84:0/4186605066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f744805b0f0 0x7f74480a8ff0 secure :-1 s=READY pgs=491 cs=0 l=1 rx=0x7f74480a2530 tx=0x7f7438010170).stop 2020-01-16T05:48:22.482 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744cddf700 1 -- 172.21.15.84:0/4186605066 shutdown_connections 2020-01-16T05:48:22.482 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744cddf700 1 --2- 172.21.15.84:0/4186605066 >> v2:172.21.15.142:3300/0 conn(0x7f744808fd80 0x7f74481503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:22.482 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744cddf700 1 --2- 172.21.15.84:0/4186605066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f744805b0f0 0x7f74480a8ff0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:22.482 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744cddf700 1 -- 172.21.15.84:0/4186605066 shutdown_connections 2020-01-16T05:48:22.482 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744cddf700 1 -- 172.21.15.84:0/4186605066 wait complete. 2020-01-16T05:48:22.483 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744cddf700 1 -- 172.21.15.84:0/4186605066 >> 172.21.15.84:0/4186605066 conn(0x7f74480abc10 msgr2=0x7f744805a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:22.489 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744cddf700 1 Processor -- start 2020-01-16T05:48:22.489 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744cddf700 1 -- start start 2020-01-16T05:48:22.489 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744cddf700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f744807c7a0 0x7f74480a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:22.489 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744cddf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7448148230 0x7f7448148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:22.490 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744cddf700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7448148bb0 con 0x7f744809f3a0 2020-01-16T05:48:22.490 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744cddf700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74480a1dc0 con 0x7f7448148230 2020-01-16T05:48:22.490 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744cddf700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7448147f90 con 0x7f744807c7a0 2020-01-16T05:48:22.490 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7448148230 0x7f7448148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:22.491 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f744809f3a0 0x7f744809dae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53694/0 (socket says 172.21.15.84:53694) 2020-01-16T05:48:22.491 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744659c700 1 -- 172.21.15.84:0/1903689485 learned_addr learned my addr 172.21.15.84:0/1903689485 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:22.491 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f7446d9d700 1 --2- 172.21.15.84:0/1903689485 >> v2:172.21.15.142:3300/0 conn(0x7f744807c7a0 0x7f74480a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:22.491 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f743f7fe700 1 -- 172.21.15.84:0/1903689485 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653183256 0 0) 0x7f7448148bb0 con 0x7f744809f3a0 2020-01-16T05:48:22.491 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f743f7fe700 1 -- 172.21.15.84:0/1903689485 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f742c003230 con 0x7f744809f3a0 2020-01-16T05:48:22.492 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744759e700 1 -- 172.21.15.84:0/1903689485 >> v2:172.21.15.142:3300/0 conn(0x7f744807c7a0 msgr2=0x7f74480a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:22.492 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744759e700 1 --2- 172.21.15.84:0/1903689485 >> v2:172.21.15.142:3300/0 conn(0x7f744807c7a0 0x7f74480a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:22.492 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744759e700 1 -- 172.21.15.84:0/1903689485 >> v1:172.21.15.84:6789/0 conn(0x7f744809f3a0 legacy=0x7f744809dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:22.492 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f743f7fe700 1 -- 172.21.15.84:0/1903689485 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 867312026 0 0) 0x7f742c003230 con 0x7f744809f3a0 2020-01-16T05:48:22.493 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.476+0000 7f744759e700 1 -- 172.21.15.84:0/1903689485 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744809e2e0 con 0x7f7448148230 2020-01-16T05:48:22.493 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f744759e700 1 --2- 172.21.15.84:0/1903689485 >> v2:172.21.15.84:3300/0 conn(0x7f7448148230 0x7f7448148660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7438007c00 tx=0x7f74380106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:22.493 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f744759e700 1 --2- 172.21.15.84:0/1903689485 >> v2:172.21.15.84:3300/0 conn(0x7f7448148230 0x7f7448148660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7438007c00 tx=0x7f74380106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:22.493 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f744759e700 1 --2- 172.21.15.84:0/1903689485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7448148230 0x7f7448148660 secure :-1 s=READY pgs=493 cs=0 l=1 rx=0x7f7438007c00 tx=0x7f74380106c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:22.494 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f744759e700 1 --2- 172.21.15.84:0/1903689485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7448148230 0x7f7448148660 secure :-1 s=THROTTLE_DONE pgs=493 cs=0 l=1 rx=0x7f7438007c00 tx=0x7f74380106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:22.494 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f743f7fe700 1 -- 172.21.15.84:0/1903689485 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f743800a160 con 0x7f7448148230 2020-01-16T05:48:22.494 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f744759e700 1 --2- 172.21.15.84:0/1903689485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7448148230 0x7f7448148660 secure :-1 s=THROTTLE_DONE pgs=493 cs=0 l=1 rx=0x7f7438007c00 tx=0x7f74380106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:22.494 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f743f7fe700 1 -- 172.21.15.84:0/1903689485 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743800a360 con 0x7f7448148230 2020-01-16T05:48:22.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f744759e700 1 --2- 172.21.15.84:0/1903689485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7448148230 0x7f7448148660 secure :-1 s=THROTTLE_DONE pgs=493 cs=0 l=1 rx=0x7f7438007c00 tx=0x7f74380106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:22.495 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f744cddf700 1 -- 172.21.15.84:0/1903689485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74481327d0 con 0x7f7448148230 2020-01-16T05:48:22.497 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f743f7fe700 1 -- 172.21.15.84:0/1903689485 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7440007350 con 0x7f7448148230 2020-01-16T05:48:22.497 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f744cddf700 1 -- 172.21.15.84:0/1903689485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7448132d20 con 0x7f7448148230 2020-01-16T05:48:22.497 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f744759e700 1 --2- 172.21.15.84:0/1903689485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7448148230 0x7f7448148660 secure :-1 s=THROTTLE_DONE pgs=493 cs=0 l=1 rx=0x7f7438007c00 tx=0x7f74380106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:22.497 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f744cddf700 1 -- 172.21.15.84:0/1903689485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744805e1c0 con 0x7f7448148230 2020-01-16T05:48:22.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f743f7fe700 1 -- 172.21.15.84:0/1903689485 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f74400060c0 con 0x7f7448148230 2020-01-16T05:48:22.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f744759e700 1 --2- 172.21.15.84:0/1903689485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7448148230 0x7f7448148660 secure :-1 s=THROTTLE_DONE pgs=493 cs=0 l=1 rx=0x7f7438007c00 tx=0x7f74380106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:22.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f743f7fe700 1 --2- 172.21.15.84:0/1903689485 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f742c03c790 0x7f742c03eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:22.498 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f743f7fe700 1 -- 172.21.15.84:0/1903689485 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f744004c250 con 0x7f7448148230 2020-01-16T05:48:22.499 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f7446d9d700 1 --2- 172.21.15.84:0/1903689485 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f742c03c790 0x7f742c03eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:22.499 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.480+0000 7f7446d9d700 1 --2- 172.21.15.84:0/1903689485 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f742c03c790 0x7f742c03eca0 crc :-1 s=READY pgs=190 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:22.499 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.488+0000 7f744759e700 1 --2- 172.21.15.84:0/1903689485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7448148230 0x7f7448148660 secure :-1 s=THROTTLE_DONE pgs=493 cs=0 l=1 rx=0x7f7438007c00 tx=0x7f74380106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:22.500 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.488+0000 7f743f7fe700 1 -- 172.21.15.84:0/1903689485 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f7440032870 con 0x7f7448148230 2020-01-16T05:48:22.642 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.644+0000 7f744cddf700 1 -- 172.21.15.84:0/1903689485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f744808f350 con 0x7f7448148230 2020-01-16T05:48:22.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.644+0000 7f744759e700 1 --2- 172.21.15.84:0/1903689485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7448148230 0x7f7448148660 secure :-1 s=THROTTLE_DONE pgs=493 cs=0 l=1 rx=0x7f7438007c00 tx=0x7f74380106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:22.643 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.644+0000 7f743f7fe700 1 -- 172.21.15.84:0/1903689485 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f7440032ad0 con 0x7f7448148230 2020-01-16T05:48:22.643 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:22.643 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:22.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.644+0000 7f744cddf700 1 -- 172.21.15.84:0/1903689485 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f742c03c790 msgr2=0x7f742c03eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:22.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.644+0000 7f744cddf700 1 --2- 172.21.15.84:0/1903689485 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f742c03c790 0x7f742c03eca0 crc :-1 s=READY pgs=190 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:22.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.644+0000 7f744cddf700 1 -- 172.21.15.84:0/1903689485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7448148230 msgr2=0x7f7448148660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:22.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.644+0000 7f744cddf700 1 --2- 172.21.15.84:0/1903689485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7448148230 0x7f7448148660 secure :-1 s=READY pgs=493 cs=0 l=1 rx=0x7f7438007c00 tx=0x7f74380106c0).stop 2020-01-16T05:48:22.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.644+0000 7f744cddf700 1 -- 172.21.15.84:0/1903689485 shutdown_connections 2020-01-16T05:48:22.645 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.644+0000 7f744cddf700 1 --2- 172.21.15.84:0/1903689485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7448148230 0x7f7448148660 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:22.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.644+0000 7f744cddf700 1 --2- 172.21.15.84:0/1903689485 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f742c03c790 0x7f742c03eca0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:22.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.644+0000 7f744cddf700 1 --2- 172.21.15.84:0/1903689485 >> v2:172.21.15.142:3300/0 conn(0x7f744807c7a0 0x7f74480a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:22.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.644+0000 7f744cddf700 1 -- 172.21.15.84:0/1903689485 shutdown_connections 2020-01-16T05:48:22.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.644+0000 7f744cddf700 1 -- 172.21.15.84:0/1903689485 wait complete. 2020-01-16T05:48:22.646 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:22.644+0000 7f744cddf700 1 -- 172.21.15.84:0/1903689485 >> 172.21.15.84:0/1903689485 conn(0x7f744808ef10 msgr2=0x7f74480a91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:22.646 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:22.656 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:24.658 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:24.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.780+0000 7f196084f700 1 Processor -- start 2020-01-16T05:48:24.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.780+0000 7f196084f700 1 -- start start 2020-01-16T05:48:24.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.780+0000 7f196084f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f195c0a9b30 0x7f195c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:24.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.780+0000 7f196084f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c066880 con 0x7f195c0a4250 2020-01-16T05:48:24.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.780+0000 7f196084f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c066ab0 con 0x7f195c07ff10 2020-01-16T05:48:24.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.780+0000 7f196084f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c0a4830 con 0x7f195c0a9b30 2020-01-16T05:48:24.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.780+0000 7f195bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f195c0a9b30 0x7f195c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:24.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.780+0000 7f1961ab1700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f195c0a4250 0x7f195c14fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53706/0 (socket says 172.21.15.84:53706) 2020-01-16T05:48:24.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.780+0000 7f1961ab1700 1 -- 172.21.15.84:0/3029823742 learned_addr learned my addr 172.21.15.84:0/3029823742 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:24.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.780+0000 7f195bfff700 1 -- 172.21.15.84:0/3029823742 >> v1:172.21.15.142:6789/0 conn(0x7f195c07ff10 legacy=0x7f195c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:24.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.780+0000 7f195bfff700 1 -- 172.21.15.84:0/3029823742 >> v1:172.21.15.84:6789/0 conn(0x7f195c0a4250 legacy=0x7f195c14fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:24.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.780+0000 7f195affd700 1 -- 172.21.15.84:0/3029823742 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199231413 0 0) 0x7f195c066880 con 0x7f195c0a4250 2020-01-16T05:48:24.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.780+0000 7f195bfff700 1 -- 172.21.15.84:0/3029823742 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c066ce0 con 0x7f195c0a9b30 2020-01-16T05:48:24.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.780+0000 7f195bfff700 1 --2- 172.21.15.84:0/3029823742 >> v2:172.21.15.84:3300/0 conn(0x7f195c0a9b30 0x7f195c0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1954008910 tx=0x7f195400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:24.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.780+0000 7f195bfff700 1 --2- 172.21.15.84:0/3029823742 >> v2:172.21.15.84:3300/0 conn(0x7f195c0a9b30 0x7f195c0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1954008910 tx=0x7f195400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:24.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.780+0000 7f195bfff700 1 --2- 172.21.15.84:0/3029823742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f195c0a9b30 0x7f195c0abdd0 secure :-1 s=READY pgs=495 cs=0 l=1 rx=0x7f1954008910 tx=0x7f195400fd70).ready entity=mon.0 client_cookie=b6f439e9dc3e447f server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:24.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f195bfff700 1 --2- 172.21.15.84:0/3029823742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f195c0a9b30 0x7f195c0abdd0 secure :-1 s=THROTTLE_DONE pgs=495 cs=0 l=1 rx=0x7f1954008910 tx=0x7f195400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:24.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f195affd700 1 -- 172.21.15.84:0/3029823742 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19540115e0 con 0x7f195c0a9b30 2020-01-16T05:48:24.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f195bfff700 1 --2- 172.21.15.84:0/3029823742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f195c0a9b30 0x7f195c0abdd0 secure :-1 s=THROTTLE_DONE pgs=495 cs=0 l=1 rx=0x7f1954008910 tx=0x7f195400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:24.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f195bfff700 1 --2- 172.21.15.84:0/3029823742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f195c0a9b30 0x7f195c0abdd0 secure :-1 s=THROTTLE_DONE pgs=495 cs=0 l=1 rx=0x7f1954008910 tx=0x7f195400fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:24.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f195affd700 1 -- 172.21.15.84:0/3029823742 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1954008d40 con 0x7f195c0a9b30 2020-01-16T05:48:24.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f195affd700 1 -- 172.21.15.84:0/3029823742 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1954011bc0 con 0x7f195c0a9b30 2020-01-16T05:48:24.788 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f196084f700 1 -- 172.21.15.84:0/3029823742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f195c0a9b30 msgr2=0x7f195c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:24.788 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f196084f700 1 --2- 172.21.15.84:0/3029823742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f195c0a9b30 0x7f195c0abdd0 secure :-1 s=READY pgs=495 cs=0 l=1 rx=0x7f1954008910 tx=0x7f195400fd70).stop 2020-01-16T05:48:24.788 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f196084f700 1 -- 172.21.15.84:0/3029823742 shutdown_connections 2020-01-16T05:48:24.788 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f196084f700 1 --2- 172.21.15.84:0/3029823742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f195c0a9b30 0x7f195c0abdd0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:24.788 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f196084f700 1 -- 172.21.15.84:0/3029823742 shutdown_connections 2020-01-16T05:48:24.788 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f196084f700 1 -- 172.21.15.84:0/3029823742 wait complete. 2020-01-16T05:48:24.788 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f196084f700 1 -- 172.21.15.84:0/3029823742 >> 172.21.15.84:0/3029823742 conn(0x7f195c0acfc0 msgr2=0x7f195c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:24.788 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f196084f700 1 Processor -- start 2020-01-16T05:48:24.789 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f196084f700 1 -- start start 2020-01-16T05:48:24.792 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f196084f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f195c0a2ac0 0x7f195c1402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:24.792 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f196084f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c0a0570 con 0x7f195c065890 2020-01-16T05:48:24.792 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f196084f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c0a2ef0 con 0x7f195c0a1240 2020-01-16T05:48:24.792 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f196084f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c0a3330 con 0x7f195c0a2ac0 2020-01-16T05:48:24.792 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f1961ab1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f195c0a2ac0 0x7f195c1402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:24.793 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f195b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f195c065890 0x7f195c0a22c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53712/0 (socket says 172.21.15.84:53712) 2020-01-16T05:48:24.793 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.784+0000 7f195b7fe700 1 -- 172.21.15.84:0/3033105096 learned_addr learned my addr 172.21.15.84:0/3033105096 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:24.793 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f195b7fe700 1 -- 172.21.15.84:0/3033105096 >> v1:172.21.15.84:6789/0 conn(0x7f195c065890 legacy=0x7f195c0a22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2020-01-16T05:48:24.793 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f195b7fe700 1 -- 172.21.15.84:0/3033105096 >> v1:172.21.15.84:6789/0 conn(0x7f195c065890 legacy=0x7f195c0a22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-01-16T05:48:24.793 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f195b7fe700 1 --1- 172.21.15.84:0/3033105096 >> v1:172.21.15.84:6789/0 conn(0x7f195c065890 0x7f195c0a22c0 :-1 s=OPENED pgs=496 cs=1 l=1).handle_message read tag failed 2020-01-16T05:48:24.793 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f195b7fe700 1 --1- 172.21.15.84:0/3033105096 >> v1:172.21.15.84:6789/0 conn(0x7f195c065890 0x7f195c0a22c0 :-1 s=OPENED pgs=496 cs=1 l=1).fault on lossy channel, failing 2020-01-16T05:48:24.793 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f1958ff9700 1 -- 172.21.15.84:0/3033105096 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460623990 0 0) 0x7f195c0a2ef0 con 0x7f195c0a1240 2020-01-16T05:48:24.794 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f1961ab1700 1 -- 172.21.15.84:0/3033105096 >> v1:172.21.15.142:6789/0 conn(0x7f195c0a1240 legacy=0x7f195c07ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:24.794 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f1961ab1700 1 -- 172.21.15.84:0/3033105096 >> v1:172.21.15.84:6789/0 conn(0x7f195c065890 legacy=0x7f195c0a22c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-01-16T05:48:24.794 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f1961ab1700 1 -- 172.21.15.84:0/3033105096 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c07d670 con 0x7f195c0a2ac0 2020-01-16T05:48:24.794 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f1961ab1700 1 --2- 172.21.15.84:0/3033105096 >> v2:172.21.15.84:3300/0 conn(0x7f195c0a2ac0 0x7f195c1402c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f195c066090 tx=0x7f194c010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:24.795 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f1961ab1700 1 --2- 172.21.15.84:0/3033105096 >> v2:172.21.15.84:3300/0 conn(0x7f195c0a2ac0 0x7f195c1402c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f195c066090 tx=0x7f194c010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:24.795 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f1961ab1700 1 --2- 172.21.15.84:0/3033105096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f195c0a2ac0 0x7f195c1402c0 secure :-1 s=READY pgs=497 cs=0 l=1 rx=0x7f195c066090 tx=0x7f194c010920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:24.795 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f1961ab1700 1 --2- 172.21.15.84:0/3033105096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f195c0a2ac0 0x7f195c1402c0 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f195c066090 tx=0x7f194c010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:24.795 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f1958ff9700 1 -- 172.21.15.84:0/3033105096 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f194c011700 con 0x7f195c0a2ac0 2020-01-16T05:48:24.795 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f1961ab1700 1 --2- 172.21.15.84:0/3033105096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f195c0a2ac0 0x7f195c1402c0 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f195c066090 tx=0x7f194c010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:24.795 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f1961ab1700 1 --2- 172.21.15.84:0/3033105096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f195c0a2ac0 0x7f195c1402c0 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f195c066090 tx=0x7f194c010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:24.795 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f1958ff9700 1 -- 172.21.15.84:0/3033105096 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c011320 con 0x7f195c0a2ac0 2020-01-16T05:48:24.795 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f196084f700 1 -- 172.21.15.84:0/3033105096 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c140810 con 0x7f195c0a2ac0 2020-01-16T05:48:24.796 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f1958ff9700 1 -- 172.21.15.84:0/3033105096 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f194c011ce0 con 0x7f195c0a2ac0 2020-01-16T05:48:24.796 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f196084f700 1 -- 172.21.15.84:0/3033105096 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c140a20 con 0x7f195c0a2ac0 2020-01-16T05:48:24.796 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f1961ab1700 1 --2- 172.21.15.84:0/3033105096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f195c0a2ac0 0x7f195c1402c0 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f195c066090 tx=0x7f194c010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:24.796 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f196084f700 1 -- 172.21.15.84:0/3033105096 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c0a3120 con 0x7f195c0a2ac0 2020-01-16T05:48:24.796 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f1958ff9700 1 -- 172.21.15.84:0/3033105096 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f194c00b330 con 0x7f195c0a2ac0 2020-01-16T05:48:24.796 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f1961ab1700 1 --2- 172.21.15.84:0/3033105096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f195c0a2ac0 0x7f195c1402c0 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f195c066090 tx=0x7f194c010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:24.796 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f1958ff9700 1 --2- 172.21.15.84:0/3033105096 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f194003c170 0x7f194003e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:24.797 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f1958ff9700 1 -- 172.21.15.84:0/3033105096 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f194c04ca90 con 0x7f195c0a2ac0 2020-01-16T05:48:24.797 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f195bfff700 1 --2- 172.21.15.84:0/3033105096 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f194003c170 0x7f194003e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:24.797 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.788+0000 7f195bfff700 1 --2- 172.21.15.84:0/3033105096 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f194003c170 0x7f194003e680 crc :-1 s=READY pgs=191 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:24.797 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.796+0000 7f1961ab1700 1 --2- 172.21.15.84:0/3033105096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f195c0a2ac0 0x7f195c1402c0 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f195c066090 tx=0x7f194c010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:24.798 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.796+0000 7f1958ff9700 1 -- 172.21.15.84:0/3033105096 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f194c0330b0 con 0x7f195c0a2ac0 2020-01-16T05:48:24.943 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.944+0000 7f196084f700 1 -- 172.21.15.84:0/3033105096 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f195c05e1c0 con 0x7f195c0a2ac0 2020-01-16T05:48:24.944 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.944+0000 7f1961ab1700 1 --2- 172.21.15.84:0/3033105096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f195c0a2ac0 0x7f195c1402c0 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f195c066090 tx=0x7f194c010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:24.944 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.944+0000 7f1958ff9700 1 -- 172.21.15.84:0/3033105096 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f194c033310 con 0x7f195c0a2ac0 2020-01-16T05:48:24.944 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:24.944 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:24.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.944+0000 7f196084f700 1 -- 172.21.15.84:0/3033105096 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f194003c170 msgr2=0x7f194003e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:24.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.944+0000 7f196084f700 1 --2- 172.21.15.84:0/3033105096 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f194003c170 0x7f194003e680 crc :-1 s=READY pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:24.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.944+0000 7f196084f700 1 -- 172.21.15.84:0/3033105096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f195c0a2ac0 msgr2=0x7f195c1402c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:24.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.944+0000 7f196084f700 1 --2- 172.21.15.84:0/3033105096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f195c0a2ac0 0x7f195c1402c0 secure :-1 s=READY pgs=497 cs=0 l=1 rx=0x7f195c066090 tx=0x7f194c010920).stop 2020-01-16T05:48:24.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.948+0000 7f196084f700 1 -- 172.21.15.84:0/3033105096 shutdown_connections 2020-01-16T05:48:24.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.948+0000 7f196084f700 1 --2- 172.21.15.84:0/3033105096 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f194003c170 0x7f194003e680 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:24.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.948+0000 7f196084f700 1 --2- 172.21.15.84:0/3033105096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f195c0a2ac0 0x7f195c1402c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:24.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.948+0000 7f196084f700 1 -- 172.21.15.84:0/3033105096 shutdown_connections 2020-01-16T05:48:24.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.948+0000 7f196084f700 1 -- 172.21.15.84:0/3033105096 wait complete. 2020-01-16T05:48:24.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:24.948+0000 7f196084f700 1 -- 172.21.15.84:0/3033105096 >> 172.21.15.84:0/3033105096 conn(0x7f195c0ab6b0 msgr2=0x7f195c0a3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:24.947 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:24.957 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:26.958 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:27.081 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.076+0000 7f7eaffff700 1 Processor -- start 2020-01-16T05:48:27.081 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.076+0000 7f7eaffff700 1 -- start start 2020-01-16T05:48:27.081 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eaffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7eb00a4250 0x7f7eb00abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eaffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb0066880 con 0x7f7eb00a9b30 2020-01-16T05:48:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eaffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb0066ab0 con 0x7f7eb007ff10 2020-01-16T05:48:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eaffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb00a4830 con 0x7f7eb00a4250 2020-01-16T05:48:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eb581c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7eb00a4250 0x7f7eb00abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eaf7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7eb00a9b30 0x7f7eb00a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53718/0 (socket says 172.21.15.84:53718) 2020-01-16T05:48:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eaf7fe700 1 -- 172.21.15.84:0/1958814562 learned_addr learned my addr 172.21.15.84:0/1958814562 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eb581c700 1 -- 172.21.15.84:0/1958814562 >> v1:172.21.15.142:6789/0 conn(0x7f7eb007ff10 legacy=0x7f7eb014dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:27.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eb581c700 1 -- 172.21.15.84:0/1958814562 >> v1:172.21.15.84:6789/0 conn(0x7f7eb00a9b30 legacy=0x7f7eb00a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:27.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eb581c700 1 -- 172.21.15.84:0/1958814562 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb0066ce0 con 0x7f7eb00a4250 2020-01-16T05:48:27.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eb581c700 1 --2- 172.21.15.84:0/1958814562 >> v2:172.21.15.84:3300/0 conn(0x7f7eb00a4250 0x7f7eb00abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7ea8008c90 tx=0x7f7ea80100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:27.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eb581c700 1 --2- 172.21.15.84:0/1958814562 >> v2:172.21.15.84:3300/0 conn(0x7f7eb00a4250 0x7f7eb00abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7ea8008c90 tx=0x7f7ea80100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:27.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eb581c700 1 --2- 172.21.15.84:0/1958814562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7eb00a4250 0x7f7eb00abdd0 secure :-1 s=READY pgs=499 cs=0 l=1 rx=0x7f7ea8008c90 tx=0x7f7ea80100f0).ready entity=mon.0 client_cookie=3198a26b713cabbf server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:27.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eb581c700 1 --2- 172.21.15.84:0/1958814562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7eb00a4250 0x7f7eb00abdd0 secure :-1 s=THROTTLE_DONE pgs=499 cs=0 l=1 rx=0x7f7ea8008c90 tx=0x7f7ea80100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:27.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eb581c700 1 --2- 172.21.15.84:0/1958814562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7eb00a4250 0x7f7eb00abdd0 secure :-1 s=THROTTLE_DONE pgs=499 cs=0 l=1 rx=0x7f7ea8008c90 tx=0x7f7ea80100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:27.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eb581c700 1 --2- 172.21.15.84:0/1958814562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7eb00a4250 0x7f7eb00abdd0 secure :-1 s=THROTTLE_DONE pgs=499 cs=0 l=1 rx=0x7f7ea8008c90 tx=0x7f7ea80100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:27.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eaeffd700 1 -- 172.21.15.84:0/1958814562 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ea800a160 con 0x7f7eb00a4250 2020-01-16T05:48:27.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eaeffd700 1 -- 172.21.15.84:0/1958814562 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea8011b60 con 0x7f7eb00a4250 2020-01-16T05:48:27.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eaeffd700 1 -- 172.21.15.84:0/1958814562 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ea800a740 con 0x7f7eb00a4250 2020-01-16T05:48:27.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eaffff700 1 -- 172.21.15.84:0/1958814562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7eb00a4250 msgr2=0x7f7eb00abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:27.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eaffff700 1 --2- 172.21.15.84:0/1958814562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7eb00a4250 0x7f7eb00abdd0 secure :-1 s=READY pgs=499 cs=0 l=1 rx=0x7f7ea8008c90 tx=0x7f7ea80100f0).stop 2020-01-16T05:48:27.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eaffff700 1 -- 172.21.15.84:0/1958814562 shutdown_connections 2020-01-16T05:48:27.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eaffff700 1 --2- 172.21.15.84:0/1958814562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7eb00a4250 0x7f7eb00abdd0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:27.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eaffff700 1 -- 172.21.15.84:0/1958814562 shutdown_connections 2020-01-16T05:48:27.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eaffff700 1 -- 172.21.15.84:0/1958814562 wait complete. 2020-01-16T05:48:27.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.080+0000 7f7eaffff700 1 -- 172.21.15.84:0/1958814562 >> 172.21.15.84:0/1958814562 conn(0x7f7eb00acfc0 msgr2=0x7f7eb00a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:27.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaffff700 1 Processor -- start 2020-01-16T05:48:27.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaffff700 1 -- start start 2020-01-16T05:48:27.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7eb009ec30 0x7f7eb0090730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:27.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7eb008f7a0 0x7f7eb01350a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:27.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb01355f0 con 0x7f7eb00a83d0 2020-01-16T05:48:27.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb00ab090 con 0x7f7eb009ec30 2020-01-16T05:48:27.088 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb008fbd0 con 0x7f7eb008f7a0 2020-01-16T05:48:27.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eb581c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7eb00a83d0 0x7f7eb00a8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53724/0 (socket says 172.21.15.84:53724) 2020-01-16T05:48:27.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eb581c700 1 -- 172.21.15.84:0/2042462322 learned_addr learned my addr 172.21.15.84:0/2042462322 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:27.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaf7fe700 1 --2- 172.21.15.84:0/2042462322 >> v2:172.21.15.84:3300/0 conn(0x7f7eb009ec30 0x7f7eb0090730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:27.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7ea6ffd700 1 --2- 172.21.15.84:0/2042462322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7eb008f7a0 0x7f7eb01350a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:27.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eacff9700 1 -- 172.21.15.84:0/2042462322 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411368017 0 0) 0x7f7eb01355f0 con 0x7f7eb00a83d0 2020-01-16T05:48:27.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eacff9700 1 -- 172.21.15.84:0/2042462322 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e94003230 con 0x7f7eb00a83d0 2020-01-16T05:48:27.089 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaf7fe700 1 -- 172.21.15.84:0/2042462322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7eb008f7a0 msgr2=0x7f7eb01350a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:27.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaf7fe700 1 --2- 172.21.15.84:0/2042462322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7eb008f7a0 0x7f7eb01350a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:27.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaf7fe700 1 -- 172.21.15.84:0/2042462322 >> v1:172.21.15.84:6789/0 conn(0x7f7eb00a83d0 legacy=0x7f7eb00a8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:27.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaf7fe700 1 -- 172.21.15.84:0/2042462322 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb00a34b0 con 0x7f7eb009ec30 2020-01-16T05:48:27.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaf7fe700 1 --2- 172.21.15.84:0/2042462322 >> v2:172.21.15.84:3300/0 conn(0x7f7eb009ec30 0x7f7eb0090730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ea0000b80 tx=0x7f7ea00109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:27.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaf7fe700 1 --2- 172.21.15.84:0/2042462322 >> v2:172.21.15.84:3300/0 conn(0x7f7eb009ec30 0x7f7eb0090730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ea0000b80 tx=0x7f7ea00109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaf7fe700 1 --2- 172.21.15.84:0/2042462322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7eb009ec30 0x7f7eb0090730 secure :-1 s=READY pgs=501 cs=0 l=1 rx=0x7f7ea0000b80 tx=0x7f7ea00109f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaf7fe700 1 --2- 172.21.15.84:0/2042462322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7eb009ec30 0x7f7eb0090730 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f7ea0000b80 tx=0x7f7ea00109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eacff9700 1 -- 172.21.15.84:0/2042462322 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ea0004990 con 0x7f7eb009ec30 2020-01-16T05:48:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaf7fe700 1 --2- 172.21.15.84:0/2042462322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7eb009ec30 0x7f7eb0090730 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f7ea0000b80 tx=0x7f7ea00109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaf7fe700 1 --2- 172.21.15.84:0/2042462322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7eb009ec30 0x7f7eb0090730 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f7ea0000b80 tx=0x7f7ea00109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eacff9700 1 -- 172.21.15.84:0/2042462322 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea00045b0 con 0x7f7eb009ec30 2020-01-16T05:48:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaffff700 1 -- 172.21.15.84:0/2042462322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb00a9000 con 0x7f7eb009ec30 2020-01-16T05:48:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eacff9700 1 -- 172.21.15.84:0/2042462322 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ea00123b0 con 0x7f7eb009ec30 2020-01-16T05:48:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.084+0000 7f7eaffff700 1 -- 172.21.15.84:0/2042462322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb013c870 con 0x7f7eb009ec30 2020-01-16T05:48:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.088+0000 7f7eaf7fe700 1 --2- 172.21.15.84:0/2042462322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7eb009ec30 0x7f7eb0090730 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f7ea0000b80 tx=0x7f7ea00109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.088+0000 7f7eaffff700 1 -- 172.21.15.84:0/2042462322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb0091c30 con 0x7f7eb009ec30 2020-01-16T05:48:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.088+0000 7f7eacff9700 1 -- 172.21.15.84:0/2042462322 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f7ea00126d0 con 0x7f7eb009ec30 2020-01-16T05:48:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.088+0000 7f7eaf7fe700 1 --2- 172.21.15.84:0/2042462322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7eb009ec30 0x7f7eb0090730 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f7ea0000b80 tx=0x7f7ea00109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:27.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.088+0000 7f7eacff9700 1 --2- 172.21.15.84:0/2042462322 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7e9403c7f0 0x7f7e9403ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:27.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.088+0000 7f7eacff9700 1 -- 172.21.15.84:0/2042462322 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f7ea004c9f0 con 0x7f7eb009ec30 2020-01-16T05:48:27.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.088+0000 7f7ea6ffd700 1 --2- 172.21.15.84:0/2042462322 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7e9403c7f0 0x7f7e9403ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:27.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.088+0000 7f7ea6ffd700 1 --2- 172.21.15.84:0/2042462322 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7e9403c7f0 0x7f7e9403ed00 crc :-1 s=READY pgs=192 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:27.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.092+0000 7f7eaf7fe700 1 --2- 172.21.15.84:0/2042462322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7eb009ec30 0x7f7eb0090730 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f7ea0000b80 tx=0x7f7ea00109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:27.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.092+0000 7f7eacff9700 1 -- 172.21.15.84:0/2042462322 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f7ea0032ff0 con 0x7f7eb009ec30 2020-01-16T05:48:27.242 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.244+0000 7f7eaffff700 1 -- 172.21.15.84:0/2042462322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7eb005e1c0 con 0x7f7eb009ec30 2020-01-16T05:48:27.243 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.244+0000 7f7eaf7fe700 1 --2- 172.21.15.84:0/2042462322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7eb009ec30 0x7f7eb0090730 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f7ea0000b80 tx=0x7f7ea00109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:27.243 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.244+0000 7f7eacff9700 1 -- 172.21.15.84:0/2042462322 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f7ea0033250 con 0x7f7eb009ec30 2020-01-16T05:48:27.243 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:27.243 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:27.246 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.244+0000 7f7eaffff700 1 -- 172.21.15.84:0/2042462322 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7e9403c7f0 msgr2=0x7f7e9403ed00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:27.246 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.244+0000 7f7eaffff700 1 --2- 172.21.15.84:0/2042462322 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7e9403c7f0 0x7f7e9403ed00 crc :-1 s=READY pgs=192 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:27.246 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.244+0000 7f7eaffff700 1 -- 172.21.15.84:0/2042462322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7eb009ec30 msgr2=0x7f7eb0090730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:27.246 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.244+0000 7f7eaffff700 1 --2- 172.21.15.84:0/2042462322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7eb009ec30 0x7f7eb0090730 secure :-1 s=READY pgs=501 cs=0 l=1 rx=0x7f7ea0000b80 tx=0x7f7ea00109f0).stop 2020-01-16T05:48:27.246 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.244+0000 7f7eaffff700 1 -- 172.21.15.84:0/2042462322 shutdown_connections 2020-01-16T05:48:27.246 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.244+0000 7f7eaffff700 1 --2- 172.21.15.84:0/2042462322 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7e9403c7f0 0x7f7e9403ed00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:27.246 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.244+0000 7f7eaffff700 1 --2- 172.21.15.84:0/2042462322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7eb009ec30 0x7f7eb0090730 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:27.247 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.244+0000 7f7eaffff700 1 --2- 172.21.15.84:0/2042462322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7eb008f7a0 0x7f7eb01350a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:27.247 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.248+0000 7f7eaffff700 1 -- 172.21.15.84:0/2042462322 shutdown_connections 2020-01-16T05:48:27.247 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.248+0000 7f7eaffff700 1 -- 172.21.15.84:0/2042462322 wait complete. 2020-01-16T05:48:27.247 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:27.248+0000 7f7eaffff700 1 -- 172.21.15.84:0/2042462322 >> 172.21.15.84:0/2042462322 conn(0x7f7eb00a9b30 msgr2=0x7f7eb00246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:27.247 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:27.262 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:27.956 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~241s 2020-01-16T05:48:29.263 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bffff700 1 Processor -- start 2020-01-16T05:48:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bffff700 1 -- start start 2020-01-16T05:48:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c00a9b30 0x7ff8c00abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff8c007ff10 0x7ff8c0066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c0066dd0 con 0x7ff8c00a4250 2020-01-16T05:48:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c00a4830 con 0x7ff8c007ff10 2020-01-16T05:48:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c007f9d0 con 0x7ff8c00a9b30 2020-01-16T05:48:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8c5517700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff8c00a4250 0x7ff8c00a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53736/0 (socket says 172.21.15.84:53736) 2020-01-16T05:48:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8c5517700 1 -- 172.21.15.84:0/4243406255 learned_addr learned my addr 172.21.15.84:0/4243406255 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8beffd700 1 --2- 172.21.15.84:0/4243406255 >> v2:172.21.15.142:3300/0 conn(0x7ff8c007ff10 0x7ff8c0066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/4243406255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c00a9b30 0x7ff8c00abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 -- 172.21.15.84:0/4243406255 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688868559 0 0) 0x7ff8c0066dd0 con 0x7ff8c00a4250 2020-01-16T05:48:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 -- 172.21.15.84:0/4243406255 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8ac003230 con 0x7ff8c00a4250 2020-01-16T05:48:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 -- 172.21.15.84:0/4243406255 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1807528729 0 0) 0x7ff8ac003230 con 0x7ff8c00a4250 2020-01-16T05:48:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 -- 172.21.15.84:0/4243406255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c00a9b30 msgr2=0x7ff8c00abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 --2- 172.21.15.84:0/4243406255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c00a9b30 0x7ff8c00abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 -- 172.21.15.84:0/4243406255 >> v2:172.21.15.142:3300/0 conn(0x7ff8c007ff10 msgr2=0x7ff8c0066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 --2- 172.21.15.84:0/4243406255 >> v2:172.21.15.142:3300/0 conn(0x7ff8c007ff10 0x7ff8c0066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 -- 172.21.15.84:0/4243406255 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c0150ce0 con 0x7ff8c00a4250 2020-01-16T05:48:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 -- 172.21.15.84:0/4243406255 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7ff8b0001750 con 0x7ff8c00a4250 2020-01-16T05:48:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 -- 172.21.15.84:0/4243406255 >> v1:172.21.15.84:6789/0 conn(0x7ff8c00a4250 legacy=0x7ff8c00a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 --2- 172.21.15.84:0/4243406255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac003860 0x7ff8ac003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 --2- 172.21.15.84:0/4243406255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8ac0045a0 0x7ff8ac0049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 --2- 172.21.15.84:0/4243406255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8ac004f20 0x7ff8ac04f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 -- 172.21.15.84:0/4243406255 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c00a4830 con 0x7ff8ac003860 2020-01-16T05:48:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 -- 172.21.15.84:0/4243406255 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c007f9d0 con 0x7ff8ac0045a0 2020-01-16T05:48:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 -- 172.21.15.84:0/4243406255 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac005350 con 0x7ff8ac004f20 2020-01-16T05:48:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/4243406255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac003860 0x7ff8ac003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8beffd700 1 --2- 172.21.15.84:0/4243406255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8ac0045a0 0x7ff8ac0049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8c5517700 1 --2- 172.21.15.84:0/4243406255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8ac004f20 0x7ff8ac04f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bf7fe700 1 -- 172.21.15.84:0/4243406255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8ac004f20 msgr2=0x7ff8ac04f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:29.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/4243406255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8ac004f20 0x7ff8ac04f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:29.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bf7fe700 1 -- 172.21.15.84:0/4243406255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8ac0045a0 msgr2=0x7ff8ac0049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:29.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/4243406255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8ac0045a0 0x7ff8ac0049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:29.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bf7fe700 1 -- 172.21.15.84:0/4243406255 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac04fdb0 con 0x7ff8ac003860 2020-01-16T05:48:29.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8beffd700 1 --2- 172.21.15.84:0/4243406255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8ac0045a0 0x7ff8ac0049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:48:29.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/4243406255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac003860 0x7ff8ac003c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff8b80032b0 tx=0x7ff8b80104e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:29.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/4243406255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac003860 0x7ff8ac003c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff8b80032b0 tx=0x7ff8b80104e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:29.396 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/4243406255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac003860 0x7ff8ac003c90 secure :-1 s=READY pgs=503 cs=0 l=1 rx=0x7ff8b80032b0 tx=0x7ff8b80104e0).ready entity=mon.0 client_cookie=ff58141661c12a0f server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:29.396 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/4243406255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac003860 0x7ff8ac003c90 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7ff8b80032b0 tx=0x7ff8b80104e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:29.396 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 -- 172.21.15.84:0/4243406255 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8b80110c0 con 0x7ff8ac003860 2020-01-16T05:48:29.396 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/4243406255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac003860 0x7ff8ac003c90 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7ff8b80032b0 tx=0x7ff8b80104e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:29.396 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/4243406255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac003860 0x7ff8ac003c90 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7ff8b80032b0 tx=0x7ff8b80104e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:29.396 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 -- 172.21.15.84:0/4243406255 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b8005a40 con 0x7ff8ac003860 2020-01-16T05:48:29.396 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8be7fc700 1 -- 172.21.15.84:0/4243406255 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8b80116a0 con 0x7ff8ac003860 2020-01-16T05:48:29.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bffff700 1 -- 172.21.15.84:0/4243406255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac003860 msgr2=0x7ff8ac003c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:29.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8bffff700 1 --2- 172.21.15.84:0/4243406255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac003860 0x7ff8ac003c90 secure :-1 s=READY pgs=503 cs=0 l=1 rx=0x7ff8b80032b0 tx=0x7ff8b80104e0).stop 2020-01-16T05:48:29.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.384+0000 7ff8c5517700 1 -- 172.21.15.84:0/4243406255 reap_dead start 2020-01-16T05:48:29.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bffff700 1 -- 172.21.15.84:0/4243406255 shutdown_connections 2020-01-16T05:48:29.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bffff700 1 -- 172.21.15.84:0/4243406255 shutdown_connections 2020-01-16T05:48:29.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bffff700 1 -- 172.21.15.84:0/4243406255 wait complete. 2020-01-16T05:48:29.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bffff700 1 -- 172.21.15.84:0/4243406255 >> 172.21.15.84:0/4243406255 conn(0x7ff8c00acfc0 msgr2=0x7ff8c00a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:29.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bffff700 1 Processor -- start 2020-01-16T05:48:29.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bffff700 1 -- start start 2020-01-16T05:48:29.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff8c0125150 0x7ff8c008f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:29.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c0091380 0x7ff8c00917b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:29.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c0091d00 con 0x7ff8c013c110 2020-01-16T05:48:29.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c00661f0 con 0x7ff8c0125150 2020-01-16T05:48:29.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c0066400 con 0x7ff8c0091380 2020-01-16T05:48:29.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bf7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff8c0125150 0x7ff8c008f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:29.399 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8c5517700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff8c013c110 0x7ff8c013c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53750/0 (socket says 172.21.15.84:53750) 2020-01-16T05:48:29.399 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bf7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff8c0125150 0x7ff8c008f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36546/0 (socket says 172.21.15.84:36546) 2020-01-16T05:48:29.399 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8c5517700 1 -- 172.21.15.84:0/958702114 learned_addr learned my addr 172.21.15.84:0/958702114 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:29.399 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8beffd700 1 --2- 172.21.15.84:0/958702114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c0091380 0x7ff8c00917b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:29.399 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bf7fe700 1 -- 172.21.15.84:0/958702114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c0091380 msgr2=0x7ff8c00917b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:29.399 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/958702114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c0091380 0x7ff8c00917b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:29.399 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bf7fe700 1 -- 172.21.15.84:0/958702114 >> v1:172.21.15.84:6789/0 conn(0x7ff8c013c110 legacy=0x7ff8c013c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:29.399 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8b7fff700 1 -- 172.21.15.84:0/958702114 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722276846 0 0) 0x7ff8c0091d00 con 0x7ff8c013c110 2020-01-16T05:48:29.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bf7fe700 1 -- 172.21.15.84:0/958702114 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c013cd40 con 0x7ff8c0125150 2020-01-16T05:48:29.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/958702114 >> v2:172.21.15.84:3300/0 conn(0x7ff8c0125150 0x7ff8c008f010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8b80032b0 tx=0x7ff8b8007080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:29.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/958702114 >> v2:172.21.15.84:3300/0 conn(0x7ff8c0125150 0x7ff8c008f010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8b80032b0 tx=0x7ff8b8007080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:29.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/958702114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c0125150 0x7ff8c008f010 secure :-1 s=READY pgs=505 cs=0 l=1 rx=0x7ff8b80032b0 tx=0x7ff8b8007080).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:29.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/958702114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c0125150 0x7ff8c008f010 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7ff8b80032b0 tx=0x7ff8b8007080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:29.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8b7fff700 1 -- 172.21.15.84:0/958702114 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8b8007740 con 0x7ff8c0125150 2020-01-16T05:48:29.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/958702114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c0125150 0x7ff8c008f010 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7ff8b80032b0 tx=0x7ff8b8007080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:29.401 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8b7fff700 1 -- 172.21.15.84:0/958702114 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b80112c0 con 0x7ff8c0125150 2020-01-16T05:48:29.401 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bffff700 1 -- 172.21.15.84:0/958702114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c0143790 con 0x7ff8c0125150 2020-01-16T05:48:29.401 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/958702114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c0125150 0x7ff8c008f010 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7ff8b80032b0 tx=0x7ff8b8007080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:29.401 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8b7fff700 1 -- 172.21.15.84:0/958702114 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8b8011890 con 0x7ff8c0125150 2020-01-16T05:48:29.401 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.388+0000 7ff8bffff700 1 -- 172.21.15.84:0/958702114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c0143cc0 con 0x7ff8c0125150 2020-01-16T05:48:29.401 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.392+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/958702114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c0125150 0x7ff8c008f010 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7ff8b80032b0 tx=0x7ff8b8007080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:29.401 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.392+0000 7ff8b7fff700 1 -- 172.21.15.84:0/958702114 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7ff8b8011b30 con 0x7ff8c0125150 2020-01-16T05:48:29.402 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.392+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/958702114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c0125150 0x7ff8c008f010 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7ff8b80032b0 tx=0x7ff8b8007080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:29.402 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.392+0000 7ff8bffff700 1 -- 172.21.15.84:0/958702114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c005e1c0 con 0x7ff8c0125150 2020-01-16T05:48:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.392+0000 7ff8b7fff700 1 --2- 172.21.15.84:0/958702114 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7ff8a403c1b0 0x7ff8a403e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.392+0000 7ff8b7fff700 1 -- 172.21.15.84:0/958702114 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7ff8b804d190 con 0x7ff8c0125150 2020-01-16T05:48:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.392+0000 7ff8beffd700 1 --2- 172.21.15.84:0/958702114 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7ff8a403c1b0 0x7ff8a403e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.392+0000 7ff8beffd700 1 --2- 172.21.15.84:0/958702114 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7ff8a403c1b0 0x7ff8a403e6c0 crc :-1 s=READY pgs=193 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.396+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/958702114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c0125150 0x7ff8c008f010 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7ff8b80032b0 tx=0x7ff8b8007080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.396+0000 7ff8b7fff700 1 -- 172.21.15.84:0/958702114 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7ff8b8033950 con 0x7ff8c0125150 2020-01-16T05:48:29.547 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.548+0000 7ff8bffff700 1 -- 172.21.15.84:0/958702114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8c005cbc0 con 0x7ff8c0125150 2020-01-16T05:48:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.548+0000 7ff8bf7fe700 1 --2- 172.21.15.84:0/958702114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c0125150 0x7ff8c008f010 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7ff8b80032b0 tx=0x7ff8b8007080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.548+0000 7ff8b7fff700 1 -- 172.21.15.84:0/958702114 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7ff8b8034fe0 con 0x7ff8c0125150 2020-01-16T05:48:29.549 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:29.549 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:29.550 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.552+0000 7ff8bffff700 1 -- 172.21.15.84:0/958702114 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7ff8a403c1b0 msgr2=0x7ff8a403e6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:29.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.552+0000 7ff8bffff700 1 --2- 172.21.15.84:0/958702114 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7ff8a403c1b0 0x7ff8a403e6c0 crc :-1 s=READY pgs=193 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:29.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.552+0000 7ff8bffff700 1 -- 172.21.15.84:0/958702114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c0125150 msgr2=0x7ff8c008f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:29.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.552+0000 7ff8bffff700 1 --2- 172.21.15.84:0/958702114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c0125150 0x7ff8c008f010 secure :-1 s=READY pgs=505 cs=0 l=1 rx=0x7ff8b80032b0 tx=0x7ff8b8007080).stop 2020-01-16T05:48:29.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.552+0000 7ff8bffff700 1 -- 172.21.15.84:0/958702114 shutdown_connections 2020-01-16T05:48:29.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.552+0000 7ff8bffff700 1 --2- 172.21.15.84:0/958702114 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7ff8a403c1b0 0x7ff8a403e6c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:29.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.552+0000 7ff8bffff700 1 --2- 172.21.15.84:0/958702114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c0125150 0x7ff8c008f010 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:29.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.552+0000 7ff8bffff700 1 --2- 172.21.15.84:0/958702114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c0091380 0x7ff8c00917b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:29.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.552+0000 7ff8bffff700 1 -- 172.21.15.84:0/958702114 shutdown_connections 2020-01-16T05:48:29.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.552+0000 7ff8bffff700 1 -- 172.21.15.84:0/958702114 wait complete. 2020-01-16T05:48:29.552 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:29.552+0000 7ff8bffff700 1 -- 172.21.15.84:0/958702114 >> 172.21.15.84:0/958702114 conn(0x7ff8c0025100 msgr2=0x7ff8c005e570 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:29.552 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:29.562 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:31.564 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.684+0000 7fdbcf55d700 1 Processor -- start 2020-01-16T05:48:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.684+0000 7fdbcf55d700 1 -- start start 2020-01-16T05:48:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.684+0000 7fdbcf55d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdbc807ff10 0x7fdbc80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.684+0000 7fdbcf55d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbc80a4250 0x7fdbc8066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.684+0000 7fdbcf55d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc8066dd0 con 0x7fdbc80a9b30 2020-01-16T05:48:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.684+0000 7fdbcf55d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc80a4830 con 0x7fdbc807ff10 2020-01-16T05:48:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.684+0000 7fdbcf55d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc807f9d0 con 0x7fdbc80a4250 2020-01-16T05:48:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.684+0000 7fdbced5c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdbc80a9b30 0x7fdbc80a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53754/0 (socket says 172.21.15.84:53754) 2020-01-16T05:48:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.684+0000 7fdbced5c700 1 -- 172.21.15.84:0/3849529464 learned_addr learned my addr 172.21.15.84:0/3849529464 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:31.691 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3849529464 >> v2:172.21.15.142:3300/0 conn(0x7fdbc807ff10 0x7fdbc80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:31.691 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbd07bf700 1 --2- 172.21.15.84:0/3849529464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbc80a4250 0x7fdbc8066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:31.691 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbcdd5a700 1 -- 172.21.15.84:0/3849529464 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81045791 0 0) 0x7fdbc8066dd0 con 0x7fdbc80a9b30 2020-01-16T05:48:31.691 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbcdd5a700 1 -- 172.21.15.84:0/3849529464 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbb0003230 con 0x7fdbc80a9b30 2020-01-16T05:48:31.691 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbce55b700 1 -- 172.21.15.84:0/3849529464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbc80a4250 msgr2=0x7fdbc8066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:31.691 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3849529464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbc80a4250 0x7fdbc8066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:31.691 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbcdd5a700 1 -- 172.21.15.84:0/3849529464 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3184670851 0 0) 0x7fdbb0003230 con 0x7fdbc80a9b30 2020-01-16T05:48:31.692 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbce55b700 1 -- 172.21.15.84:0/3849529464 >> v1:172.21.15.84:6789/0 conn(0x7fdbc80a9b30 legacy=0x7fdbc80a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:31.692 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbce55b700 1 -- 172.21.15.84:0/3849529464 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc8150ce0 con 0x7fdbc807ff10 2020-01-16T05:48:31.692 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3849529464 >> v2:172.21.15.142:3300/0 conn(0x7fdbc807ff10 0x7fdbc80abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdbc0001d10 tx=0x7fdbc0001d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:31.692 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3849529464 >> v2:172.21.15.142:3300/0 conn(0x7fdbc807ff10 0x7fdbc80abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdbc0001d10 tx=0x7fdbc0001d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:31.692 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3849529464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbc807ff10 0x7fdbc80abdd0 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7fdbc0001d10 tx=0x7fdbc0001d50).ready entity=mon.1 client_cookie=807d3d8bbab47c2a server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:31.692 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3849529464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbc807ff10 0x7fdbc80abdd0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7fdbc0001d10 tx=0x7fdbc0001d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:31.693 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbcdd5a700 1 -- 172.21.15.84:0/3849529464 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbc0001ad0 con 0x7fdbc807ff10 2020-01-16T05:48:31.693 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3849529464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbc807ff10 0x7fdbc80abdd0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7fdbc0001d10 tx=0x7fdbc0001d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:31.693 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3849529464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbc807ff10 0x7fdbc80abdd0 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7fdbc0001d10 tx=0x7fdbc0001d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:31.693 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbcdd5a700 1 -- 172.21.15.84:0/3849529464 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc00018e0 con 0x7fdbc807ff10 2020-01-16T05:48:31.693 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbcdd5a700 1 -- 172.21.15.84:0/3849529464 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbbc011750 con 0x7fdbc807ff10 2020-01-16T05:48:31.693 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbcf55d700 1 -- 172.21.15.84:0/3849529464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbc807ff10 msgr2=0x7fdbc80abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:31.694 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbcf55d700 1 --2- 172.21.15.84:0/3849529464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbc807ff10 0x7fdbc80abdd0 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7fdbc0001d10 tx=0x7fdbc0001d50).stop 2020-01-16T05:48:31.694 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbcf55d700 1 -- 172.21.15.84:0/3849529464 shutdown_connections 2020-01-16T05:48:31.694 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbcf55d700 1 --2- 172.21.15.84:0/3849529464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbc80a4250 0x7fdbc8066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:31.694 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbcf55d700 1 --2- 172.21.15.84:0/3849529464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbc807ff10 0x7fdbc80abdd0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:31.694 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbcf55d700 1 -- 172.21.15.84:0/3849529464 shutdown_connections 2020-01-16T05:48:31.694 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbcf55d700 1 -- 172.21.15.84:0/3849529464 wait complete. 2020-01-16T05:48:31.694 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbcf55d700 1 -- 172.21.15.84:0/3849529464 >> 172.21.15.84:0/3849529464 conn(0x7fdbc80acfc0 msgr2=0x7fdbc80a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:31.695 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbcf55d700 1 Processor -- start 2020-01-16T05:48:31.695 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.688+0000 7fdbcf55d700 1 -- start start 2020-01-16T05:48:31.697 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbcf55d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbc80a7450 0x7fdbc809f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:31.698 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbcf55d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdbc80a8610 0x7fdbc809f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:31.698 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbcf55d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdbc81257f0 0x7fdbc8125c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:31.698 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbcf55d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc80a8bf0 con 0x7fdbc80a8610 2020-01-16T05:48:31.698 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbcf55d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc80a8e90 con 0x7fdbc81257f0 2020-01-16T05:48:31.698 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbcf55d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc8126170 con 0x7fdbc80a7450 2020-01-16T05:48:31.698 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbce55b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdbc80a8610 0x7fdbc809f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:31.698 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbce55b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdbc80a8610 0x7fdbc809f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36564/0 (socket says 172.21.15.84:36564) 2020-01-16T05:48:31.699 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbce55b700 1 -- 172.21.15.84:0/3459410903 learned_addr learned my addr 172.21.15.84:0/3459410903 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:31.699 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbced5c700 1 --2- 172.21.15.84:0/3459410903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbc80a7450 0x7fdbc809f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:31.699 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbd07bf700 1 --2- 172.21.15.84:0/3459410903 >> v2:172.21.15.142:3300/0 conn(0x7fdbc81257f0 0x7fdbc8125c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:31.699 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbce55b700 1 -- 172.21.15.84:0/3459410903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbc80a7450 msgr2=0x7fdbc809f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:31.699 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3459410903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbc80a7450 0x7fdbc809f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:31.699 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbce55b700 1 -- 172.21.15.84:0/3459410903 >> v2:172.21.15.142:3300/0 conn(0x7fdbc81257f0 msgr2=0x7fdbc8125c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:31.699 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3459410903 >> v2:172.21.15.142:3300/0 conn(0x7fdbc81257f0 0x7fdbc8125c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:31.699 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbce55b700 1 -- 172.21.15.84:0/3459410903 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc80a3560 con 0x7fdbc80a8610 2020-01-16T05:48:31.700 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3459410903 >> v2:172.21.15.84:3300/0 conn(0x7fdbc80a8610 0x7fdbc809f920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdbc8125210 tx=0x7fdbbc011ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:31.700 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3459410903 >> v2:172.21.15.84:3300/0 conn(0x7fdbc80a8610 0x7fdbc809f920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdbc8125210 tx=0x7fdbbc011ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:31.700 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3459410903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbc80a8610 0x7fdbc809f920 secure :-1 s=READY pgs=507 cs=0 l=1 rx=0x7fdbc8125210 tx=0x7fdbbc011ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:31.700 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3459410903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbc80a8610 0x7fdbc809f920 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7fdbc8125210 tx=0x7fdbbc011ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:31.700 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbc77fe700 1 -- 172.21.15.84:0/3459410903 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbbc007340 con 0x7fdbc80a8610 2020-01-16T05:48:31.700 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbcf55d700 1 -- 172.21.15.84:0/3459410903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc8065870 con 0x7fdbc80a8610 2020-01-16T05:48:31.700 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3459410903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbc80a8610 0x7fdbc809f920 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7fdbc8125210 tx=0x7fdbbc011ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:31.701 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbc77fe700 1 -- 172.21.15.84:0/3459410903 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc011370 con 0x7fdbc80a8610 2020-01-16T05:48:31.701 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3459410903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbc80a8610 0x7fdbc809f920 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7fdbc8125210 tx=0x7fdbbc011ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:31.701 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbc77fe700 1 -- 172.21.15.84:0/3459410903 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbbc00f550 con 0x7fdbc80a8610 2020-01-16T05:48:31.701 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbcf55d700 1 -- 172.21.15.84:0/3459410903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc80a54c0 con 0x7fdbc80a8610 2020-01-16T05:48:31.701 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3459410903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbc80a8610 0x7fdbc809f920 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7fdbc8125210 tx=0x7fdbbc011ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:31.701 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbc77fe700 1 -- 172.21.15.84:0/3459410903 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fdbbc0056c0 con 0x7fdbc80a8610 2020-01-16T05:48:31.701 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3459410903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbc80a8610 0x7fdbc809f920 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7fdbc8125210 tx=0x7fdbbc011ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:31.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbc77fe700 1 --2- 172.21.15.84:0/3459410903 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdba803c270 0x7fdba803e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:31.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbc77fe700 1 -- 172.21.15.84:0/3459410903 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fdbbc04ccf0 con 0x7fdbc80a8610 2020-01-16T05:48:31.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbced5c700 1 --2- 172.21.15.84:0/3459410903 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdba803c270 0x7fdba803e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:31.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.692+0000 7fdbced5c700 1 --2- 172.21.15.84:0/3459410903 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdba803c270 0x7fdba803e780 crc :-1 s=READY pgs=194 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:31.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.696+0000 7fdbcf55d700 1 -- 172.21.15.84:0/3459410903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba4003360 con 0x7fdbc80a8610 2020-01-16T05:48:31.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.700+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3459410903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbc80a8610 0x7fdbc809f920 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7fdbc8125210 tx=0x7fdbbc011ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:31.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.700+0000 7fdbc77fe700 1 -- 172.21.15.84:0/3459410903 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fdbbc0332f0 con 0x7fdbc80a8610 2020-01-16T05:48:31.848 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.848+0000 7fdbcf55d700 1 -- 172.21.15.84:0/3459410903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdba4003790 con 0x7fdbc80a8610 2020-01-16T05:48:31.849 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.848+0000 7fdbce55b700 1 --2- 172.21.15.84:0/3459410903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbc80a8610 0x7fdbc809f920 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7fdbc8125210 tx=0x7fdbbc011ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:31.849 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.848+0000 7fdbc77fe700 1 -- 172.21.15.84:0/3459410903 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fdbbc033550 con 0x7fdbc80a8610 2020-01-16T05:48:31.849 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:31.849 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:31.850 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.852+0000 7fdbcf55d700 1 -- 172.21.15.84:0/3459410903 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdba803c270 msgr2=0x7fdba803e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:31.850 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.852+0000 7fdbcf55d700 1 --2- 172.21.15.84:0/3459410903 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdba803c270 0x7fdba803e780 crc :-1 s=READY pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:31.851 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.852+0000 7fdbcf55d700 1 -- 172.21.15.84:0/3459410903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbc80a8610 msgr2=0x7fdbc809f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:31.851 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.852+0000 7fdbcf55d700 1 --2- 172.21.15.84:0/3459410903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbc80a8610 0x7fdbc809f920 secure :-1 s=READY pgs=507 cs=0 l=1 rx=0x7fdbc8125210 tx=0x7fdbbc011ac0).stop 2020-01-16T05:48:31.851 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.852+0000 7fdbcf55d700 1 -- 172.21.15.84:0/3459410903 shutdown_connections 2020-01-16T05:48:31.851 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.852+0000 7fdbcf55d700 1 --2- 172.21.15.84:0/3459410903 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdba803c270 0x7fdba803e780 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:31.851 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.852+0000 7fdbcf55d700 1 --2- 172.21.15.84:0/3459410903 >> v2:172.21.15.142:3300/0 conn(0x7fdbc81257f0 0x7fdbc8125c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:31.851 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.852+0000 7fdbcf55d700 1 --2- 172.21.15.84:0/3459410903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbc80a7450 0x7fdbc809f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:31.852 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.852+0000 7fdbcf55d700 1 --2- 172.21.15.84:0/3459410903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbc80a8610 0x7fdbc809f920 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:31.852 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.852+0000 7fdbcf55d700 1 -- 172.21.15.84:0/3459410903 shutdown_connections 2020-01-16T05:48:31.852 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.852+0000 7fdbcf55d700 1 -- 172.21.15.84:0/3459410903 wait complete. 2020-01-16T05:48:31.852 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:31.852+0000 7fdbcf55d700 1 -- 172.21.15.84:0/3459410903 >> 172.21.15.84:0/3459410903 conn(0x7fdbc80a9b30 msgr2=0x7fdbc80a3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:31.852 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:31.861 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:48:33.862 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:33.987 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1e077700 1 Processor -- start 2020-01-16T05:48:33.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1e077700 1 -- start start 2020-01-16T05:48:33.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1e077700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180a9b30 0x7f4f180abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:33.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1e077700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f18066880 con 0x7f4f1807ff10 2020-01-16T05:48:33.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1e077700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f18066ab0 con 0x7f4f180a4250 2020-01-16T05:48:33.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1e077700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180a4830 con 0x7f4f180a9b30 2020-01-16T05:48:33.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1d075700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4f1807ff10 0x7f4f180a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53770/0 (socket says 172.21.15.84:53770) 2020-01-16T05:48:33.988 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1d075700 1 -- 172.21.15.84:0/2741433918 learned_addr learned my addr 172.21.15.84:0/2741433918 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1d876700 1 --2- 172.21.15.84:0/2741433918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180a9b30 0x7f4f180abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1c874700 1 -- 172.21.15.84:0/2741433918 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156286172 0 0) 0x7f4f18066880 con 0x7f4f1807ff10 2020-01-16T05:48:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1c874700 1 -- 172.21.15.84:0/2741433918 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f00003230 con 0x7f4f1807ff10 2020-01-16T05:48:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1c874700 1 -- 172.21.15.84:0/2741433918 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144644220 0 0) 0x7f4f18066ab0 con 0x7f4f180a4250 2020-01-16T05:48:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1c874700 1 -- 172.21.15.84:0/2741433918 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f18066880 con 0x7f4f180a4250 2020-01-16T05:48:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1d876700 1 -- 172.21.15.84:0/2741433918 >> v1:172.21.15.142:6789/0 conn(0x7f4f180a4250 legacy=0x7f4f1814fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1d876700 1 -- 172.21.15.84:0/2741433918 >> v1:172.21.15.84:6789/0 conn(0x7f4f1807ff10 legacy=0x7f4f180a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:33.990 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1d876700 1 -- 172.21.15.84:0/2741433918 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f18066ce0 con 0x7f4f180a9b30 2020-01-16T05:48:33.990 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1d876700 1 --2- 172.21.15.84:0/2741433918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180a9b30 0x7f4f180abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4f100032b0 tx=0x7f4f100100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:33.990 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1d876700 1 --2- 172.21.15.84:0/2741433918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180a9b30 0x7f4f180abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4f100032b0 tx=0x7f4f100100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:33.990 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1d876700 1 --2- 172.21.15.84:0/2741433918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180a9b30 0x7f4f180abdd0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f4f100032b0 tx=0x7f4f100100f0).ready entity=mon.2 client_cookie=38e301981b6ffb96 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:33.990 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1d876700 1 --2- 172.21.15.84:0/2741433918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180a9b30 0x7f4f180abdd0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f4f100032b0 tx=0x7f4f100100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:33.990 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.984+0000 7f4f1c874700 1 -- 172.21.15.84:0/2741433918 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f1000a160 con 0x7f4f180a9b30 2020-01-16T05:48:33.990 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1d876700 1 --2- 172.21.15.84:0/2741433918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180a9b30 0x7f4f180abdd0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f4f100032b0 tx=0x7f4f100100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:33.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1c874700 1 -- 172.21.15.84:0/2741433918 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f10011ba0 con 0x7f4f180a9b30 2020-01-16T05:48:33.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1d876700 1 --2- 172.21.15.84:0/2741433918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180a9b30 0x7f4f180abdd0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f4f100032b0 tx=0x7f4f100100f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:33.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1c874700 1 -- 172.21.15.84:0/2741433918 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f1000a740 con 0x7f4f180a9b30 2020-01-16T05:48:33.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1e077700 1 -- 172.21.15.84:0/2741433918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180a9b30 msgr2=0x7f4f180abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:33.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1e077700 1 --2- 172.21.15.84:0/2741433918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180a9b30 0x7f4f180abdd0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f4f100032b0 tx=0x7f4f100100f0).stop 2020-01-16T05:48:33.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1e077700 1 -- 172.21.15.84:0/2741433918 shutdown_connections 2020-01-16T05:48:33.991 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1e077700 1 --2- 172.21.15.84:0/2741433918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180a9b30 0x7f4f180abdd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:33.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1e077700 1 -- 172.21.15.84:0/2741433918 shutdown_connections 2020-01-16T05:48:33.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1e077700 1 -- 172.21.15.84:0/2741433918 wait complete. 2020-01-16T05:48:33.992 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1e077700 1 -- 172.21.15.84:0/2741433918 >> 172.21.15.84:0/2741433918 conn(0x7f4f180acfc0 msgr2=0x7f4f180a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:33.994 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1e077700 1 Processor -- start 2020-01-16T05:48:33.995 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1e077700 1 -- start start 2020-01-16T05:48:33.995 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1e077700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4f18133960 0x7f4f18122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:33.995 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1e077700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4f18124b30 0x7f4f181368c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:33.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1e077700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1809fb80 con 0x7f4f18136e10 2020-01-16T05:48:33.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1e077700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f18136380 con 0x7f4f18133960 2020-01-16T05:48:33.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1e077700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f18136620 con 0x7f4f18124b30 2020-01-16T05:48:33.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1d876700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4f18133960 0x7f4f18122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:33.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1d876700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4f18133960 0x7f4f18122c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36574/0 (socket says 172.21.15.84:36574) 2020-01-16T05:48:33.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1d876700 1 -- 172.21.15.84:0/3478851224 learned_addr learned my addr 172.21.15.84:0/3478851224 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:33.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.988+0000 7f4f1d075700 1 --2- 172.21.15.84:0/3478851224 >> v2:172.21.15.142:3300/0 conn(0x7f4f18124b30 0x7f4f181368c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:33.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f1d876700 1 -- 172.21.15.84:0/3478851224 >> v2:172.21.15.142:3300/0 conn(0x7f4f18124b30 msgr2=0x7f4f181368c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:33.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f1d876700 1 --2- 172.21.15.84:0/3478851224 >> v2:172.21.15.142:3300/0 conn(0x7f4f18124b30 0x7f4f181368c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:33.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f1d876700 1 -- 172.21.15.84:0/3478851224 >> v1:172.21.15.142:6789/0 conn(0x7f4f18136e10 legacy=0x7f4f180a26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:33.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f1d876700 1 -- 172.21.15.84:0/3478851224 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f18123190 con 0x7f4f18133960 2020-01-16T05:48:33.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f1d876700 1 --2- 172.21.15.84:0/3478851224 >> v2:172.21.15.84:3300/0 conn(0x7f4f18133960 0x7f4f18122c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4f18123e00 tx=0x7f4f1000a550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:33.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f1d876700 1 --2- 172.21.15.84:0/3478851224 >> v2:172.21.15.84:3300/0 conn(0x7f4f18133960 0x7f4f18122c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4f18123e00 tx=0x7f4f1000a550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:33.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f1d876700 1 --2- 172.21.15.84:0/3478851224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f18133960 0x7f4f18122c40 secure :-1 s=READY pgs=509 cs=0 l=1 rx=0x7f4f18123e00 tx=0x7f4f1000a550).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:33.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f1d876700 1 --2- 172.21.15.84:0/3478851224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f18133960 0x7f4f18122c40 secure :-1 s=THROTTLE_DONE pgs=509 cs=0 l=1 rx=0x7f4f18123e00 tx=0x7f4f1000a550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:33.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f167fc700 1 -- 172.21.15.84:0/3478851224 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f1000ac30 con 0x7f4f18133960 2020-01-16T05:48:33.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f1d876700 1 --2- 172.21.15.84:0/3478851224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f18133960 0x7f4f18122c40 secure :-1 s=THROTTLE_DONE pgs=509 cs=0 l=1 rx=0x7f4f18123e00 tx=0x7f4f1000a550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:33.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f1d876700 1 --2- 172.21.15.84:0/3478851224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f18133960 0x7f4f18122c40 secure :-1 s=THROTTLE_DONE pgs=509 cs=0 l=1 rx=0x7f4f18123e00 tx=0x7f4f1000a550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:33.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f167fc700 1 -- 172.21.15.84:0/3478851224 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1000a360 con 0x7f4f18133960 2020-01-16T05:48:33.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f1e077700 1 -- 172.21.15.84:0/3478851224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f180661d0 con 0x7f4f18133960 2020-01-16T05:48:33.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f167fc700 1 -- 172.21.15.84:0/3478851224 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f10007150 con 0x7f4f18133960 2020-01-16T05:48:34.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f1e077700 1 -- 172.21.15.84:0/3478851224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f180a2ee0 con 0x7f4f18133960 2020-01-16T05:48:34.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f1d876700 1 --2- 172.21.15.84:0/3478851224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f18133960 0x7f4f18122c40 secure :-1 s=THROTTLE_DONE pgs=509 cs=0 l=1 rx=0x7f4f18123e00 tx=0x7f4f1000a550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:34.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f1e077700 1 -- 172.21.15.84:0/3478851224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1805e1c0 con 0x7f4f18133960 2020-01-16T05:48:34.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f167fc700 1 -- 172.21.15.84:0/3478851224 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f4f10007460 con 0x7f4f18133960 2020-01-16T05:48:34.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f1d876700 1 --2- 172.21.15.84:0/3478851224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f18133960 0x7f4f18122c40 secure :-1 s=THROTTLE_DONE pgs=509 cs=0 l=1 rx=0x7f4f18123e00 tx=0x7f4f1000a550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:34.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f167fc700 1 --2- 172.21.15.84:0/3478851224 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4ef803c270 0x7f4ef803e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:34.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f167fc700 1 -- 172.21.15.84:0/3478851224 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f4f1004d530 con 0x7f4f18133960 2020-01-16T05:48:34.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f1d075700 1 --2- 172.21.15.84:0/3478851224 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4ef803c270 0x7f4ef803e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:34.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.992+0000 7f4f1d075700 1 --2- 172.21.15.84:0/3478851224 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4ef803c270 0x7f4ef803e780 crc :-1 s=READY pgs=195 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:34.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.996+0000 7f4f1d876700 1 --2- 172.21.15.84:0/3478851224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f18133960 0x7f4f18122c40 secure :-1 s=THROTTLE_DONE pgs=509 cs=0 l=1 rx=0x7f4f18123e00 tx=0x7f4f1000a550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:34.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:33.996+0000 7f4f167fc700 1 -- 172.21.15.84:0/3478851224 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f4f10033b50 con 0x7f4f18133960 2020-01-16T05:48:34.147 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:34.148+0000 7f4f1e077700 1 -- 172.21.15.84:0/3478851224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f180a3920 con 0x7f4f18133960 2020-01-16T05:48:34.148 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:34.148+0000 7f4f1d876700 1 --2- 172.21.15.84:0/3478851224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f18133960 0x7f4f18122c40 secure :-1 s=THROTTLE_DONE pgs=509 cs=0 l=1 rx=0x7f4f18123e00 tx=0x7f4f1000a550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:34.148 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:34.148+0000 7f4f167fc700 1 -- 172.21.15.84:0/3478851224 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f4f10033db0 con 0x7f4f18133960 2020-01-16T05:48:34.148 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:34.148 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:34.149 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:34.148+0000 7f4f1e077700 1 -- 172.21.15.84:0/3478851224 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4ef803c270 msgr2=0x7f4ef803e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:34.150 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:34.148+0000 7f4f1e077700 1 --2- 172.21.15.84:0/3478851224 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4ef803c270 0x7f4ef803e780 crc :-1 s=READY pgs=195 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:34.150 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:34.148+0000 7f4f1e077700 1 -- 172.21.15.84:0/3478851224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f18133960 msgr2=0x7f4f18122c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:34.150 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:34.148+0000 7f4f1e077700 1 --2- 172.21.15.84:0/3478851224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f18133960 0x7f4f18122c40 secure :-1 s=READY pgs=509 cs=0 l=1 rx=0x7f4f18123e00 tx=0x7f4f1000a550).stop 2020-01-16T05:48:34.150 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:34.148+0000 7f4f1e077700 1 -- 172.21.15.84:0/3478851224 shutdown_connections 2020-01-16T05:48:34.150 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:34.148+0000 7f4f1e077700 1 --2- 172.21.15.84:0/3478851224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f18133960 0x7f4f18122c40 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:34.150 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:34.148+0000 7f4f1e077700 1 --2- 172.21.15.84:0/3478851224 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f4ef803c270 0x7f4ef803e780 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:34.150 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:34.148+0000 7f4f1e077700 1 --2- 172.21.15.84:0/3478851224 >> v2:172.21.15.142:3300/0 conn(0x7f4f18124b30 0x7f4f181368c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:34.151 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:34.152+0000 7f4f1e077700 1 -- 172.21.15.84:0/3478851224 shutdown_connections 2020-01-16T05:48:34.151 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:34.152+0000 7f4f1e077700 1 -- 172.21.15.84:0/3478851224 wait complete. 2020-01-16T05:48:34.151 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:34.152+0000 7f4f1e077700 1 -- 172.21.15.84:0/3478851224 >> 172.21.15.84:0/3478851224 conn(0x7f4f180a8cb0 msgr2=0x7f4f18091120 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:34.151 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:34.160 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:34.269 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~247s 2020-01-16T05:48:36.161 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f1931cd7700 1 Processor -- start 2020-01-16T05:48:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f1931cd7700 1 -- start start 2020-01-16T05:48:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f1931cd7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f192c0a2f60 0x7f192c05b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f1931cd7700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f192c0a8ff0 0x7f192c08fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f1931cd7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192c0902d0 con 0x7f192c07c560 2020-01-16T05:48:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f1931cd7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192c0a3390 con 0x7f192c0a2f60 2020-01-16T05:48:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f1931cd7700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192c0905b0 con 0x7f192c0a8ff0 2020-01-16T05:48:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f192bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f192c0a2f60 0x7f192c05b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f1930a75700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f192c07c560 0x7f192c149000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53788/0 (socket says 172.21.15.84:53788) 2020-01-16T05:48:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f1930a75700 1 -- 172.21.15.84:0/1990824314 learned_addr learned my addr 172.21.15.84:0/1990824314 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f192b7fe700 1 --2- 172.21.15.84:0/1990824314 >> v2:172.21.15.142:3300/0 conn(0x7f192c0a8ff0 0x7f192c08fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f192affd700 1 -- 172.21.15.84:0/1990824314 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111132337 0 0) 0x7f1924001450 con 0x7f192c07c560 2020-01-16T05:48:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f192affd700 1 -- 172.21.15.84:0/1990824314 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1914003230 con 0x7f192c07c560 2020-01-16T05:48:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f192bfff700 1 -- 172.21.15.84:0/1990824314 >> v2:172.21.15.142:3300/0 conn(0x7f192c0a8ff0 msgr2=0x7f192c08fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f192bfff700 1 --2- 172.21.15.84:0/1990824314 >> v2:172.21.15.142:3300/0 conn(0x7f192c0a8ff0 0x7f192c08fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f192bfff700 1 -- 172.21.15.84:0/1990824314 >> v1:172.21.15.84:6789/0 conn(0x7f192c07c560 legacy=0x7f192c149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f192bfff700 1 -- 172.21.15.84:0/1990824314 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c0a9420 con 0x7f192c0a2f60 2020-01-16T05:48:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f192bfff700 1 --2- 172.21.15.84:0/1990824314 >> v2:172.21.15.84:3300/0 conn(0x7f192c0a2f60 0x7f192c05b0f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f192c090770 tx=0x7f191c00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f192bfff700 1 --2- 172.21.15.84:0/1990824314 >> v2:172.21.15.84:3300/0 conn(0x7f192c0a2f60 0x7f192c05b0f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f192c090770 tx=0x7f191c00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f192bfff700 1 --2- 172.21.15.84:0/1990824314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f192c0a2f60 0x7f192c05b0f0 secure :-1 s=READY pgs=511 cs=0 l=1 rx=0x7f192c090770 tx=0x7f191c00fdf0).ready entity=mon.0 client_cookie=de0110a1b7d5290a server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f192bfff700 1 --2- 172.21.15.84:0/1990824314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f192c0a2f60 0x7f192c05b0f0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f192c090770 tx=0x7f191c00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f192affd700 1 -- 172.21.15.84:0/1990824314 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f191c011620 con 0x7f192c0a2f60 2020-01-16T05:48:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f192bfff700 1 --2- 172.21.15.84:0/1990824314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f192c0a2f60 0x7f192c05b0f0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f192c090770 tx=0x7f191c00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f192affd700 1 -- 172.21.15.84:0/1990824314 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c008c50 con 0x7f192c0a2f60 2020-01-16T05:48:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f192bfff700 1 --2- 172.21.15.84:0/1990824314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f192c0a2f60 0x7f192c05b0f0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f192c090770 tx=0x7f191c00fdf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f1931cd7700 1 -- 172.21.15.84:0/1990824314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f192c0a2f60 msgr2=0x7f192c05b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f192affd700 1 -- 172.21.15.84:0/1990824314 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f191c011c00 con 0x7f192c0a2f60 2020-01-16T05:48:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f1931cd7700 1 --2- 172.21.15.84:0/1990824314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f192c0a2f60 0x7f192c05b0f0 secure :-1 s=READY pgs=511 cs=0 l=1 rx=0x7f192c090770 tx=0x7f191c00fdf0).stop 2020-01-16T05:48:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f1931cd7700 1 -- 172.21.15.84:0/1990824314 shutdown_connections 2020-01-16T05:48:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f1931cd7700 1 --2- 172.21.15.84:0/1990824314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f192c0a2f60 0x7f192c05b0f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f1931cd7700 1 --2- 172.21.15.84:0/1990824314 >> v2:172.21.15.142:3300/0 conn(0x7f192c0a8ff0 0x7f192c08fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f1931cd7700 1 -- 172.21.15.84:0/1990824314 shutdown_connections 2020-01-16T05:48:36.287 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f1931cd7700 1 -- 172.21.15.84:0/1990824314 wait complete. 2020-01-16T05:48:36.287 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.280+0000 7f1931cd7700 1 -- 172.21.15.84:0/1990824314 >> 172.21.15.84:0/1990824314 conn(0x7f192c0abc10 msgr2=0x7f192c05a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:36.290 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f1931cd7700 1 Processor -- start 2020-01-16T05:48:36.290 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f1931cd7700 1 -- start start 2020-01-16T05:48:36.290 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f1931cd7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f192c0a4610 0x7f192c09f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:36.290 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f1931cd7700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f192c124f90 0x7f192c0a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:36.290 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f1931cd7700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192c0a54e0 con 0x7f192c0a6340 2020-01-16T05:48:36.290 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f1931cd7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192c07ffe0 con 0x7f192c0a4610 2020-01-16T05:48:36.291 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f1931cd7700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192c09f9e0 con 0x7f192c124f90 2020-01-16T05:48:36.291 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f192bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f192c0a4610 0x7f192c09f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:36.291 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f192bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f192c0a4610 0x7f192c09f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36590/0 (socket says 172.21.15.84:36590) 2020-01-16T05:48:36.291 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f192bfff700 1 -- 172.21.15.84:0/2456663302 learned_addr learned my addr 172.21.15.84:0/2456663302 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f192b7fe700 1 --2- 172.21.15.84:0/2456663302 >> v2:172.21.15.142:3300/0 conn(0x7f192c124f90 0x7f192c0a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f192bfff700 1 -- 172.21.15.84:0/2456663302 >> v2:172.21.15.142:3300/0 conn(0x7f192c124f90 msgr2=0x7f192c0a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f192bfff700 1 --2- 172.21.15.84:0/2456663302 >> v2:172.21.15.142:3300/0 conn(0x7f192c124f90 0x7f192c0a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f192bfff700 1 -- 172.21.15.84:0/2456663302 >> v1:172.21.15.142:6789/0 conn(0x7f192c0a6340 legacy=0x7f192c0a6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f192bfff700 1 -- 172.21.15.84:0/2456663302 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c09e2e0 con 0x7f192c0a4610 2020-01-16T05:48:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f192b7fe700 1 --2- 172.21.15.84:0/2456663302 >> v2:172.21.15.142:3300/0 conn(0x7f192c124f90 0x7f192c0a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:48:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f192bfff700 1 --2- 172.21.15.84:0/2456663302 >> v2:172.21.15.84:3300/0 conn(0x7f192c0a4610 0x7f192c09f340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f192c090770 tx=0x7f191c008f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f192bfff700 1 --2- 172.21.15.84:0/2456663302 >> v2:172.21.15.84:3300/0 conn(0x7f192c0a4610 0x7f192c09f340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f192c090770 tx=0x7f191c008f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f192bfff700 1 --2- 172.21.15.84:0/2456663302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f192c0a4610 0x7f192c09f340 secure :-1 s=READY pgs=512 cs=0 l=1 rx=0x7f192c090770 tx=0x7f191c008f80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f192bfff700 1 --2- 172.21.15.84:0/2456663302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f192c0a4610 0x7f192c09f340 secure :-1 s=THROTTLE_DONE pgs=512 cs=0 l=1 rx=0x7f192c090770 tx=0x7f191c008f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f1928ff9700 1 -- 172.21.15.84:0/2456663302 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f191c007340 con 0x7f192c0a4610 2020-01-16T05:48:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f192bfff700 1 --2- 172.21.15.84:0/2456663302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f192c0a4610 0x7f192c09f340 secure :-1 s=THROTTLE_DONE pgs=512 cs=0 l=1 rx=0x7f192c090770 tx=0x7f191c008f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f192bfff700 1 --2- 172.21.15.84:0/2456663302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f192c0a4610 0x7f192c09f340 secure :-1 s=THROTTLE_DONE pgs=512 cs=0 l=1 rx=0x7f192c090770 tx=0x7f191c008f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f1928ff9700 1 -- 172.21.15.84:0/2456663302 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c011820 con 0x7f192c0a4610 2020-01-16T05:48:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.284+0000 7f1931cd7700 1 -- 172.21.15.84:0/2456663302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192c149b50 con 0x7f192c0a4610 2020-01-16T05:48:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.288+0000 7f1928ff9700 1 -- 172.21.15.84:0/2456663302 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f191c00f740 con 0x7f192c0a4610 2020-01-16T05:48:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.288+0000 7f1931cd7700 1 -- 172.21.15.84:0/2456663302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192c1253c0 con 0x7f192c0a4610 2020-01-16T05:48:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.288+0000 7f192bfff700 1 --2- 172.21.15.84:0/2456663302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f192c0a4610 0x7f192c09f340 secure :-1 s=THROTTLE_DONE pgs=512 cs=0 l=1 rx=0x7f192c090770 tx=0x7f191c008f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.288+0000 7f192bfff700 1 --2- 172.21.15.84:0/2456663302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f192c0a4610 0x7f192c09f340 secure :-1 s=THROTTLE_DONE pgs=512 cs=0 l=1 rx=0x7f192c090770 tx=0x7f191c008f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.288+0000 7f1928ff9700 1 -- 172.21.15.84:0/2456663302 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f191c0056c0 con 0x7f192c0a4610 2020-01-16T05:48:36.295 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.288+0000 7f1931cd7700 1 -- 172.21.15.84:0/2456663302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192c05e1c0 con 0x7f192c0a4610 2020-01-16T05:48:36.295 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.288+0000 7f1928ff9700 1 --2- 172.21.15.84:0/2456663302 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f190c03c290 0x7f190c03e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:36.295 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.288+0000 7f1928ff9700 1 -- 172.21.15.84:0/2456663302 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f191c04cff0 con 0x7f192c0a4610 2020-01-16T05:48:36.295 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.288+0000 7f192b7fe700 1 --2- 172.21.15.84:0/2456663302 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f190c03c290 0x7f190c03e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:36.295 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.288+0000 7f192b7fe700 1 --2- 172.21.15.84:0/2456663302 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f190c03c290 0x7f190c03e7a0 crc :-1 s=READY pgs=196 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:36.296 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.296+0000 7f192bfff700 1 --2- 172.21.15.84:0/2456663302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f192c0a4610 0x7f192c09f340 secure :-1 s=THROTTLE_DONE pgs=512 cs=0 l=1 rx=0x7f192c090770 tx=0x7f191c008f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:36.296 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.296+0000 7f1928ff9700 1 -- 172.21.15.84:0/2456663302 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f191c0335d0 con 0x7f192c0a4610 2020-01-16T05:48:36.448 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.448+0000 7f1931cd7700 1 -- 172.21.15.84:0/2456663302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f192c0a4ce0 con 0x7f192c0a4610 2020-01-16T05:48:36.449 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.452+0000 7f192bfff700 1 --2- 172.21.15.84:0/2456663302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f192c0a4610 0x7f192c09f340 secure :-1 s=THROTTLE_DONE pgs=512 cs=0 l=1 rx=0x7f192c090770 tx=0x7f191c008f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:36.449 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.452+0000 7f1928ff9700 1 -- 172.21.15.84:0/2456663302 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f191c04fb40 con 0x7f192c0a4610 2020-01-16T05:48:36.450 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:36.450 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.452+0000 7f1931cd7700 1 -- 172.21.15.84:0/2456663302 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f190c03c290 msgr2=0x7f190c03e7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.452+0000 7f1931cd7700 1 --2- 172.21.15.84:0/2456663302 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f190c03c290 0x7f190c03e7a0 crc :-1 s=READY pgs=196 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.452+0000 7f1931cd7700 1 -- 172.21.15.84:0/2456663302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f192c0a4610 msgr2=0x7f192c09f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.452+0000 7f1931cd7700 1 --2- 172.21.15.84:0/2456663302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f192c0a4610 0x7f192c09f340 secure :-1 s=READY pgs=512 cs=0 l=1 rx=0x7f192c090770 tx=0x7f191c008f80).stop 2020-01-16T05:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.452+0000 7f1931cd7700 1 -- 172.21.15.84:0/2456663302 shutdown_connections 2020-01-16T05:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.452+0000 7f1931cd7700 1 --2- 172.21.15.84:0/2456663302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f192c0a4610 0x7f192c09f340 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.452+0000 7f1931cd7700 1 --2- 172.21.15.84:0/2456663302 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f190c03c290 0x7f190c03e7a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.452+0000 7f1931cd7700 1 --2- 172.21.15.84:0/2456663302 >> v2:172.21.15.142:3300/0 conn(0x7f192c124f90 0x7f192c0a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.452+0000 7f1931cd7700 1 -- 172.21.15.84:0/2456663302 shutdown_connections 2020-01-16T05:48:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.452+0000 7f1931cd7700 1 -- 172.21.15.84:0/2456663302 wait complete. 2020-01-16T05:48:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:36.452+0000 7f1931cd7700 1 -- 172.21.15.84:0/2456663302 >> 172.21.15.84:0/2456663302 conn(0x7f192c0a58a0 msgr2=0x7f192c07b540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:36.463 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:38.464 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:38.589 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.584+0000 7f696ffff700 1 Processor -- start 2020-01-16T05:48:38.590 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.584+0000 7f696ffff700 1 -- start start 2020-01-16T05:48:38.590 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.584+0000 7f696ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69700a9b30 0x7f69700abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:38.590 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f697007ff10 0x7f6970066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:38.590 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696ffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6970066dd0 con 0x7f69700a4250 2020-01-16T05:48:38.591 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696ffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69700a4830 con 0x7f697007ff10 2020-01-16T05:48:38.591 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696ffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697007f9d0 con 0x7f69700a9b30 2020-01-16T05:48:38.591 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f697007ff10 0x7f6970066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:38.591 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f697007ff10 0x7f6970066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36600/0 (socket says 172.21.15.84:36600) 2020-01-16T05:48:38.591 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696effd700 1 -- 172.21.15.84:0/992313149 learned_addr learned my addr 172.21.15.84:0/992313149 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:38.592 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f6975a38700 1 --1- 172.21.15.84:0/992313149 >> v1:172.21.15.84:6789/0 conn(0x7f69700a4250 0x7f69700a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53804/0 (socket says 172.21.15.84:53804) 2020-01-16T05:48:38.592 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696f7fe700 1 --2- 172.21.15.84:0/992313149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69700a9b30 0x7f69700abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:38.592 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696effd700 1 -- 172.21.15.84:0/992313149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69700a9b30 msgr2=0x7f69700abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:38.592 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696effd700 1 --2- 172.21.15.84:0/992313149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69700a9b30 0x7f69700abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:38.592 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696effd700 1 -- 172.21.15.84:0/992313149 >> v1:172.21.15.84:6789/0 conn(0x7f69700a4250 legacy=0x7f69700a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:38.592 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696effd700 1 -- 172.21.15.84:0/992313149 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6970150ce0 con 0x7f697007ff10 2020-01-16T05:48:38.593 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696f7fe700 1 --2- 172.21.15.84:0/992313149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69700a9b30 0x7f69700abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-01-16T05:48:38.593 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696effd700 1 --2- 172.21.15.84:0/992313149 >> v2:172.21.15.84:3300/0 conn(0x7f697007ff10 0x7f6970066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6958008910 tx=0x7f695800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:38.593 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696effd700 1 --2- 172.21.15.84:0/992313149 >> v2:172.21.15.84:3300/0 conn(0x7f697007ff10 0x7f6970066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6958008910 tx=0x7f695800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:38.593 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696effd700 1 --2- 172.21.15.84:0/992313149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f697007ff10 0x7f6970066880 secure :-1 s=READY pgs=514 cs=0 l=1 rx=0x7f6958008910 tx=0x7f695800feb0).ready entity=mon.0 client_cookie=3caa90f8d17e1481 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:38.593 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696effd700 1 --2- 172.21.15.84:0/992313149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f697007ff10 0x7f6970066880 secure :-1 s=THROTTLE_DONE pgs=514 cs=0 l=1 rx=0x7f6958008910 tx=0x7f695800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:38.594 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696e7fc700 1 -- 172.21.15.84:0/992313149 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6958011720 con 0x7f697007ff10 2020-01-16T05:48:38.594 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696effd700 1 --2- 172.21.15.84:0/992313149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f697007ff10 0x7f6970066880 secure :-1 s=THROTTLE_DONE pgs=514 cs=0 l=1 rx=0x7f6958008910 tx=0x7f695800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:38.594 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696effd700 1 --2- 172.21.15.84:0/992313149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f697007ff10 0x7f6970066880 secure :-1 s=THROTTLE_DONE pgs=514 cs=0 l=1 rx=0x7f6958008910 tx=0x7f695800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:38.594 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696e7fc700 1 -- 172.21.15.84:0/992313149 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6958008d30 con 0x7f697007ff10 2020-01-16T05:48:38.594 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696e7fc700 1 -- 172.21.15.84:0/992313149 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6958011d00 con 0x7f697007ff10 2020-01-16T05:48:38.595 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696ffff700 1 -- 172.21.15.84:0/992313149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f697007ff10 msgr2=0x7f6970066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:38.595 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696ffff700 1 --2- 172.21.15.84:0/992313149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f697007ff10 0x7f6970066880 secure :-1 s=READY pgs=514 cs=0 l=1 rx=0x7f6958008910 tx=0x7f695800feb0).stop 2020-01-16T05:48:38.595 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696ffff700 1 -- 172.21.15.84:0/992313149 shutdown_connections 2020-01-16T05:48:38.595 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696ffff700 1 --2- 172.21.15.84:0/992313149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69700a9b30 0x7f69700abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:38.595 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696ffff700 1 --2- 172.21.15.84:0/992313149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f697007ff10 0x7f6970066880 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:38.595 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696ffff700 1 -- 172.21.15.84:0/992313149 shutdown_connections 2020-01-16T05:48:38.596 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696ffff700 1 -- 172.21.15.84:0/992313149 wait complete. 2020-01-16T05:48:38.596 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.588+0000 7f696ffff700 1 -- 172.21.15.84:0/992313149 >> 172.21.15.84:0/992313149 conn(0x7f69700acfc0 msgr2=0x7f69700a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:38.599 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.592+0000 7f696ffff700 1 Processor -- start 2020-01-16T05:48:38.599 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.592+0000 7f696ffff700 1 -- start start 2020-01-16T05:48:38.600 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.592+0000 7f696ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69700913e0 0x7f6970134d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:38.600 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.592+0000 7f696ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f697009f7c0 0x7f697013c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:38.600 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.592+0000 7f696ffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6970061650 con 0x7f6970135290 2020-01-16T05:48:38.601 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.592+0000 7f696ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69700ab090 con 0x7f697009f7c0 2020-01-16T05:48:38.601 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.592+0000 7f696ffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69701356c0 con 0x7f69700913e0 2020-01-16T05:48:38.601 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.592+0000 7f696f7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69700913e0 0x7f6970134d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:38.601 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.592+0000 7f6975a38700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f697009f7c0 0x7f697013c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:38.601 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.592+0000 7f696f7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69700913e0 0x7f6970134d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:48852/0 (socket says 172.21.15.84:48852) 2020-01-16T05:48:38.602 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.592+0000 7f696effd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f6970135290 0x7f697009efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:52032/0 (socket says 172.21.15.84:52032) 2020-01-16T05:48:38.602 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.592+0000 7f696f7fe700 1 -- 172.21.15.84:0/241505570 learned_addr learned my addr 172.21.15.84:0/241505570 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:38.602 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.592+0000 7f6975a38700 1 -- 172.21.15.84:0/241505570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69700913e0 msgr2=0x7f6970134d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:38.602 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.592+0000 7f6975a38700 1 --2- 172.21.15.84:0/241505570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69700913e0 0x7f6970134d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:38.602 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.592+0000 7f6975a38700 1 -- 172.21.15.84:0/241505570 >> v1:172.21.15.142:6789/0 conn(0x7f6970135290 legacy=0x7f697009efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:38.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.592+0000 7f6975a38700 1 -- 172.21.15.84:0/241505570 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69700a32d0 con 0x7f697009f7c0 2020-01-16T05:48:38.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.592+0000 7f696f7fe700 1 --2- 172.21.15.84:0/241505570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69700913e0 0x7f6970134d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:48:38.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.592+0000 7f6975a38700 1 --2- 172.21.15.84:0/241505570 >> v2:172.21.15.142:3300/0 conn(0x7f697009f7c0 0x7f697013c190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f69700ad3b0 tx=0x7f6968010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:38.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.596+0000 7f6975a38700 1 --2- 172.21.15.84:0/241505570 >> v2:172.21.15.142:3300/0 conn(0x7f697009f7c0 0x7f697013c190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f69700ad3b0 tx=0x7f6968010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:38.603 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.596+0000 7f6975a38700 1 --2- 172.21.15.84:0/241505570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f697009f7c0 0x7f697013c190 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7f69700ad3b0 tx=0x7f6968010950).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:38.604 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.596+0000 7f6975a38700 1 --2- 172.21.15.84:0/241505570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f697009f7c0 0x7f697013c190 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f69700ad3b0 tx=0x7f6968010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:38.604 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.596+0000 7f6967fff700 1 -- 172.21.15.84:0/241505570 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6968011640 con 0x7f697009f7c0 2020-01-16T05:48:38.604 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.596+0000 7f6975a38700 1 --2- 172.21.15.84:0/241505570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f697009f7c0 0x7f697013c190 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f69700ad3b0 tx=0x7f6968010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:38.604 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.596+0000 7f6975a38700 1 --2- 172.21.15.84:0/241505570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f697009f7c0 0x7f697013c190 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f69700ad3b0 tx=0x7f6968010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:38.604 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.596+0000 7f6967fff700 1 -- 172.21.15.84:0/241505570 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6968011260 con 0x7f697009f7c0 2020-01-16T05:48:38.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.596+0000 7f696ffff700 1 -- 172.21.15.84:0/241505570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697013c6e0 con 0x7f697009f7c0 2020-01-16T05:48:38.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.596+0000 7f6967fff700 1 -- 172.21.15.84:0/241505570 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6968011c20 con 0x7f697009f7c0 2020-01-16T05:48:38.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.596+0000 7f696ffff700 1 -- 172.21.15.84:0/241505570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697013cc90 con 0x7f697009f7c0 2020-01-16T05:48:38.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.596+0000 7f6975a38700 1 --2- 172.21.15.84:0/241505570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f697009f7c0 0x7f697013c190 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f69700ad3b0 tx=0x7f6968010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:38.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.596+0000 7f6967fff700 1 -- 172.21.15.84:0/241505570 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f696800b330 con 0x7f697009f7c0 2020-01-16T05:48:38.605 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.596+0000 7f6975a38700 1 --2- 172.21.15.84:0/241505570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f697009f7c0 0x7f697013c190 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f69700ad3b0 tx=0x7f6968010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:38.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.596+0000 7f696ffff700 1 -- 172.21.15.84:0/241505570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6970091d10 con 0x7f697009f7c0 2020-01-16T05:48:38.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.596+0000 7f6967fff700 1 --2- 172.21.15.84:0/241505570 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f695403c270 0x7f695403e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:38.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.596+0000 7f6967fff700 1 -- 172.21.15.84:0/241505570 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f696804ca60 con 0x7f697009f7c0 2020-01-16T05:48:38.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.596+0000 7f696f7fe700 1 --2- 172.21.15.84:0/241505570 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f695403c270 0x7f695403e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:38.606 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.596+0000 7f696f7fe700 1 --2- 172.21.15.84:0/241505570 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f695403c270 0x7f695403e780 crc :-1 s=READY pgs=197 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:38.607 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.604+0000 7f6975a38700 1 --2- 172.21.15.84:0/241505570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f697009f7c0 0x7f697013c190 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f69700ad3b0 tx=0x7f6968010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:38.607 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.604+0000 7f6967fff700 1 -- 172.21.15.84:0/241505570 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f6968033060 con 0x7f697009f7c0 2020-01-16T05:48:38.759 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.760+0000 7f696ffff700 1 -- 172.21.15.84:0/241505570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f697005e1c0 con 0x7f697009f7c0 2020-01-16T05:48:38.760 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.760+0000 7f6975a38700 1 --2- 172.21.15.84:0/241505570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f697009f7c0 0x7f697013c190 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f69700ad3b0 tx=0x7f6968010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:38.761 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.760+0000 7f6967fff700 1 -- 172.21.15.84:0/241505570 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f69680332c0 con 0x7f697009f7c0 2020-01-16T05:48:38.761 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:38.761 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:38.762 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.764+0000 7f696ffff700 1 -- 172.21.15.84:0/241505570 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f695403c270 msgr2=0x7f695403e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:38.762 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.764+0000 7f696ffff700 1 --2- 172.21.15.84:0/241505570 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f695403c270 0x7f695403e780 crc :-1 s=READY pgs=197 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:38.763 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.764+0000 7f696ffff700 1 -- 172.21.15.84:0/241505570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f697009f7c0 msgr2=0x7f697013c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:38.763 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.764+0000 7f696ffff700 1 --2- 172.21.15.84:0/241505570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f697009f7c0 0x7f697013c190 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7f69700ad3b0 tx=0x7f6968010950).stop 2020-01-16T05:48:38.763 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.764+0000 7f696ffff700 1 -- 172.21.15.84:0/241505570 shutdown_connections 2020-01-16T05:48:38.763 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.764+0000 7f696ffff700 1 --2- 172.21.15.84:0/241505570 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f695403c270 0x7f695403e780 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:38.763 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.764+0000 7f696ffff700 1 --2- 172.21.15.84:0/241505570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f697009f7c0 0x7f697013c190 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:38.763 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.764+0000 7f696ffff700 1 --2- 172.21.15.84:0/241505570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69700913e0 0x7f6970134d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:38.763 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.764+0000 7f696ffff700 1 -- 172.21.15.84:0/241505570 shutdown_connections 2020-01-16T05:48:38.764 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.764+0000 7f696ffff700 1 -- 172.21.15.84:0/241505570 wait complete. 2020-01-16T05:48:38.764 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:38.764+0000 7f696ffff700 1 -- 172.21.15.84:0/241505570 >> 172.21.15.84:0/241505570 conn(0x7f69700a9270 msgr2=0x7f69700246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:38.764 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:38.775 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:40.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~253s 2020-01-16T05:48:40.775 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:40.899 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeabfff700 1 Processor -- start 2020-01-16T05:48:40.900 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeabfff700 1 -- start start 2020-01-16T05:48:40.900 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeabfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feeac0a4250 0x7feeac0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:40.900 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeabfff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeac066880 con 0x7feeac07ff10 2020-01-16T05:48:40.900 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeabfff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeac066ab0 con 0x7feeac0a9b30 2020-01-16T05:48:40.900 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeabfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac0a4830 con 0x7feeac0a4250 2020-01-16T05:48:40.901 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeaaffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7feeac07ff10 0x7feeac14dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53814/0 (socket says 172.21.15.84:53814) 2020-01-16T05:48:40.901 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeaaffd700 1 -- 172.21.15.84:0/2446666654 learned_addr learned my addr 172.21.15.84:0/2446666654 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:40.901 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeb17d4700 1 --2- 172.21.15.84:0/2446666654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feeac0a4250 0x7feeac0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:40.902 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeaa7fc700 1 -- 172.21.15.84:0/2446666654 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762602985 0 0) 0x7feeac066880 con 0x7feeac07ff10 2020-01-16T05:48:40.902 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeaa7fc700 1 -- 172.21.15.84:0/2446666654 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee94003230 con 0x7feeac07ff10 2020-01-16T05:48:40.902 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeaa7fc700 1 -- 172.21.15.84:0/2446666654 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363051878 0 0) 0x7feeac066ab0 con 0x7feeac0a9b30 2020-01-16T05:48:40.902 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeaa7fc700 1 -- 172.21.15.84:0/2446666654 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeac066880 con 0x7feeac0a9b30 2020-01-16T05:48:40.902 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeaa7fc700 1 -- 172.21.15.84:0/2446666654 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2657475185 0 0) 0x7fee94003230 con 0x7feeac07ff10 2020-01-16T05:48:40.903 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeb17d4700 1 -- 172.21.15.84:0/2446666654 >> v1:172.21.15.142:6789/0 conn(0x7feeac0a9b30 legacy=0x7feeac0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:40.903 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeb17d4700 1 -- 172.21.15.84:0/2446666654 >> v1:172.21.15.84:6789/0 conn(0x7feeac07ff10 legacy=0x7feeac14dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:40.903 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeb17d4700 1 -- 172.21.15.84:0/2446666654 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac066ce0 con 0x7feeac0a4250 2020-01-16T05:48:40.903 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeb17d4700 1 --2- 172.21.15.84:0/2446666654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feeac0a4250 0x7feeac0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feea0001520 tx=0x7feea0001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:40.903 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeb17d4700 1 --2- 172.21.15.84:0/2446666654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feeac0a4250 0x7feeac0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feea0001520 tx=0x7feea0001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:40.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeb17d4700 1 --2- 172.21.15.84:0/2446666654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feeac0a4250 0x7feeac0abdd0 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7feea0001520 tx=0x7feea0001950).ready entity=mon.2 client_cookie=3befb2c67bc601a8 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:40.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeb17d4700 1 --2- 172.21.15.84:0/2446666654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feeac0a4250 0x7feeac0abdd0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7feea0001520 tx=0x7feea0001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:40.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeaa7fc700 1 -- 172.21.15.84:0/2446666654 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feea0001750 con 0x7feeac0a4250 2020-01-16T05:48:40.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeb17d4700 1 --2- 172.21.15.84:0/2446666654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feeac0a4250 0x7feeac0abdd0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7feea0001520 tx=0x7feea0001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:40.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeaa7fc700 1 -- 172.21.15.84:0/2446666654 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea0001560 con 0x7feeac0a4250 2020-01-16T05:48:40.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeb17d4700 1 --2- 172.21.15.84:0/2446666654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feeac0a4250 0x7feeac0abdd0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7feea0001520 tx=0x7feea0001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:40.904 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeaa7fc700 1 -- 172.21.15.84:0/2446666654 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feea400a350 con 0x7feeac0a4250 2020-01-16T05:48:40.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeabfff700 1 -- 172.21.15.84:0/2446666654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feeac0a4250 msgr2=0x7feeac0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:40.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.896+0000 7feeabfff700 1 --2- 172.21.15.84:0/2446666654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feeac0a4250 0x7feeac0abdd0 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7feea0001520 tx=0x7feea0001950).stop 2020-01-16T05:48:40.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.900+0000 7feeabfff700 1 -- 172.21.15.84:0/2446666654 shutdown_connections 2020-01-16T05:48:40.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.900+0000 7feeabfff700 1 --2- 172.21.15.84:0/2446666654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feeac0a4250 0x7feeac0abdd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:40.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.900+0000 7feeabfff700 1 -- 172.21.15.84:0/2446666654 shutdown_connections 2020-01-16T05:48:40.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.900+0000 7feeabfff700 1 -- 172.21.15.84:0/2446666654 wait complete. 2020-01-16T05:48:40.905 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.900+0000 7feeabfff700 1 -- 172.21.15.84:0/2446666654 >> 172.21.15.84:0/2446666654 conn(0x7feeac0acfc0 msgr2=0x7feeac0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:40.908 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.900+0000 7feeabfff700 1 Processor -- start 2020-01-16T05:48:40.908 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.900+0000 7feeabfff700 1 -- start start 2020-01-16T05:48:40.909 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeabfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feeac1256f0 0x7feeac126860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:40.909 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeabfff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeac126db0 con 0x7feeac05bef0 2020-01-16T05:48:40.909 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeabfff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeac09fbd0 con 0x7feeac08ef10 2020-01-16T05:48:40.909 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeabfff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeac1251b0 con 0x7feeac1256f0 2020-01-16T05:48:40.909 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeb17d4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feeac1256f0 0x7feeac126860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:40.909 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeb17d4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feeac1256f0 0x7feeac126860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36624/0 (socket says 172.21.15.84:36624) 2020-01-16T05:48:40.910 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeaaffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7feeac05bef0 0x7feeac09f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53822/0 (socket says 172.21.15.84:53822) 2020-01-16T05:48:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeb17d4700 1 -- 172.21.15.84:0/140518550 learned_addr learned my addr 172.21.15.84:0/140518550 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeb17d4700 1 -- 172.21.15.84:0/140518550 >> v1:172.21.15.142:6789/0 conn(0x7feeac08ef10 legacy=0x7feeac1361a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeb17d4700 1 -- 172.21.15.84:0/140518550 >> v1:172.21.15.84:6789/0 conn(0x7feeac05bef0 legacy=0x7feeac09f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeb17d4700 1 -- 172.21.15.84:0/140518550 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac1405c0 con 0x7feeac1256f0 2020-01-16T05:48:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7fee93fff700 1 -- 172.21.15.84:0/140518550 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496837149 0 0) 0x7feea0001230 con 0x7feeac05bef0 2020-01-16T05:48:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeb17d4700 1 --2- 172.21.15.84:0/140518550 >> v2:172.21.15.84:3300/0 conn(0x7feeac1256f0 0x7feeac126860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feea0001520 tx=0x7feea4008bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeb17d4700 1 --2- 172.21.15.84:0/140518550 >> v2:172.21.15.84:3300/0 conn(0x7feeac1256f0 0x7feeac126860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feea0001520 tx=0x7feea4008bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:40.913 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeb17d4700 1 --2- 172.21.15.84:0/140518550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeac1256f0 0x7feeac126860 secure :-1 s=READY pgs=517 cs=0 l=1 rx=0x7feea0001520 tx=0x7feea4008bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:40.913 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeb17d4700 1 --2- 172.21.15.84:0/140518550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeac1256f0 0x7feeac126860 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7feea0001520 tx=0x7feea4008bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:40.913 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7fee93fff700 1 -- 172.21.15.84:0/140518550 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feea400ac40 con 0x7feeac1256f0 2020-01-16T05:48:40.913 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeb17d4700 1 --2- 172.21.15.84:0/140518550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeac1256f0 0x7feeac126860 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7feea0001520 tx=0x7feea4008bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeb17d4700 1 --2- 172.21.15.84:0/140518550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeac1256f0 0x7feeac126860 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7feea0001520 tx=0x7feea4008bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7fee93fff700 1 -- 172.21.15.84:0/140518550 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea4011c50 con 0x7feeac1256f0 2020-01-16T05:48:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7fee93fff700 1 -- 172.21.15.84:0/140518550 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feea4007150 con 0x7feeac1256f0 2020-01-16T05:48:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeabfff700 1 -- 172.21.15.84:0/140518550 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeac13e5a0 con 0x7feeac1256f0 2020-01-16T05:48:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeabfff700 1 -- 172.21.15.84:0/140518550 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeac13eb50 con 0x7feeac1256f0 2020-01-16T05:48:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeb17d4700 1 --2- 172.21.15.84:0/140518550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeac1256f0 0x7feeac126860 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7feea0001520 tx=0x7feea4008bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeabfff700 1 -- 172.21.15.84:0/140518550 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeac05e1c0 con 0x7feeac1256f0 2020-01-16T05:48:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7fee93fff700 1 -- 172.21.15.84:0/140518550 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7feea4007420 con 0x7feeac1256f0 2020-01-16T05:48:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.904+0000 7feeb17d4700 1 --2- 172.21.15.84:0/140518550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeac1256f0 0x7feeac126860 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7feea0001520 tx=0x7feea4008bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.908+0000 7fee93fff700 1 --2- 172.21.15.84:0/140518550 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fee8c03c190 0x7fee8c03e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.908+0000 7fee93fff700 1 -- 172.21.15.84:0/140518550 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7feea4091240 con 0x7feeac1256f0 2020-01-16T05:48:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.908+0000 7feeab7fe700 1 --2- 172.21.15.84:0/140518550 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fee8c03c190 0x7fee8c03e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.908+0000 7feeab7fe700 1 --2- 172.21.15.84:0/140518550 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fee8c03c190 0x7fee8c03e6a0 crc :-1 s=READY pgs=198 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.912+0000 7feeb17d4700 1 --2- 172.21.15.84:0/140518550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeac1256f0 0x7feeac126860 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7feea0001520 tx=0x7feea4008bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:40.912+0000 7fee93fff700 1 -- 172.21.15.84:0/140518550 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7feea4077860 con 0x7feeac1256f0 2020-01-16T05:48:41.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:41.064+0000 7feeabfff700 1 -- 172.21.15.84:0/140518550 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feeac0ad1d0 con 0x7feeac1256f0 2020-01-16T05:48:41.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:41.064+0000 7feeb17d4700 1 --2- 172.21.15.84:0/140518550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeac1256f0 0x7feeac126860 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7feea0001520 tx=0x7feea4008bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:41.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:41.064+0000 7fee93fff700 1 -- 172.21.15.84:0/140518550 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7feea4077ac0 con 0x7feeac1256f0 2020-01-16T05:48:41.065 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:41.065 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:41.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:41.068+0000 7feeabfff700 1 -- 172.21.15.84:0/140518550 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fee8c03c190 msgr2=0x7fee8c03e6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:41.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:41.068+0000 7feeabfff700 1 --2- 172.21.15.84:0/140518550 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fee8c03c190 0x7fee8c03e6a0 crc :-1 s=READY pgs=198 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:41.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:41.068+0000 7feeabfff700 1 -- 172.21.15.84:0/140518550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeac1256f0 msgr2=0x7feeac126860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:41.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:41.068+0000 7feeabfff700 1 --2- 172.21.15.84:0/140518550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeac1256f0 0x7feeac126860 secure :-1 s=READY pgs=517 cs=0 l=1 rx=0x7feea0001520 tx=0x7feea4008bc0).stop 2020-01-16T05:48:41.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:41.068+0000 7feeabfff700 1 -- 172.21.15.84:0/140518550 shutdown_connections 2020-01-16T05:48:41.068 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:41.068+0000 7feeabfff700 1 --2- 172.21.15.84:0/140518550 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fee8c03c190 0x7fee8c03e6a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:41.068 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:41.068+0000 7feeabfff700 1 --2- 172.21.15.84:0/140518550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeac1256f0 0x7feeac126860 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:41.068 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:41.068+0000 7feeabfff700 1 -- 172.21.15.84:0/140518550 shutdown_connections 2020-01-16T05:48:41.068 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:41.068+0000 7feeabfff700 1 -- 172.21.15.84:0/140518550 wait complete. 2020-01-16T05:48:41.068 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:41.068+0000 7feeabfff700 1 -- 172.21.15.84:0/140518550 >> 172.21.15.84:0/140518550 conn(0x7feeac0a9b30 msgr2=0x7feeac07ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:41.068 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:41.078 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:43.079 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:43.205 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.200+0000 7f69c39be700 1 Processor -- start 2020-01-16T05:48:43.205 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.200+0000 7f69c39be700 1 -- start start 2020-01-16T05:48:43.205 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c39be700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f69bc05b0f0 0x7f69bc0a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:43.205 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c39be700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69bc08fd80 0x7f69bc1503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:43.206 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c39be700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69bc07cd60 con 0x7f69bc0a2f60 2020-01-16T05:48:43.206 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c39be700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69bc0a3390 con 0x7f69bc05b0f0 2020-01-16T05:48:43.206 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c39be700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc0905b0 con 0x7f69bc08fd80 2020-01-16T05:48:43.206 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c175a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f69bc05b0f0 0x7f69bc0a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:43.206 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c175a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f69bc05b0f0 0x7f69bc0a8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36630/0 (socket says 172.21.15.84:36630) 2020-01-16T05:48:43.206 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c175a700 1 -- 172.21.15.84:0/544110425 learned_addr learned my addr 172.21.15.84:0/544110425 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:43.206 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c275c700 1 --2- 172.21.15.84:0/544110425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69bc08fd80 0x7f69bc1503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:43.207 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c0f59700 1 -- 172.21.15.84:0/544110425 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199026554 0 0) 0x7f69bc07cd60 con 0x7f69bc0a2f60 2020-01-16T05:48:43.207 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c175a700 1 -- 172.21.15.84:0/544110425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69bc08fd80 msgr2=0x7f69bc1503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:43.207 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c175a700 1 --2- 172.21.15.84:0/544110425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69bc08fd80 0x7f69bc1503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:43.207 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c175a700 1 -- 172.21.15.84:0/544110425 >> v1:172.21.15.142:6789/0 conn(0x7f69bc0a2f60 legacy=0x7f69bc07c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:43.207 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c175a700 1 -- 172.21.15.84:0/544110425 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc05b520 con 0x7f69bc05b0f0 2020-01-16T05:48:43.207 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c175a700 1 --2- 172.21.15.84:0/544110425 >> v2:172.21.15.84:3300/0 conn(0x7f69bc05b0f0 0x7f69bc0a8ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f69bc090770 tx=0x7f69b000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:43.207 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c175a700 1 --2- 172.21.15.84:0/544110425 >> v2:172.21.15.84:3300/0 conn(0x7f69bc05b0f0 0x7f69bc0a8ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f69bc090770 tx=0x7f69b000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:43.208 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c175a700 1 --2- 172.21.15.84:0/544110425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69bc05b0f0 0x7f69bc0a8ff0 secure :-1 s=READY pgs=518 cs=0 l=1 rx=0x7f69bc090770 tx=0x7f69b000feb0).ready entity=mon.0 client_cookie=2dd97e150c63e366 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:43.208 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c175a700 1 --2- 172.21.15.84:0/544110425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69bc05b0f0 0x7f69bc0a8ff0 secure :-1 s=THROTTLE_DONE pgs=518 cs=0 l=1 rx=0x7f69bc090770 tx=0x7f69b000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:43.208 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c0f59700 1 -- 172.21.15.84:0/544110425 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69b0011720 con 0x7f69bc05b0f0 2020-01-16T05:48:43.208 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c175a700 1 --2- 172.21.15.84:0/544110425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69bc05b0f0 0x7f69bc0a8ff0 secure :-1 s=THROTTLE_DONE pgs=518 cs=0 l=1 rx=0x7f69bc090770 tx=0x7f69b000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:43.208 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c175a700 1 --2- 172.21.15.84:0/544110425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69bc05b0f0 0x7f69bc0a8ff0 secure :-1 s=THROTTLE_DONE pgs=518 cs=0 l=1 rx=0x7f69bc090770 tx=0x7f69b000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:43.208 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c0f59700 1 -- 172.21.15.84:0/544110425 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b0008d30 con 0x7f69bc05b0f0 2020-01-16T05:48:43.208 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c0f59700 1 -- 172.21.15.84:0/544110425 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69b0011d00 con 0x7f69bc05b0f0 2020-01-16T05:48:43.209 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c39be700 1 -- 172.21.15.84:0/544110425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69bc05b0f0 msgr2=0x7f69bc0a8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:43.209 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c39be700 1 --2- 172.21.15.84:0/544110425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69bc05b0f0 0x7f69bc0a8ff0 secure :-1 s=READY pgs=518 cs=0 l=1 rx=0x7f69bc090770 tx=0x7f69b000feb0).stop 2020-01-16T05:48:43.209 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c39be700 1 -- 172.21.15.84:0/544110425 shutdown_connections 2020-01-16T05:48:43.209 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c39be700 1 --2- 172.21.15.84:0/544110425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69bc08fd80 0x7f69bc1503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:43.209 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c39be700 1 --2- 172.21.15.84:0/544110425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69bc05b0f0 0x7f69bc0a8ff0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:43.209 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c39be700 1 -- 172.21.15.84:0/544110425 shutdown_connections 2020-01-16T05:48:43.209 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c39be700 1 -- 172.21.15.84:0/544110425 wait complete. 2020-01-16T05:48:43.209 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.204+0000 7f69c39be700 1 -- 172.21.15.84:0/544110425 >> 172.21.15.84:0/544110425 conn(0x7f69bc0abc10 msgr2=0x7f69bc05a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:43.212 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c39be700 1 Processor -- start 2020-01-16T05:48:43.212 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c39be700 1 -- start start 2020-01-16T05:48:43.212 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c39be700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f69bc07fe50 0x7f69bc07e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:43.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c39be700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69bc09bf60 0x7f69bc07ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:43.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c39be700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69bc07f160 con 0x7f69bc07d490 2020-01-16T05:48:43.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c39be700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69bc07da40 con 0x7f69bc07fe50 2020-01-16T05:48:43.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c39be700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc07dce0 con 0x7f69bc09bf60 2020-01-16T05:48:43.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c275c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f69bc07d490 0x7f69bc0a5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53836/0 (socket says 172.21.15.84:53836) 2020-01-16T05:48:43.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c275c700 1 -- 172.21.15.84:0/1508745156 learned_addr learned my addr 172.21.15.84:0/1508745156 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:43.213 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c1f5b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f69bc07fe50 0x7f69bc07e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:43.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c175a700 1 --2- 172.21.15.84:0/1508745156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69bc09bf60 0x7f69bc07ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:43.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69ba7fc700 1 -- 172.21.15.84:0/1508745156 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644733872 0 0) 0x7f69bc07f160 con 0x7f69bc07d490 2020-01-16T05:48:43.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69ba7fc700 1 -- 172.21.15.84:0/1508745156 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f699c003230 con 0x7f69bc07d490 2020-01-16T05:48:43.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c1f5b700 1 -- 172.21.15.84:0/1508745156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69bc09bf60 msgr2=0x7f69bc07ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:43.214 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c1f5b700 1 --2- 172.21.15.84:0/1508745156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69bc09bf60 0x7f69bc07ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:43.215 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69ba7fc700 1 -- 172.21.15.84:0/1508745156 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3090060862 0 0) 0x7f699c003230 con 0x7f69bc07d490 2020-01-16T05:48:43.215 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c1f5b700 1 -- 172.21.15.84:0/1508745156 >> v1:172.21.15.84:6789/0 conn(0x7f69bc07d490 legacy=0x7f69bc0a5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:43.215 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c1f5b700 1 -- 172.21.15.84:0/1508745156 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc07e030 con 0x7f69bc07fe50 2020-01-16T05:48:43.215 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c1f5b700 1 --2- 172.21.15.84:0/1508745156 >> v2:172.21.15.84:3300/0 conn(0x7f69bc07fe50 0x7f69bc07e6c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f69ac0016d0 tx=0x7f69ac002f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:43.215 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c1f5b700 1 --2- 172.21.15.84:0/1508745156 >> v2:172.21.15.84:3300/0 conn(0x7f69bc07fe50 0x7f69bc07e6c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f69ac0016d0 tx=0x7f69ac002f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:43.215 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c1f5b700 1 --2- 172.21.15.84:0/1508745156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69bc07fe50 0x7f69bc07e6c0 secure :-1 s=READY pgs=520 cs=0 l=1 rx=0x7f69ac0016d0 tx=0x7f69ac002f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:43.215 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c1f5b700 1 --2- 172.21.15.84:0/1508745156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69bc07fe50 0x7f69bc07e6c0 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7f69ac0016d0 tx=0x7f69ac002f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:43.215 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69ba7fc700 1 -- 172.21.15.84:0/1508745156 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69ac001490 con 0x7f69bc07fe50 2020-01-16T05:48:43.216 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c1f5b700 1 --2- 172.21.15.84:0/1508745156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69bc07fe50 0x7f69bc07e6c0 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7f69ac0016d0 tx=0x7f69ac002f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:43.216 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c1f5b700 1 --2- 172.21.15.84:0/1508745156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69bc07fe50 0x7f69bc07e6c0 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7f69ac0016d0 tx=0x7f69ac002f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:43.216 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69ba7fc700 1 -- 172.21.15.84:0/1508745156 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac0012a0 con 0x7f69bc07fe50 2020-01-16T05:48:43.216 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c39be700 1 -- 172.21.15.84:0/1508745156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69bc0a62b0 con 0x7f69bc07fe50 2020-01-16T05:48:43.216 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69ba7fc700 1 -- 172.21.15.84:0/1508745156 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69b40124e0 con 0x7f69bc07fe50 2020-01-16T05:48:43.216 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.208+0000 7f69c39be700 1 -- 172.21.15.84:0/1508745156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69bc0a6830 con 0x7f69bc07fe50 2020-01-16T05:48:43.217 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.212+0000 7f69c1f5b700 1 --2- 172.21.15.84:0/1508745156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69bc07fe50 0x7f69bc07e6c0 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7f69ac0016d0 tx=0x7f69ac002f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:43.217 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.212+0000 7f69c1f5b700 1 --2- 172.21.15.84:0/1508745156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69bc07fe50 0x7f69bc07e6c0 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7f69ac0016d0 tx=0x7f69ac002f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:43.217 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.212+0000 7f69ba7fc700 1 -- 172.21.15.84:0/1508745156 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f69b40127f0 con 0x7f69bc07fe50 2020-01-16T05:48:43.217 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.212+0000 7f69c39be700 1 -- 172.21.15.84:0/1508745156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69bc05e1c0 con 0x7f69bc07fe50 2020-01-16T05:48:43.217 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.212+0000 7f69ba7fc700 1 --2- 172.21.15.84:0/1508745156 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f699c03c800 0x7f699c03ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:43.217 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.212+0000 7f69ba7fc700 1 -- 172.21.15.84:0/1508745156 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f69b404cb70 con 0x7f69bc07fe50 2020-01-16T05:48:43.217 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.212+0000 7f69c175a700 1 --2- 172.21.15.84:0/1508745156 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f699c03c800 0x7f699c03ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:43.218 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.212+0000 7f69c175a700 1 --2- 172.21.15.84:0/1508745156 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f699c03c800 0x7f699c03ed10 crc :-1 s=READY pgs=199 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:43.218 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.220+0000 7f69c1f5b700 1 --2- 172.21.15.84:0/1508745156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69bc07fe50 0x7f69bc07e6c0 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7f69ac0016d0 tx=0x7f69ac002f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:43.218 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.220+0000 7f69ba7fc700 1 -- 172.21.15.84:0/1508745156 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f69b4033150 con 0x7f69bc07fe50 2020-01-16T05:48:43.365 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.368+0000 7f69c39be700 1 -- 172.21.15.84:0/1508745156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69bc08f350 con 0x7f69bc07fe50 2020-01-16T05:48:43.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.368+0000 7f69c1f5b700 1 --2- 172.21.15.84:0/1508745156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69bc07fe50 0x7f69bc07e6c0 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7f69ac0016d0 tx=0x7f69ac002f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:43.366 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.368+0000 7f69ba7fc700 1 -- 172.21.15.84:0/1508745156 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f69b40333b0 con 0x7f69bc07fe50 2020-01-16T05:48:43.366 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:43.367 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:43.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.368+0000 7f69c39be700 1 -- 172.21.15.84:0/1508745156 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f699c03c800 msgr2=0x7f699c03ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:43.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.368+0000 7f69c39be700 1 --2- 172.21.15.84:0/1508745156 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f699c03c800 0x7f699c03ed10 crc :-1 s=READY pgs=199 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:43.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.368+0000 7f69c39be700 1 -- 172.21.15.84:0/1508745156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69bc07fe50 msgr2=0x7f69bc07e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:43.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.368+0000 7f69c39be700 1 --2- 172.21.15.84:0/1508745156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69bc07fe50 0x7f69bc07e6c0 secure :-1 s=READY pgs=520 cs=0 l=1 rx=0x7f69ac0016d0 tx=0x7f69ac002f70).stop 2020-01-16T05:48:43.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.368+0000 7f69c39be700 1 -- 172.21.15.84:0/1508745156 shutdown_connections 2020-01-16T05:48:43.368 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.368+0000 7f69c39be700 1 --2- 172.21.15.84:0/1508745156 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f699c03c800 0x7f699c03ed10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:43.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.368+0000 7f69c39be700 1 --2- 172.21.15.84:0/1508745156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69bc07fe50 0x7f69bc07e6c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:43.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.368+0000 7f69c39be700 1 --2- 172.21.15.84:0/1508745156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69bc09bf60 0x7f69bc07ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:43.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.368+0000 7f69c39be700 1 -- 172.21.15.84:0/1508745156 shutdown_connections 2020-01-16T05:48:43.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.368+0000 7f69c39be700 1 -- 172.21.15.84:0/1508745156 wait complete. 2020-01-16T05:48:43.369 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:43.368+0000 7f69c39be700 1 -- 172.21.15.84:0/1508745156 >> 172.21.15.84:0/1508745156 conn(0x7f69bc0a2e40 msgr2=0x7f69bc05a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:43.370 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:43.379 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:48:44.735 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:48:44.738 INFO:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:48:45.381 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:45.505 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.500+0000 7fd3fe6c8700 1 Processor -- start 2020-01-16T05:48:45.505 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.500+0000 7fd3fe6c8700 1 -- start start 2020-01-16T05:48:45.505 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.500+0000 7fd3fe6c8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f80a2f60 0x7fd3f805b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:45.506 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.500+0000 7fd3fe6c8700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd3f808fd80 0x7fd3f81503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:45.506 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.500+0000 7fd3fe6c8700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f807cd60 con 0x7fd3f80a8ff0 2020-01-16T05:48:45.506 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.500+0000 7fd3fe6c8700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f80a3390 con 0x7fd3f808fd80 2020-01-16T05:48:45.506 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.500+0000 7fd3fe6c8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f80905b0 con 0x7fd3f80a2f60 2020-01-16T05:48:45.506 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.500+0000 7fd3fd466700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd3f808fd80 0x7fd3f81503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:45.506 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.500+0000 7fd3fcc65700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f80a2f60 0x7fd3f805b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:45.506 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.500+0000 7fd3fd466700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd3f808fd80 0x7fd3f81503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.84:46626/0 (socket says 172.21.15.84:46626) 2020-01-16T05:48:45.507 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.500+0000 7fd3fcc65700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f80a2f60 0x7fd3f805b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:48886/0 (socket says 172.21.15.84:48886) 2020-01-16T05:48:45.507 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.500+0000 7fd3f7fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd3f80a8ff0 0x7fd3f807c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:52070/0 (socket says 172.21.15.84:52070) 2020-01-16T05:48:45.507 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.500+0000 7fd3fd466700 1 -- 172.21.15.84:0/4032437169 learned_addr learned my addr 172.21.15.84:0/4032437169 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:45.507 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fcc65700 1 -- 172.21.15.84:0/4032437169 >> v2:172.21.15.142:3300/0 conn(0x7fd3f808fd80 msgr2=0x7fd3f81503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:45.507 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fcc65700 1 --2- 172.21.15.84:0/4032437169 >> v2:172.21.15.142:3300/0 conn(0x7fd3f808fd80 0x7fd3f81503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:45.507 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fcc65700 1 -- 172.21.15.84:0/4032437169 >> v1:172.21.15.142:6789/0 conn(0x7fd3f80a8ff0 legacy=0x7fd3f807c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:45.507 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fcc65700 1 -- 172.21.15.84:0/4032437169 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f80a9420 con 0x7fd3f80a2f60 2020-01-16T05:48:45.508 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fd466700 1 --2- 172.21.15.84:0/4032437169 >> v2:172.21.15.142:3300/0 conn(0x7fd3f808fd80 0x7fd3f81503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:48:45.508 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fcc65700 1 --2- 172.21.15.84:0/4032437169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f80a2f60 0x7fd3f805b0f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd3e8008c90 tx=0x7fd3e8010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:45.508 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fcc65700 1 --2- 172.21.15.84:0/4032437169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f80a2f60 0x7fd3f805b0f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd3e8008c90 tx=0x7fd3e8010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:45.508 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fcc65700 1 --2- 172.21.15.84:0/4032437169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f80a2f60 0x7fd3f805b0f0 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fd3e8008c90 tx=0x7fd3e8010170).ready entity=mon.2 client_cookie=e0f2db52cc725639 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:45.508 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fcc65700 1 --2- 172.21.15.84:0/4032437169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f80a2f60 0x7fd3f805b0f0 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fd3e8008c90 tx=0x7fd3e8010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:45.508 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fcc65700 1 --2- 172.21.15.84:0/4032437169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f80a2f60 0x7fd3f805b0f0 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fd3e8008c90 tx=0x7fd3e8010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:45.508 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fcc65700 1 --2- 172.21.15.84:0/4032437169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f80a2f60 0x7fd3f805b0f0 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fd3e8008c90 tx=0x7fd3e8010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:45.509 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3f77fe700 1 -- 172.21.15.84:0/4032437169 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3e800a160 con 0x7fd3f80a2f60 2020-01-16T05:48:45.509 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3f77fe700 1 -- 172.21.15.84:0/4032437169 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e8011af0 con 0x7fd3f80a2f60 2020-01-16T05:48:45.509 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3f77fe700 1 -- 172.21.15.84:0/4032437169 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3e800a740 con 0x7fd3f80a2f60 2020-01-16T05:48:45.509 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fe6c8700 1 -- 172.21.15.84:0/4032437169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f80a2f60 msgr2=0x7fd3f805b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:45.509 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fe6c8700 1 --2- 172.21.15.84:0/4032437169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f80a2f60 0x7fd3f805b0f0 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fd3e8008c90 tx=0x7fd3e8010170).stop 2020-01-16T05:48:45.509 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fe6c8700 1 -- 172.21.15.84:0/4032437169 shutdown_connections 2020-01-16T05:48:45.509 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fe6c8700 1 --2- 172.21.15.84:0/4032437169 >> v2:172.21.15.142:3300/0 conn(0x7fd3f808fd80 0x7fd3f81503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:45.510 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fe6c8700 1 --2- 172.21.15.84:0/4032437169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f80a2f60 0x7fd3f805b0f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:45.510 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fe6c8700 1 -- 172.21.15.84:0/4032437169 shutdown_connections 2020-01-16T05:48:45.510 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fe6c8700 1 -- 172.21.15.84:0/4032437169 wait complete. 2020-01-16T05:48:45.510 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.504+0000 7fd3fe6c8700 1 -- 172.21.15.84:0/4032437169 >> 172.21.15.84:0/4032437169 conn(0x7fd3f80abc10 msgr2=0x7fd3f805a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:45.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fe6c8700 1 Processor -- start 2020-01-16T05:48:45.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fe6c8700 1 -- start start 2020-01-16T05:48:45.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fe6c8700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd3f807e960 0x7fd3f809f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:45.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fe6c8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f807f780 0x7fd3f80a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:45.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fe6c8700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f8123dc0 con 0x7fd3f8123990 2020-01-16T05:48:45.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fe6c8700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f807efa0 con 0x7fd3f807e960 2020-01-16T05:48:45.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fe6c8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f807f240 con 0x7fd3f807f780 2020-01-16T05:48:45.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fcc65700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd3f807e960 0x7fd3f809f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:45.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3f7fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f807f780 0x7fd3f80a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:45.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fcc65700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd3f807e960 0x7fd3f809f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.84:46632/0 (socket says 172.21.15.84:46632) 2020-01-16T05:48:45.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fd466700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd3f8123990 0x7fd3f812f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:52076/0 (socket says 172.21.15.84:52076) 2020-01-16T05:48:45.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fcc65700 1 -- 172.21.15.84:0/2151379426 learned_addr learned my addr 172.21.15.84:0/2151379426 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:45.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3f7fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f807f780 0x7fd3f80a00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:48890/0 (socket says 172.21.15.84:48890) 2020-01-16T05:48:45.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fcc65700 1 -- 172.21.15.84:0/2151379426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f807f780 msgr2=0x7fd3f80a00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:45.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fcc65700 1 --2- 172.21.15.84:0/2151379426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f807f780 0x7fd3f80a00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:45.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fcc65700 1 -- 172.21.15.84:0/2151379426 >> v1:172.21.15.142:6789/0 conn(0x7fd3f8123990 legacy=0x7fd3f812f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:45.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fcc65700 1 -- 172.21.15.84:0/2151379426 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f813e310 con 0x7fd3f807e960 2020-01-16T05:48:45.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3f57fa700 1 -- 172.21.15.84:0/2151379426 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861765619 0 0) 0x7fd3f8123dc0 con 0x7fd3f8123990 2020-01-16T05:48:45.515 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fcc65700 1 --2- 172.21.15.84:0/2151379426 >> v2:172.21.15.142:3300/0 conn(0x7fd3f807e960 0x7fd3f809f610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3f807f160 tx=0x7fd3e8011e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:45.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fcc65700 1 --2- 172.21.15.84:0/2151379426 >> v2:172.21.15.142:3300/0 conn(0x7fd3f807e960 0x7fd3f809f610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3f807f160 tx=0x7fd3e8011e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:45.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fcc65700 1 --2- 172.21.15.84:0/2151379426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f807e960 0x7fd3f809f610 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7fd3f807f160 tx=0x7fd3e8011e50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:45.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fcc65700 1 --2- 172.21.15.84:0/2151379426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f807e960 0x7fd3f809f610 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7fd3f807f160 tx=0x7fd3e8011e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:45.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3f57fa700 1 -- 172.21.15.84:0/2151379426 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3e8005a40 con 0x7fd3f807e960 2020-01-16T05:48:45.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fcc65700 1 --2- 172.21.15.84:0/2151379426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f807e960 0x7fd3f809f610 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7fd3f807f160 tx=0x7fd3e8011e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:45.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3f57fa700 1 -- 172.21.15.84:0/2151379426 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e800a360 con 0x7fd3f807e960 2020-01-16T05:48:45.516 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fe6c8700 1 -- 172.21.15.84:0/2151379426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f813d300 con 0x7fd3f807e960 2020-01-16T05:48:45.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.508+0000 7fd3fcc65700 1 --2- 172.21.15.84:0/2151379426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f807e960 0x7fd3f809f610 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7fd3f807f160 tx=0x7fd3e8011e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:45.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.512+0000 7fd3f57fa700 1 -- 172.21.15.84:0/2151379426 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3e8007340 con 0x7fd3f807e960 2020-01-16T05:48:45.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.512+0000 7fd3fe6c8700 1 -- 172.21.15.84:0/2151379426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f813d710 con 0x7fd3f807e960 2020-01-16T05:48:45.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.512+0000 7fd3fcc65700 1 --2- 172.21.15.84:0/2151379426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f807e960 0x7fd3f809f610 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7fd3f807f160 tx=0x7fd3e8011e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:45.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.512+0000 7fd3fe6c8700 1 -- 172.21.15.84:0/2151379426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f805e1c0 con 0x7fd3f807e960 2020-01-16T05:48:45.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.512+0000 7fd3f57fa700 1 -- 172.21.15.84:0/2151379426 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fd3e8007620 con 0x7fd3f807e960 2020-01-16T05:48:45.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.512+0000 7fd3fcc65700 1 --2- 172.21.15.84:0/2151379426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f807e960 0x7fd3f809f610 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7fd3f807f160 tx=0x7fd3e8011e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:45.517 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.512+0000 7fd3f57fa700 1 --2- 172.21.15.84:0/2151379426 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd3dc03c1b0 0x7fd3dc03e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:45.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.512+0000 7fd3f57fa700 1 -- 172.21.15.84:0/2151379426 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fd3e804d560 con 0x7fd3f807e960 2020-01-16T05:48:45.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.512+0000 7fd3f7fff700 1 --2- 172.21.15.84:0/2151379426 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd3dc03c1b0 0x7fd3dc03e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:45.518 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.512+0000 7fd3f7fff700 1 --2- 172.21.15.84:0/2151379426 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd3dc03c1b0 0x7fd3dc03e6c0 crc :-1 s=READY pgs=200 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:45.521 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.520+0000 7fd3fcc65700 1 --2- 172.21.15.84:0/2151379426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f807e960 0x7fd3f809f610 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7fd3f807f160 tx=0x7fd3e8011e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:45.521 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.520+0000 7fd3f57fa700 1 -- 172.21.15.84:0/2151379426 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fd3e8033b60 con 0x7fd3f807e960 2020-01-16T05:48:45.673 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.672+0000 7fd3fe6c8700 1 -- 172.21.15.84:0/2151379426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3f808f350 con 0x7fd3f807e960 2020-01-16T05:48:45.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.676+0000 7fd3fcc65700 1 --2- 172.21.15.84:0/2151379426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f807e960 0x7fd3f809f610 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7fd3f807f160 tx=0x7fd3e8011e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:45.674 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.676+0000 7fd3f57fa700 1 -- 172.21.15.84:0/2151379426 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fd3e8008450 con 0x7fd3f807e960 2020-01-16T05:48:45.674 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:45.675 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:45.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.676+0000 7fd3fe6c8700 1 -- 172.21.15.84:0/2151379426 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd3dc03c1b0 msgr2=0x7fd3dc03e6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:45.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.676+0000 7fd3fe6c8700 1 --2- 172.21.15.84:0/2151379426 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd3dc03c1b0 0x7fd3dc03e6c0 crc :-1 s=READY pgs=200 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:45.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.676+0000 7fd3fe6c8700 1 -- 172.21.15.84:0/2151379426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f807e960 msgr2=0x7fd3f809f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:45.676 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.676+0000 7fd3fe6c8700 1 --2- 172.21.15.84:0/2151379426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f807e960 0x7fd3f809f610 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7fd3f807f160 tx=0x7fd3e8011e50).stop 2020-01-16T05:48:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.676+0000 7fd3fe6c8700 1 -- 172.21.15.84:0/2151379426 shutdown_connections 2020-01-16T05:48:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.676+0000 7fd3fe6c8700 1 --2- 172.21.15.84:0/2151379426 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd3dc03c1b0 0x7fd3dc03e6c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.676+0000 7fd3fe6c8700 1 --2- 172.21.15.84:0/2151379426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f807e960 0x7fd3f809f610 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.676+0000 7fd3fe6c8700 1 --2- 172.21.15.84:0/2151379426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f807f780 0x7fd3f80a00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.676+0000 7fd3fe6c8700 1 -- 172.21.15.84:0/2151379426 shutdown_connections 2020-01-16T05:48:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.676+0000 7fd3fe6c8700 1 -- 172.21.15.84:0/2151379426 wait complete. 2020-01-16T05:48:45.678 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:45.676+0000 7fd3fe6c8700 1 -- 172.21.15.84:0/2151379426 >> 172.21.15.84:0/2151379426 conn(0x7fd3f808fac0 msgr2=0x7fd3f8126b90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:45.678 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:45.688 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:46.893 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~260s 2020-01-16T05:48:47.688 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:47.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6cb59e700 1 Processor -- start 2020-01-16T05:48:47.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6cb59e700 1 -- start start 2020-01-16T05:48:47.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6cb59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6cc0a9b30 0x7fc6cc0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:47.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6cb59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc6cc07ff10 0x7fc6cc066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:47.822 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6cb59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc6cc0a4250 0x7fc6cc0a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:47.822 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6cb59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc0a4830 con 0x7fc6cc0a4250 2020-01-16T05:48:47.822 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6cb59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc07f9d0 con 0x7fc6cc07ff10 2020-01-16T05:48:47.822 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6cb59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc07fc70 con 0x7fc6cc0a9b30 2020-01-16T05:48:47.822 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6d0c5d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc6cc0a4250 0x7fc6cc0a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:47.822 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6d0c5d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc6cc0a4250 0x7fc6cc0a4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36658/0 (socket says 172.21.15.84:36658) 2020-01-16T05:48:47.822 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6d0c5d700 1 -- 172.21.15.84:0/2412915016 learned_addr learned my addr 172.21.15.84:0/2412915016 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:47.823 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6cad9d700 1 --2- 172.21.15.84:0/2412915016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6cc0a9b30 0x7fc6cc0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:47.823 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6c259c700 1 --2- 172.21.15.84:0/2412915016 >> v2:172.21.15.142:3300/0 conn(0x7fc6cc07ff10 0x7fc6cc066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:47.823 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6d0c5d700 1 -- 172.21.15.84:0/2412915016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6cc0a9b30 msgr2=0x7fc6cc0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:47.823 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6d0c5d700 1 --2- 172.21.15.84:0/2412915016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6cc0a9b30 0x7fc6cc0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:47.823 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6d0c5d700 1 -- 172.21.15.84:0/2412915016 >> v2:172.21.15.142:3300/0 conn(0x7fc6cc07ff10 msgr2=0x7fc6cc066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:47.823 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6d0c5d700 1 --2- 172.21.15.84:0/2412915016 >> v2:172.21.15.142:3300/0 conn(0x7fc6cc07ff10 0x7fc6cc066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:47.823 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6d0c5d700 1 -- 172.21.15.84:0/2412915016 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc066dd0 con 0x7fc6cc0a4250 2020-01-16T05:48:47.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6cad9d700 1 --2- 172.21.15.84:0/2412915016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6cc0a9b30 0x7fc6cc0abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:48:47.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6c259c700 1 --2- 172.21.15.84:0/2412915016 >> v2:172.21.15.142:3300/0 conn(0x7fc6cc07ff10 0x7fc6cc066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:48:47.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6d0c5d700 1 --2- 172.21.15.84:0/2412915016 >> v2:172.21.15.84:3300/0 conn(0x7fc6cc0a4250 0x7fc6cc0a4ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc6cc0a49f0 tx=0x7fc6c40102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:47.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6d0c5d700 1 --2- 172.21.15.84:0/2412915016 >> v2:172.21.15.84:3300/0 conn(0x7fc6cc0a4250 0x7fc6cc0a4ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc6cc0a49f0 tx=0x7fc6c40102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:47.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6d0c5d700 1 --2- 172.21.15.84:0/2412915016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0a4250 0x7fc6cc0a4ad0 secure :-1 s=READY pgs=521 cs=0 l=1 rx=0x7fc6cc0a49f0 tx=0x7fc6c40102b0).ready entity=mon.0 client_cookie=37080cc906e25cb server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:47.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6d0c5d700 1 --2- 172.21.15.84:0/2412915016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0a4250 0x7fc6cc0a4ad0 secure :-1 s=THROTTLE_DONE pgs=521 cs=0 l=1 rx=0x7fc6cc0a49f0 tx=0x7fc6c40102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:47.824 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6d0c5d700 1 --2- 172.21.15.84:0/2412915016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0a4250 0x7fc6cc0a4ad0 secure :-1 s=THROTTLE_DONE pgs=521 cs=0 l=1 rx=0x7fc6cc0a49f0 tx=0x7fc6c40102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:47.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.816+0000 7fc6d0c5d700 1 --2- 172.21.15.84:0/2412915016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0a4250 0x7fc6cc0a4ad0 secure :-1 s=THROTTLE_DONE pgs=521 cs=0 l=1 rx=0x7fc6cc0a49f0 tx=0x7fc6c40102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:47.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.812+0000 7fc6ca59c700 1 -- 172.21.15.84:0/2412915016 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6c400a160 con 0x7fc6cc0a4250 2020-01-16T05:48:47.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.816+0000 7fc6ca59c700 1 -- 172.21.15.84:0/2412915016 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c4011bf0 con 0x7fc6cc0a4250 2020-01-16T05:48:47.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.816+0000 7fc6ca59c700 1 -- 172.21.15.84:0/2412915016 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6c400a740 con 0x7fc6cc0a4250 2020-01-16T05:48:47.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.816+0000 7fc6cb59e700 1 -- 172.21.15.84:0/2412915016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0a4250 msgr2=0x7fc6cc0a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:47.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.816+0000 7fc6cb59e700 1 --2- 172.21.15.84:0/2412915016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0a4250 0x7fc6cc0a4ad0 secure :-1 s=READY pgs=521 cs=0 l=1 rx=0x7fc6cc0a49f0 tx=0x7fc6c40102b0).stop 2020-01-16T05:48:47.825 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.816+0000 7fc6cb59e700 1 -- 172.21.15.84:0/2412915016 shutdown_connections 2020-01-16T05:48:47.826 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.816+0000 7fc6cb59e700 1 --2- 172.21.15.84:0/2412915016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0a4250 0x7fc6cc0a4ad0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:47.826 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.816+0000 7fc6cb59e700 1 --2- 172.21.15.84:0/2412915016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6cc0a9b30 0x7fc6cc0abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:47.826 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.816+0000 7fc6cb59e700 1 --2- 172.21.15.84:0/2412915016 >> v2:172.21.15.142:3300/0 conn(0x7fc6cc07ff10 0x7fc6cc066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:47.826 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.816+0000 7fc6cb59e700 1 -- 172.21.15.84:0/2412915016 shutdown_connections 2020-01-16T05:48:47.826 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.816+0000 7fc6cb59e700 1 -- 172.21.15.84:0/2412915016 wait complete. 2020-01-16T05:48:47.826 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.816+0000 7fc6cb59e700 1 -- 172.21.15.84:0/2412915016 >> 172.21.15.84:0/2412915016 conn(0x7fc6cc0acfc0 msgr2=0x7fc6cc0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:47.827 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6cb59e700 1 Processor -- start 2020-01-16T05:48:47.827 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6cb59e700 1 -- start start 2020-01-16T05:48:47.827 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6cb59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6cc091460 0x7fc6cc09f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:47.827 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6cb59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc6cc0610d0 0x7fc6cc0a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:47.827 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6cb59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6cc0a20f0 con 0x7fc6cc09f7d0 2020-01-16T05:48:47.827 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6cb59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc07b850 con 0x7fc6cc0610d0 2020-01-16T05:48:47.828 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6cb59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0a1910 con 0x7fc6cc091460 2020-01-16T05:48:47.828 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6c259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc6cc0610d0 0x7fc6cc0a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:47.828 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6c259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc6cc0610d0 0x7fc6cc0a03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36662/0 (socket says 172.21.15.84:36662) 2020-01-16T05:48:47.828 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6c259c700 1 -- 172.21.15.84:0/3706382349 learned_addr learned my addr 172.21.15.84:0/3706382349 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:47.828 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6cad9d700 1 --2- 172.21.15.84:0/3706382349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6cc091460 0x7fc6cc09f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:47.828 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6c259c700 1 -- 172.21.15.84:0/3706382349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6cc091460 msgr2=0x7fc6cc09f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:47.828 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6c259c700 1 --2- 172.21.15.84:0/3706382349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6cc091460 0x7fc6cc09f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:47.829 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6c259c700 1 -- 172.21.15.84:0/3706382349 >> v1:172.21.15.142:6789/0 conn(0x7fc6cc09f7d0 legacy=0x7fc6cc0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:47.829 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6c259c700 1 -- 172.21.15.84:0/3706382349 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc091bc0 con 0x7fc6cc0610d0 2020-01-16T05:48:47.829 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6c259c700 1 --2- 172.21.15.84:0/3706382349 >> v2:172.21.15.84:3300/0 conn(0x7fc6cc0610d0 0x7fc6cc0a03c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc6cc0a2340 tx=0x7fc6b4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:47.829 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6c259c700 1 --2- 172.21.15.84:0/3706382349 >> v2:172.21.15.84:3300/0 conn(0x7fc6cc0610d0 0x7fc6cc0a03c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc6cc0a2340 tx=0x7fc6b4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:47.829 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6c259c700 1 --2- 172.21.15.84:0/3706382349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0610d0 0x7fc6cc0a03c0 secure :-1 s=READY pgs=522 cs=0 l=1 rx=0x7fc6cc0a2340 tx=0x7fc6b4010c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:47.829 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6c259c700 1 --2- 172.21.15.84:0/3706382349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0610d0 0x7fc6cc0a03c0 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7fc6cc0a2340 tx=0x7fc6b4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:47.829 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6c3fff700 1 -- 172.21.15.84:0/3706382349 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6b4012a40 con 0x7fc6cc0610d0 2020-01-16T05:48:47.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6c259c700 1 --2- 172.21.15.84:0/3706382349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0610d0 0x7fc6cc0a03c0 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7fc6cc0a2340 tx=0x7fc6b4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:47.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6c259c700 1 --2- 172.21.15.84:0/3706382349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0610d0 0x7fc6cc0a03c0 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7fc6cc0a2340 tx=0x7fc6b4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:47.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6c3fff700 1 -- 172.21.15.84:0/3706382349 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b4012660 con 0x7fc6cc0610d0 2020-01-16T05:48:47.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6c3fff700 1 -- 172.21.15.84:0/3706382349 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6b4009340 con 0x7fc6cc0610d0 2020-01-16T05:48:47.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6cb59e700 1 -- 172.21.15.84:0/3706382349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6cc0a1570 con 0x7fc6cc0610d0 2020-01-16T05:48:47.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.820+0000 7fc6cb59e700 1 -- 172.21.15.84:0/3706382349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc0a0910 con 0x7fc6cc0610d0 2020-01-16T05:48:47.830 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.824+0000 7fc6c259c700 1 --2- 172.21.15.84:0/3706382349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0610d0 0x7fc6cc0a03c0 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7fc6cc0a2340 tx=0x7fc6b4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:47.831 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.824+0000 7fc6cb59e700 1 -- 172.21.15.84:0/3706382349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6cc05e1c0 con 0x7fc6cc0610d0 2020-01-16T05:48:47.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.824+0000 7fc6c3fff700 1 -- 172.21.15.84:0/3706382349 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fc6b4007170 con 0x7fc6cc0610d0 2020-01-16T05:48:47.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.824+0000 7fc6c259c700 1 --2- 172.21.15.84:0/3706382349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0610d0 0x7fc6cc0a03c0 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7fc6cc0a2340 tx=0x7fc6b4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:47.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.824+0000 7fc6c3fff700 1 --2- 172.21.15.84:0/3706382349 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc6b003c2d0 0x7fc6b003e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:47.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.824+0000 7fc6c3fff700 1 -- 172.21.15.84:0/3706382349 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fc6b4009dc0 con 0x7fc6cc0610d0 2020-01-16T05:48:47.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.824+0000 7fc6cad9d700 1 --2- 172.21.15.84:0/3706382349 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc6b003c2d0 0x7fc6b003e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:47.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.824+0000 7fc6cad9d700 1 --2- 172.21.15.84:0/3706382349 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc6b003c2d0 0x7fc6b003e7e0 crc :-1 s=READY pgs=201 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:47.832 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.828+0000 7fc6c259c700 1 --2- 172.21.15.84:0/3706382349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0610d0 0x7fc6cc0a03c0 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7fc6cc0a2340 tx=0x7fc6b4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:47.833 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.828+0000 7fc6c3fff700 1 -- 172.21.15.84:0/3706382349 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fc6b4033440 con 0x7fc6cc0610d0 2020-01-16T05:48:47.981 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.984+0000 7fc6cb59e700 1 -- 172.21.15.84:0/3706382349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6cc05cbc0 con 0x7fc6cc0610d0 2020-01-16T05:48:47.982 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.984+0000 7fc6c259c700 1 --2- 172.21.15.84:0/3706382349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0610d0 0x7fc6cc0a03c0 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7fc6cc0a2340 tx=0x7fc6b4010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:47.982 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.984+0000 7fc6c3fff700 1 -- 172.21.15.84:0/3706382349 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fc6b40336a0 con 0x7fc6cc0610d0 2020-01-16T05:48:47.982 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:47.983 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:47.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.984+0000 7fc6cb59e700 1 -- 172.21.15.84:0/3706382349 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc6b003c2d0 msgr2=0x7fc6b003e7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:47.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.984+0000 7fc6cb59e700 1 --2- 172.21.15.84:0/3706382349 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc6b003c2d0 0x7fc6b003e7e0 crc :-1 s=READY pgs=201 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:47.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.984+0000 7fc6cb59e700 1 -- 172.21.15.84:0/3706382349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0610d0 msgr2=0x7fc6cc0a03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:47.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.984+0000 7fc6cb59e700 1 --2- 172.21.15.84:0/3706382349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0610d0 0x7fc6cc0a03c0 secure :-1 s=READY pgs=522 cs=0 l=1 rx=0x7fc6cc0a2340 tx=0x7fc6b4010c30).stop 2020-01-16T05:48:47.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.984+0000 7fc6cb59e700 1 -- 172.21.15.84:0/3706382349 shutdown_connections 2020-01-16T05:48:47.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.984+0000 7fc6cb59e700 1 --2- 172.21.15.84:0/3706382349 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc6b003c2d0 0x7fc6b003e7e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:47.984 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.984+0000 7fc6cb59e700 1 --2- 172.21.15.84:0/3706382349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6cc091460 0x7fc6cc09f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:47.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.984+0000 7fc6cb59e700 1 --2- 172.21.15.84:0/3706382349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6cc0610d0 0x7fc6cc0a03c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:47.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.984+0000 7fc6cb59e700 1 -- 172.21.15.84:0/3706382349 shutdown_connections 2020-01-16T05:48:47.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.984+0000 7fc6cb59e700 1 -- 172.21.15.84:0/3706382349 wait complete. 2020-01-16T05:48:47.985 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:47.984+0000 7fc6cb59e700 1 -- 172.21.15.84:0/3706382349 >> 172.21.15.84:0/3706382349 conn(0x7fc6cc0a8dc0 msgr2=0x7fc6cc0246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:47.985 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:47.996 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:49.996 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9bfff700 1 Processor -- start 2020-01-16T05:48:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9bfff700 1 -- start start 2020-01-16T05:48:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f9c07ff10 0x7f7f9c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f9c0a4250 0x7f7f9c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9bfff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f9c066dd0 con 0x7f7f9c0a9b30 2020-01-16T05:48:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9bfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f9c0a4830 con 0x7f7f9c0a4250 2020-01-16T05:48:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9bfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9c07f9d0 con 0x7f7f9c07ff10 2020-01-16T05:48:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7f9c0a9b30 0x7f7f9c0a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53868/0 (socket says 172.21.15.84:53868) 2020-01-16T05:48:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9b7fe700 1 -- 172.21.15.84:0/4044804833 learned_addr learned my addr 172.21.15.84:0/4044804833 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7fa1638700 1 --2- 172.21.15.84:0/4044804833 >> v2:172.21.15.142:3300/0 conn(0x7f7f9c0a4250 0x7f7f9c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f92ffd700 1 --2- 172.21.15.84:0/4044804833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f9c07ff10 0x7f7f9c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 -- 172.21.15.84:0/4044804833 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780492732 0 0) 0x7f7f9c066dd0 con 0x7f7f9c0a9b30 2020-01-16T05:48:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 -- 172.21.15.84:0/4044804833 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f88003230 con 0x7f7f9c0a9b30 2020-01-16T05:48:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 -- 172.21.15.84:0/4044804833 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1247737957 0 0) 0x7f7f88003230 con 0x7f7f9c0a9b30 2020-01-16T05:48:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 -- 172.21.15.84:0/4044804833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f9c07ff10 msgr2=0x7f7f9c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:50.122 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 --2- 172.21.15.84:0/4044804833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f9c07ff10 0x7f7f9c0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:50.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 -- 172.21.15.84:0/4044804833 >> v2:172.21.15.142:3300/0 conn(0x7f7f9c0a4250 msgr2=0x7f7f9c066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:50.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 --2- 172.21.15.84:0/4044804833 >> v2:172.21.15.142:3300/0 conn(0x7f7f9c0a4250 0x7f7f9c066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:50.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 -- 172.21.15.84:0/4044804833 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9c150ce0 con 0x7f7f9c0a9b30 2020-01-16T05:48:50.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 -- 172.21.15.84:0/4044804833 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f7f8c001750 con 0x7f7f9c0a9b30 2020-01-16T05:48:50.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 -- 172.21.15.84:0/4044804833 >> v1:172.21.15.84:6789/0 conn(0x7f7f9c0a9b30 legacy=0x7f7f9c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:50.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 --2- 172.21.15.84:0/4044804833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f88003860 0x7f7f88003cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:50.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 --2- 172.21.15.84:0/4044804833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f880045a0 0x7f7f880049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 --2- 172.21.15.84:0/4044804833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f88004f20 0x7f7f8804f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 -- 172.21.15.84:0/4044804833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9c0a4830 con 0x7f7f88003860 2020-01-16T05:48:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 -- 172.21.15.84:0/4044804833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9c07f9d0 con 0x7f7f880045a0 2020-01-16T05:48:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 -- 172.21.15.84:0/4044804833 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f88005380 con 0x7f7f88004f20 2020-01-16T05:48:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9b7fe700 1 --2- 172.21.15.84:0/4044804833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f88003860 0x7f7f88003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f92ffd700 1 --2- 172.21.15.84:0/4044804833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f880045a0 0x7f7f880049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7fa1638700 1 --2- 172.21.15.84:0/4044804833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f88004f20 0x7f7f8804f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:50.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9b7fe700 1 -- 172.21.15.84:0/4044804833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f88004f20 msgr2=0x7f7f8804f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:50.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9b7fe700 1 --2- 172.21.15.84:0/4044804833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f88004f20 0x7f7f8804f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:50.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9b7fe700 1 -- 172.21.15.84:0/4044804833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f880045a0 msgr2=0x7f7f880049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:50.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9b7fe700 1 --2- 172.21.15.84:0/4044804833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f880045a0 0x7f7f880049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:50.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9b7fe700 1 -- 172.21.15.84:0/4044804833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8804fe40 con 0x7f7f88003860 2020-01-16T05:48:50.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9b7fe700 1 --2- 172.21.15.84:0/4044804833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f88003860 0x7f7f88003cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7f8c001a50 tx=0x7f7f8c00c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:50.125 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9b7fe700 1 --2- 172.21.15.84:0/4044804833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f88003860 0x7f7f88003cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7f8c001a50 tx=0x7f7f8c00c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9b7fe700 1 --2- 172.21.15.84:0/4044804833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f88003860 0x7f7f88003cd0 secure :-1 s=READY pgs=524 cs=0 l=1 rx=0x7f7f8c001a50 tx=0x7f7f8c00c3a0).ready entity=mon.0 client_cookie=212130190f355782 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9b7fe700 1 --2- 172.21.15.84:0/4044804833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f88003860 0x7f7f88003cd0 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7f7f8c001a50 tx=0x7f7f8c00c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 -- 172.21.15.84:0/4044804833 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f8c00b450 con 0x7f7f88003860 2020-01-16T05:48:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9b7fe700 1 --2- 172.21.15.84:0/4044804833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f88003860 0x7f7f88003cd0 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7f7f8c001a50 tx=0x7f7f8c00c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 -- 172.21.15.84:0/4044804833 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8c00b070 con 0x7f7f88003860 2020-01-16T05:48:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9b7fe700 1 --2- 172.21.15.84:0/4044804833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f88003860 0x7f7f88003cd0 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7f7f8c001a50 tx=0x7f7f8c00c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9bfff700 1 -- 172.21.15.84:0/4044804833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f88003860 msgr2=0x7f7f88003cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9affd700 1 -- 172.21.15.84:0/4044804833 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f8c00aa70 con 0x7f7f88003860 2020-01-16T05:48:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7f9bfff700 1 --2- 172.21.15.84:0/4044804833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f88003860 0x7f7f88003cd0 secure :-1 s=READY pgs=524 cs=0 l=1 rx=0x7f7f8c001a50 tx=0x7f7f8c00c3a0).stop 2020-01-16T05:48:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.116+0000 7f7fa1638700 1 -- 172.21.15.84:0/4044804833 reap_dead start 2020-01-16T05:48:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.120+0000 7f7f9bfff700 1 -- 172.21.15.84:0/4044804833 shutdown_connections 2020-01-16T05:48:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.120+0000 7f7f9bfff700 1 -- 172.21.15.84:0/4044804833 shutdown_connections 2020-01-16T05:48:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.120+0000 7f7f9bfff700 1 -- 172.21.15.84:0/4044804833 wait complete. 2020-01-16T05:48:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.120+0000 7f7f9bfff700 1 -- 172.21.15.84:0/4044804833 >> 172.21.15.84:0/4044804833 conn(0x7f7f9c0acfc0 msgr2=0x7f7f9c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.120+0000 7f7f9bfff700 1 Processor -- start 2020-01-16T05:48:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.120+0000 7f7f9bfff700 1 -- start start 2020-01-16T05:48:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.120+0000 7f7f9bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f9c124450 0x7f7f9c126ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.120+0000 7f7f9bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f9c0a52d0 0x7f7f9c13d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.120+0000 7f7f9bfff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f9c126bc0 con 0x7f7f9c08fd00 2020-01-16T05:48:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.120+0000 7f7f9bfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f9c08f530 con 0x7f7f9c124450 2020-01-16T05:48:50.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.120+0000 7f7f9bfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9c08f7c0 con 0x7f7f9c0a52d0 2020-01-16T05:48:50.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f92ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7f9c08fd00 0x7f7f9c0a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53880/0 (socket says 172.21.15.84:53880) 2020-01-16T05:48:50.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f92ffd700 1 -- 172.21.15.84:0/1596297662 learned_addr learned my addr 172.21.15.84:0/1596297662 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:50.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f9b7fe700 1 --2- 172.21.15.84:0/1596297662 >> v2:172.21.15.142:3300/0 conn(0x7f7f9c124450 0x7f7f9c126ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:50.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7fa1638700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f9c0a52d0 0x7f7f9c13d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:50.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 -- 172.21.15.84:0/1596297662 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621656915 0 0) 0x7f7f9c126bc0 con 0x7f7f9c08fd00 2020-01-16T05:48:50.134 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 -- 172.21.15.84:0/1596297662 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f80003230 con 0x7f7f9c08fd00 2020-01-16T05:48:50.135 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 -- 172.21.15.84:0/1596297662 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 253349914 0 0) 0x7f7f80003230 con 0x7f7f9c08fd00 2020-01-16T05:48:50.135 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 -- 172.21.15.84:0/1596297662 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7f9c126bc0 con 0x7f7f9c08fd00 2020-01-16T05:48:50.135 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 -- 172.21.15.84:0/1596297662 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f7f84001490 con 0x7f7f9c08fd00 2020-01-16T05:48:50.135 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 -- 172.21.15.84:0/1596297662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f9c0a52d0 msgr2=0x7f7f9c13d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:50.135 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f9c0a52d0 0x7f7f9c13d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:50.135 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 -- 172.21.15.84:0/1596297662 >> v2:172.21.15.142:3300/0 conn(0x7f7f9c124450 msgr2=0x7f7f9c126ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:50.135 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 --2- 172.21.15.84:0/1596297662 >> v2:172.21.15.142:3300/0 conn(0x7f7f9c124450 0x7f7f9c126ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:50.136 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 -- 172.21.15.84:0/1596297662 >> v1:172.21.15.84:6789/0 conn(0x7f7f9c08fd00 legacy=0x7f7f9c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:50.136 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f80003a20 0x7f7f80003e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:50.136 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f800045a0 0x7f7f800049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:50.136 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f80005010 0x7f7f8000b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:50.136 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 -- 172.21.15.84:0/1596297662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9c08f530 con 0x7f7f800045a0 2020-01-16T05:48:50.136 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 -- 172.21.15.84:0/1596297662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9c08f7c0 con 0x7f7f80003a20 2020-01-16T05:48:50.136 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 -- 172.21.15.84:0/1596297662 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8000bdc0 con 0x7f7f80005010 2020-01-16T05:48:50.137 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7fa1638700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f9c0a52d0 0x7f7f9c13d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:48:50.137 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f92ffd700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f800045a0 0x7f7f800049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:50.137 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f9b7fe700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f80003a20 0x7f7f80003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:50.137 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7fa1638700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f80005010 0x7f7f8000b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:50.137 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f92ffd700 1 -- 172.21.15.84:0/1596297662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f80005010 msgr2=0x7f7f8000b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:50.137 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f92ffd700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f80005010 0x7f7f8000b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f92ffd700 1 -- 172.21.15.84:0/1596297662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f80003a20 msgr2=0x7f7f80003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f92ffd700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f80003a20 0x7f7f80003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f92ffd700 1 -- 172.21.15.84:0/1596297662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9c0a35c0 con 0x7f7f800045a0 2020-01-16T05:48:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7fa1638700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f80005010 0x7f7f8000b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-01-16T05:48:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f9bfff700 1 -- 172.21.15.84:0/1596297662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f9c125ca0 con 0x7f7f800045a0 2020-01-16T05:48:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f92ffd700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f800045a0 0x7f7f800049d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7f84007f00 tx=0x7f7f840117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f9bfff700 1 -- 172.21.15.84:0/1596297662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f9c127430 con 0x7f7f800045a0 2020-01-16T05:48:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f92ffd700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f800045a0 0x7f7f800049d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7f84007f00 tx=0x7f7f840117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f92ffd700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f800045a0 0x7f7f800049d0 secure :-1 s=READY pgs=526 cs=0 l=1 rx=0x7f7f84007f00 tx=0x7f7f840117e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f92ffd700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f800045a0 0x7f7f800049d0 secure :-1 s=THROTTLE_DONE pgs=526 cs=0 l=1 rx=0x7f7f84007f00 tx=0x7f7f840117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 -- 172.21.15.84:0/1596297662 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f840100a0 con 0x7f7f800045a0 2020-01-16T05:48:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f92ffd700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f800045a0 0x7f7f800049d0 secure :-1 s=THROTTLE_DONE pgs=526 cs=0 l=1 rx=0x7f7f84007f00 tx=0x7f7f840117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:50.140 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f92ffd700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f800045a0 0x7f7f800049d0 secure :-1 s=THROTTLE_DONE pgs=526 cs=0 l=1 rx=0x7f7f84007f00 tx=0x7f7f840117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:50.140 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 -- 172.21.15.84:0/1596297662 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f84007160 con 0x7f7f800045a0 2020-01-16T05:48:50.140 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f98ff9700 1 -- 172.21.15.84:0/1596297662 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f84005da0 con 0x7f7f800045a0 2020-01-16T05:48:50.140 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f92ffd700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f800045a0 0x7f7f800049d0 secure :-1 s=THROTTLE_DONE pgs=526 cs=0 l=1 rx=0x7f7f84007f00 tx=0x7f7f840117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:50.140 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.124+0000 7f7f9bfff700 1 -- 172.21.15.84:0/1596297662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f74003360 con 0x7f7f800045a0 2020-01-16T05:48:50.140 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.128+0000 7f7f98ff9700 1 -- 172.21.15.84:0/1596297662 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f7f8400f1d0 con 0x7f7f800045a0 2020-01-16T05:48:50.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.128+0000 7f7f92ffd700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f800045a0 0x7f7f800049d0 secure :-1 s=THROTTLE_DONE pgs=526 cs=0 l=1 rx=0x7f7f84007f00 tx=0x7f7f840117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:50.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.128+0000 7f7f98ff9700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7f800450d0 0x7f7f800475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:50.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.128+0000 7f7f98ff9700 1 -- 172.21.15.84:0/1596297662 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f7f8404d390 con 0x7f7f800045a0 2020-01-16T05:48:50.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.128+0000 7f7f9b7fe700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7f800450d0 0x7f7f800475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:50.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.128+0000 7f7f9b7fe700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7f800450d0 0x7f7f800475e0 crc :-1 s=READY pgs=202 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:50.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.132+0000 7f7f92ffd700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f800045a0 0x7f7f800049d0 secure :-1 s=THROTTLE_DONE pgs=526 cs=0 l=1 rx=0x7f7f84007f00 tx=0x7f7f840117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:50.141 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.132+0000 7f7f98ff9700 1 -- 172.21.15.84:0/1596297662 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f7f840352c0 con 0x7f7f800045a0 2020-01-16T05:48:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.280+0000 7f7f9bfff700 1 -- 172.21.15.84:0/1596297662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f74003790 con 0x7f7f800045a0 2020-01-16T05:48:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.284+0000 7f7f92ffd700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f800045a0 0x7f7f800049d0 secure :-1 s=THROTTLE_DONE pgs=526 cs=0 l=1 rx=0x7f7f84007f00 tx=0x7f7f840117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.284+0000 7f7f98ff9700 1 -- 172.21.15.84:0/1596297662 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f7f840347e0 con 0x7f7f800045a0 2020-01-16T05:48:50.283 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:50.283 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.284+0000 7f7f9bfff700 1 -- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7f800450d0 msgr2=0x7f7f800475e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.284+0000 7f7f9bfff700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f7f800450d0 0x7f7f800475e0 crc :-1 s=READY pgs=202 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.284+0000 7f7f9bfff700 1 -- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f800045a0 msgr2=0x7f7f800049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.284+0000 7f7f9bfff700 1 --2- 172.21.15.84:0/1596297662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f800045a0 0x7f7f800049d0 secure :-1 s=READY pgs=526 cs=0 l=1 rx=0x7f7f84007f00 tx=0x7f7f840117e0).stop 2020-01-16T05:48:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.284+0000 7f7fa1638700 1 -- 172.21.15.84:0/1596297662 reap_dead start 2020-01-16T05:48:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.284+0000 7f7f9bfff700 1 -- 172.21.15.84:0/1596297662 shutdown_connections 2020-01-16T05:48:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.284+0000 7f7f9bfff700 1 -- 172.21.15.84:0/1596297662 shutdown_connections 2020-01-16T05:48:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.284+0000 7f7f9bfff700 1 -- 172.21.15.84:0/1596297662 wait complete. 2020-01-16T05:48:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:50.284+0000 7f7f9bfff700 1 -- 172.21.15.84:0/1596297662 >> 172.21.15.84:0/1596297662 conn(0x7f7f9c0acfc0 msgr2=0x7f7f9c024ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:50.295 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:52.296 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:52.418 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89cd02700 1 Processor -- start 2020-01-16T05:48:52.418 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89cd02700 1 -- start start 2020-01-16T05:48:52.419 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89cd02700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8980a9b30 0x7fa8980abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:52.419 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89cd02700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8980a4250 0x7fa898066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:52.419 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89cd02700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa898066dd0 con 0x7fa89807ff10 2020-01-16T05:48:52.419 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89cd02700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8980a4830 con 0x7fa8980a4250 2020-01-16T05:48:52.419 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89cd02700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89807f9d0 con 0x7fa8980a9b30 2020-01-16T05:48:52.419 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89df64700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8980a4250 0x7fa898066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:52.419 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89df64700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8980a4250 0x7fa898066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36700/0 (socket says 172.21.15.84:36700) 2020-01-16T05:48:52.420 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89df64700 1 -- 172.21.15.84:0/3785977436 learned_addr learned my addr 172.21.15.84:0/3785977436 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:52.420 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa897fff700 1 --2- 172.21.15.84:0/3785977436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8980a9b30 0x7fa8980abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:52.420 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89df64700 1 -- 172.21.15.84:0/3785977436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8980a9b30 msgr2=0x7fa8980abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:52.420 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89df64700 1 --2- 172.21.15.84:0/3785977436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8980a9b30 0x7fa8980abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:52.420 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89df64700 1 -- 172.21.15.84:0/3785977436 >> v1:172.21.15.142:6789/0 conn(0x7fa89807ff10 legacy=0x7fa8980a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:52.420 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89df64700 1 -- 172.21.15.84:0/3785977436 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa898150ce0 con 0x7fa8980a4250 2020-01-16T05:48:52.420 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89df64700 1 --2- 172.21.15.84:0/3785977436 >> v2:172.21.15.84:3300/0 conn(0x7fa8980a4250 0x7fa898066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa890008c90 tx=0x7fa890010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:52.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89df64700 1 --2- 172.21.15.84:0/3785977436 >> v2:172.21.15.84:3300/0 conn(0x7fa8980a4250 0x7fa898066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa890008c90 tx=0x7fa890010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:52.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89df64700 1 --2- 172.21.15.84:0/3785977436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8980a4250 0x7fa898066880 secure :-1 s=READY pgs=527 cs=0 l=1 rx=0x7fa890008c90 tx=0x7fa890010230).ready entity=mon.0 client_cookie=869bf34b36960a4c server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:52.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89df64700 1 --2- 172.21.15.84:0/3785977436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8980a4250 0x7fa898066880 secure :-1 s=THROTTLE_DONE pgs=527 cs=0 l=1 rx=0x7fa890008c90 tx=0x7fa890010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:52.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89df64700 1 --2- 172.21.15.84:0/3785977436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8980a4250 0x7fa898066880 secure :-1 s=THROTTLE_DONE pgs=527 cs=0 l=1 rx=0x7fa890008c90 tx=0x7fa890010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:52.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa896ffd700 1 -- 172.21.15.84:0/3785977436 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa89000a160 con 0x7fa8980a4250 2020-01-16T05:48:52.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89df64700 1 --2- 172.21.15.84:0/3785977436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8980a4250 0x7fa898066880 secure :-1 s=THROTTLE_DONE pgs=527 cs=0 l=1 rx=0x7fa890008c90 tx=0x7fa890010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:52.421 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa896ffd700 1 -- 172.21.15.84:0/3785977436 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa890011bb0 con 0x7fa8980a4250 2020-01-16T05:48:52.422 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa896ffd700 1 -- 172.21.15.84:0/3785977436 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa89000a740 con 0x7fa8980a4250 2020-01-16T05:48:52.422 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89cd02700 1 -- 172.21.15.84:0/3785977436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8980a4250 msgr2=0x7fa898066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:52.422 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.416+0000 7fa89cd02700 1 --2- 172.21.15.84:0/3785977436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8980a4250 0x7fa898066880 secure :-1 s=READY pgs=527 cs=0 l=1 rx=0x7fa890008c90 tx=0x7fa890010230).stop 2020-01-16T05:48:52.422 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa89cd02700 1 -- 172.21.15.84:0/3785977436 shutdown_connections 2020-01-16T05:48:52.422 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa89cd02700 1 --2- 172.21.15.84:0/3785977436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8980a4250 0x7fa898066880 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:52.422 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa89cd02700 1 --2- 172.21.15.84:0/3785977436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8980a9b30 0x7fa8980abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:52.422 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa89cd02700 1 -- 172.21.15.84:0/3785977436 shutdown_connections 2020-01-16T05:48:52.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa89cd02700 1 -- 172.21.15.84:0/3785977436 wait complete. 2020-01-16T05:48:52.423 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa89cd02700 1 -- 172.21.15.84:0/3785977436 >> 172.21.15.84:0/3785977436 conn(0x7fa8980acfc0 msgr2=0x7fa8980a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:52.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa89cd02700 1 Processor -- start 2020-01-16T05:48:52.426 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa89cd02700 1 -- start start 2020-01-16T05:48:52.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa89cd02700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa8980a6c60 0x7fa898138780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:52.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa89cd02700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89813d5e0 0x7fa89813fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:52.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa89cd02700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa898134be0 con 0x7fa898138cd0 2020-01-16T05:48:52.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa89cd02700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8981384e0 con 0x7fa8980a6c60 2020-01-16T05:48:52.427 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa89cd02700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8981381a0 con 0x7fa89813d5e0 2020-01-16T05:48:52.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa8977fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa898138cd0 0x7fa898128b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53904/0 (socket says 172.21.15.84:53904) 2020-01-16T05:48:52.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa8977fe700 1 -- 172.21.15.84:0/1660931025 learned_addr learned my addr 172.21.15.84:0/1660931025 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:52.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa897fff700 1 --2- 172.21.15.84:0/1660931025 >> v2:172.21.15.142:3300/0 conn(0x7fa8980a6c60 0x7fa898138780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:52.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa89df64700 1 --2- 172.21.15.84:0/1660931025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89813d5e0 0x7fa89813fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:52.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa894ff9700 1 -- 172.21.15.84:0/1660931025 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435177431 0 0) 0x7fa898134be0 con 0x7fa898138cd0 2020-01-16T05:48:52.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.420+0000 7fa894ff9700 1 -- 172.21.15.84:0/1660931025 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa878003230 con 0x7fa898138cd0 2020-01-16T05:48:52.428 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa897fff700 1 -- 172.21.15.84:0/1660931025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89813d5e0 msgr2=0x7fa89813fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:52.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa897fff700 1 --2- 172.21.15.84:0/1660931025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89813d5e0 0x7fa89813fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:52.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa897fff700 1 -- 172.21.15.84:0/1660931025 >> v1:172.21.15.84:6789/0 conn(0x7fa898138cd0 legacy=0x7fa898128b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:52.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa897fff700 1 -- 172.21.15.84:0/1660931025 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8981299c0 con 0x7fa8980a6c60 2020-01-16T05:48:52.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa897fff700 1 --2- 172.21.15.84:0/1660931025 >> v2:172.21.15.142:3300/0 conn(0x7fa8980a6c60 0x7fa898138780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa888002f30 tx=0x7fa888010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:52.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa897fff700 1 --2- 172.21.15.84:0/1660931025 >> v2:172.21.15.142:3300/0 conn(0x7fa8980a6c60 0x7fa898138780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa888002f30 tx=0x7fa888010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:52.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa897fff700 1 --2- 172.21.15.84:0/1660931025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8980a6c60 0x7fa898138780 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7fa888002f30 tx=0x7fa888010b40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:52.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa897fff700 1 --2- 172.21.15.84:0/1660931025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8980a6c60 0x7fa898138780 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fa888002f30 tx=0x7fa888010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:52.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa894ff9700 1 -- 172.21.15.84:0/1660931025 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa888005b40 con 0x7fa8980a6c60 2020-01-16T05:48:52.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa897fff700 1 --2- 172.21.15.84:0/1660931025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8980a6c60 0x7fa898138780 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fa888002f30 tx=0x7fa888010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:52.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa894ff9700 1 -- 172.21.15.84:0/1660931025 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa888005760 con 0x7fa8980a6c60 2020-01-16T05:48:52.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa897fff700 1 --2- 172.21.15.84:0/1660931025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8980a6c60 0x7fa898138780 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fa888002f30 tx=0x7fa888010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:52.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa89cd02700 1 -- 172.21.15.84:0/1660931025 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa898135a20 con 0x7fa8980a6c60 2020-01-16T05:48:52.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa894ff9700 1 -- 172.21.15.84:0/1660931025 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa888012860 con 0x7fa8980a6c60 2020-01-16T05:48:52.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa89cd02700 1 -- 172.21.15.84:0/1660931025 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa898129390 con 0x7fa8980a6c60 2020-01-16T05:48:52.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa897fff700 1 --2- 172.21.15.84:0/1660931025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8980a6c60 0x7fa898138780 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fa888002f30 tx=0x7fa888010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:52.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa89cd02700 1 -- 172.21.15.84:0/1660931025 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89805e1c0 con 0x7fa8980a6c60 2020-01-16T05:48:52.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa894ff9700 1 -- 172.21.15.84:0/1660931025 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fa888012b40 con 0x7fa8980a6c60 2020-01-16T05:48:52.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa897fff700 1 --2- 172.21.15.84:0/1660931025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8980a6c60 0x7fa898138780 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fa888002f30 tx=0x7fa888010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:52.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa894ff9700 1 --2- 172.21.15.84:0/1660931025 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa87803c7e0 0x7fa87803ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:52.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.424+0000 7fa894ff9700 1 -- 172.21.15.84:0/1660931025 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fa88804cbf0 con 0x7fa8980a6c60 2020-01-16T05:48:52.431 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.428+0000 7fa8977fe700 1 --2- 172.21.15.84:0/1660931025 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa87803c7e0 0x7fa87803ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:52.432 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.428+0000 7fa8977fe700 1 --2- 172.21.15.84:0/1660931025 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa87803c7e0 0x7fa87803ecf0 crc :-1 s=READY pgs=203 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:52.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.436+0000 7fa897fff700 1 --2- 172.21.15.84:0/1660931025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8980a6c60 0x7fa898138780 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fa888002f30 tx=0x7fa888010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:52.434 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.436+0000 7fa894ff9700 1 -- 172.21.15.84:0/1660931025 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fa8880331f0 con 0x7fa8980a6c60 2020-01-16T05:48:52.589 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.588+0000 7fa89cd02700 1 -- 172.21.15.84:0/1660931025 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa89809fce0 con 0x7fa8980a6c60 2020-01-16T05:48:52.590 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.592+0000 7fa897fff700 1 --2- 172.21.15.84:0/1660931025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8980a6c60 0x7fa898138780 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fa888002f30 tx=0x7fa888010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:52.590 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.592+0000 7fa894ff9700 1 -- 172.21.15.84:0/1660931025 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fa888033450 con 0x7fa8980a6c60 2020-01-16T05:48:52.590 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:52.590 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:52.598 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.592+0000 7fa89cd02700 1 -- 172.21.15.84:0/1660931025 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa87803c7e0 msgr2=0x7fa87803ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:52.599 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.592+0000 7fa89cd02700 1 --2- 172.21.15.84:0/1660931025 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa87803c7e0 0x7fa87803ecf0 crc :-1 s=READY pgs=203 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:52.599 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.592+0000 7fa89cd02700 1 -- 172.21.15.84:0/1660931025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8980a6c60 msgr2=0x7fa898138780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:52.599 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.592+0000 7fa89cd02700 1 --2- 172.21.15.84:0/1660931025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8980a6c60 0x7fa898138780 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7fa888002f30 tx=0x7fa888010b40).stop 2020-01-16T05:48:52.599 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.592+0000 7fa89cd02700 1 -- 172.21.15.84:0/1660931025 shutdown_connections 2020-01-16T05:48:52.599 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.592+0000 7fa89cd02700 1 --2- 172.21.15.84:0/1660931025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89813d5e0 0x7fa89813fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:52.600 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.592+0000 7fa89cd02700 1 --2- 172.21.15.84:0/1660931025 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa87803c7e0 0x7fa87803ecf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:52.600 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.592+0000 7fa89cd02700 1 --2- 172.21.15.84:0/1660931025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8980a6c60 0x7fa898138780 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:52.600 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.592+0000 7fa89cd02700 1 -- 172.21.15.84:0/1660931025 shutdown_connections 2020-01-16T05:48:52.600 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.592+0000 7fa89cd02700 1 -- 172.21.15.84:0/1660931025 wait complete. 2020-01-16T05:48:52.600 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:52.592+0000 7fa89cd02700 1 -- 172.21.15.84:0/1660931025 >> 172.21.15.84:0/1660931025 conn(0x7fa898066650 msgr2=0x7fa8980246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:52.601 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:52.603 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:53.207 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~266s 2020-01-16T05:48:54.604 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:54.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.724+0000 7fec2e2fb700 1 Processor -- start 2020-01-16T05:48:54.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.724+0000 7fec2e2fb700 1 -- start start 2020-01-16T05:48:54.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.724+0000 7fec2e2fb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fec280a9b30 0x7fec280abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:54.729 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.724+0000 7fec2e2fb700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec28066880 con 0x7fec2807ff10 2020-01-16T05:48:54.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.724+0000 7fec2e2fb700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec28066ab0 con 0x7fec280a4250 2020-01-16T05:48:54.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.724+0000 7fec2e2fb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec280a4830 con 0x7fec280a9b30 2020-01-16T05:48:54.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.724+0000 7fec2dafa700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fec280a9b30 0x7fec280abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:54.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.724+0000 7fec2dafa700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fec280a9b30 0x7fec280abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36712/0 (socket says 172.21.15.84:36712) 2020-01-16T05:48:54.730 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.724+0000 7fec2dafa700 1 -- 172.21.15.84:0/97257186 learned_addr learned my addr 172.21.15.84:0/97257186 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:54.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2dafa700 1 -- 172.21.15.84:0/97257186 >> v1:172.21.15.142:6789/0 conn(0x7fec280a4250 legacy=0x7fec2814fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:54.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2dafa700 1 -- 172.21.15.84:0/97257186 >> v1:172.21.15.84:6789/0 conn(0x7fec2807ff10 legacy=0x7fec280a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:54.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2caf8700 1 -- 172.21.15.84:0/97257186 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713575430 0 0) 0x7fec28066880 con 0x7fec2807ff10 2020-01-16T05:48:54.731 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2dafa700 1 -- 172.21.15.84:0/97257186 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec28066ce0 con 0x7fec280a9b30 2020-01-16T05:48:54.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2dafa700 1 --2- 172.21.15.84:0/97257186 >> v2:172.21.15.84:3300/0 conn(0x7fec280a9b30 0x7fec280abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fec18008c90 tx=0x7fec180101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:54.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2dafa700 1 --2- 172.21.15.84:0/97257186 >> v2:172.21.15.84:3300/0 conn(0x7fec280a9b30 0x7fec280abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fec18008c90 tx=0x7fec180101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:54.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2dafa700 1 --2- 172.21.15.84:0/97257186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec280a9b30 0x7fec280abdd0 secure :-1 s=READY pgs=530 cs=0 l=1 rx=0x7fec18008c90 tx=0x7fec180101b0).ready entity=mon.0 client_cookie=43dee68f2e6b1e8d server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:54.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2dafa700 1 --2- 172.21.15.84:0/97257186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec280a9b30 0x7fec280abdd0 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7fec18008c90 tx=0x7fec180101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:54.732 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2caf8700 1 -- 172.21.15.84:0/97257186 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1800a160 con 0x7fec280a9b30 2020-01-16T05:48:54.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2dafa700 1 --2- 172.21.15.84:0/97257186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec280a9b30 0x7fec280abdd0 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7fec18008c90 tx=0x7fec180101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:54.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2dafa700 1 --2- 172.21.15.84:0/97257186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec280a9b30 0x7fec280abdd0 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7fec18008c90 tx=0x7fec180101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:54.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2caf8700 1 -- 172.21.15.84:0/97257186 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec18011c20 con 0x7fec280a9b30 2020-01-16T05:48:54.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2caf8700 1 -- 172.21.15.84:0/97257186 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1800a740 con 0x7fec280a9b30 2020-01-16T05:48:54.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2e2fb700 1 -- 172.21.15.84:0/97257186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec280a9b30 msgr2=0x7fec280abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:54.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2e2fb700 1 --2- 172.21.15.84:0/97257186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec280a9b30 0x7fec280abdd0 secure :-1 s=READY pgs=530 cs=0 l=1 rx=0x7fec18008c90 tx=0x7fec180101b0).stop 2020-01-16T05:48:54.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2e2fb700 1 -- 172.21.15.84:0/97257186 shutdown_connections 2020-01-16T05:48:54.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2e2fb700 1 --2- 172.21.15.84:0/97257186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec280a9b30 0x7fec280abdd0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:54.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2e2fb700 1 -- 172.21.15.84:0/97257186 shutdown_connections 2020-01-16T05:48:54.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2e2fb700 1 -- 172.21.15.84:0/97257186 wait complete. 2020-01-16T05:48:54.735 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.728+0000 7fec2e2fb700 1 -- 172.21.15.84:0/97257186 >> 172.21.15.84:0/97257186 conn(0x7fec280acfc0 msgr2=0x7fec280a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:54.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.732+0000 7fec2e2fb700 1 Processor -- start 2020-01-16T05:48:54.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.732+0000 7fec2e2fb700 1 -- start start 2020-01-16T05:48:54.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.732+0000 7fec2e2fb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec280a8930 0x7fec280a27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:54.741 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.732+0000 7fec2e2fb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fec2809eb20 0x7fec2809ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:54.742 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.732+0000 7fec2e2fb700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec28137010 con 0x7fec2807c5b0 2020-01-16T05:48:54.742 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.732+0000 7fec2e2fb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec281362b0 con 0x7fec2809eb20 2020-01-16T05:48:54.742 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.732+0000 7fec2e2fb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2807cb20 con 0x7fec280a8930 2020-01-16T05:48:54.742 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.732+0000 7fec2dafa700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fec2807c5b0 0x7fec28136810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53918/0 (socket says 172.21.15.84:53918) 2020-01-16T05:48:54.743 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.732+0000 7fec2dafa700 1 -- 172.21.15.84:0/1829874331 learned_addr learned my addr 172.21.15.84:0/1829874331 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:54.743 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.732+0000 7fec2f55d700 1 --2- 172.21.15.84:0/1829874331 >> v2:172.21.15.84:3300/0 conn(0x7fec2809eb20 0x7fec2809ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:54.743 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.732+0000 7fec2d2f9700 1 --2- 172.21.15.84:0/1829874331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec280a8930 0x7fec280a27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:54.743 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.732+0000 7fec267fc700 1 -- 172.21.15.84:0/1829874331 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965792489 0 0) 0x7fec28137010 con 0x7fec2807c5b0 2020-01-16T05:48:54.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.732+0000 7fec267fc700 1 -- 172.21.15.84:0/1829874331 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec08003230 con 0x7fec2807c5b0 2020-01-16T05:48:54.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.732+0000 7fec2f55d700 1 -- 172.21.15.84:0/1829874331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec280a8930 msgr2=0x7fec280a27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:54.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.732+0000 7fec2f55d700 1 --2- 172.21.15.84:0/1829874331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec280a8930 0x7fec280a27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:54.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.732+0000 7fec2f55d700 1 -- 172.21.15.84:0/1829874331 >> v1:172.21.15.84:6789/0 conn(0x7fec2807c5b0 legacy=0x7fec28136810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:54.744 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.732+0000 7fec2f55d700 1 -- 172.21.15.84:0/1829874331 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2807d060 con 0x7fec2809eb20 2020-01-16T05:48:54.745 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.732+0000 7fec2f55d700 1 --2- 172.21.15.84:0/1829874331 >> v2:172.21.15.84:3300/0 conn(0x7fec2809eb20 0x7fec2809ef50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fec2807cce0 tx=0x7fec200109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:54.745 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.736+0000 7fec2f55d700 1 --2- 172.21.15.84:0/1829874331 >> v2:172.21.15.84:3300/0 conn(0x7fec2809eb20 0x7fec2809ef50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fec2807cce0 tx=0x7fec200109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:54.745 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.736+0000 7fec2f55d700 1 --2- 172.21.15.84:0/1829874331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec2809eb20 0x7fec2809ef50 secure :-1 s=READY pgs=532 cs=0 l=1 rx=0x7fec2807cce0 tx=0x7fec200109b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:54.745 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.736+0000 7fec2f55d700 1 --2- 172.21.15.84:0/1829874331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec2809eb20 0x7fec2809ef50 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7fec2807cce0 tx=0x7fec200109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:54.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.736+0000 7fec267fc700 1 -- 172.21.15.84:0/1829874331 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec200069d0 con 0x7fec2809eb20 2020-01-16T05:48:54.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.736+0000 7fec2f55d700 1 --2- 172.21.15.84:0/1829874331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec2809eb20 0x7fec2809ef50 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7fec2807cce0 tx=0x7fec200109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:54.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.736+0000 7fec2f55d700 1 --2- 172.21.15.84:0/1829874331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec2809eb20 0x7fec2809ef50 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7fec2807cce0 tx=0x7fec200109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:54.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.736+0000 7fec267fc700 1 -- 172.21.15.84:0/1829874331 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec20001e10 con 0x7fec2809eb20 2020-01-16T05:48:54.746 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.736+0000 7fec267fc700 1 -- 172.21.15.84:0/1829874331 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec20002070 con 0x7fec2809eb20 2020-01-16T05:48:54.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.736+0000 7fec2e2fb700 1 -- 172.21.15.84:0/1829874331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2809f4a0 con 0x7fec2809eb20 2020-01-16T05:48:54.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.736+0000 7fec2e2fb700 1 -- 172.21.15.84:0/1829874331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2813d700 con 0x7fec2809eb20 2020-01-16T05:48:54.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.736+0000 7fec2f55d700 1 --2- 172.21.15.84:0/1829874331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec2809eb20 0x7fec2809ef50 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7fec2807cce0 tx=0x7fec200109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:54.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.736+0000 7fec267fc700 1 -- 172.21.15.84:0/1829874331 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fec20002390 con 0x7fec2809eb20 2020-01-16T05:48:54.747 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.736+0000 7fec2f55d700 1 --2- 172.21.15.84:0/1829874331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec2809eb20 0x7fec2809ef50 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7fec2807cce0 tx=0x7fec200109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:54.748 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.736+0000 7fec2e2fb700 1 -- 172.21.15.84:0/1829874331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2805e1c0 con 0x7fec2809eb20 2020-01-16T05:48:54.749 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.736+0000 7fec267fc700 1 --2- 172.21.15.84:0/1829874331 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fec0803c7d0 0x7fec0803ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:54.749 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.736+0000 7fec267fc700 1 -- 172.21.15.84:0/1829874331 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fec2004c850 con 0x7fec2809eb20 2020-01-16T05:48:54.749 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.736+0000 7fec2dafa700 1 --2- 172.21.15.84:0/1829874331 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fec0803c7d0 0x7fec0803ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:54.749 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.736+0000 7fec2dafa700 1 --2- 172.21.15.84:0/1829874331 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fec0803c7d0 0x7fec0803ece0 crc :-1 s=READY pgs=204 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:54.750 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.740+0000 7fec2f55d700 1 --2- 172.21.15.84:0/1829874331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec2809eb20 0x7fec2809ef50 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7fec2807cce0 tx=0x7fec200109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:54.750 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.740+0000 7fec267fc700 1 -- 172.21.15.84:0/1829874331 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fec2809f4a0 con 0x7fec2809eb20 2020-01-16T05:48:54.894 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.896+0000 7fec2e2fb700 1 -- 172.21.15.84:0/1829874331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec280a8d60 con 0x7fec2809eb20 2020-01-16T05:48:54.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.896+0000 7fec2f55d700 1 --2- 172.21.15.84:0/1829874331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec2809eb20 0x7fec2809ef50 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7fec2807cce0 tx=0x7fec200109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:54.895 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.896+0000 7fec267fc700 1 -- 172.21.15.84:0/1829874331 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fec20032e50 con 0x7fec2809eb20 2020-01-16T05:48:54.895 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:54.896 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:54.897 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.896+0000 7fec2e2fb700 1 -- 172.21.15.84:0/1829874331 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fec0803c7d0 msgr2=0x7fec0803ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:54.897 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.896+0000 7fec2e2fb700 1 --2- 172.21.15.84:0/1829874331 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fec0803c7d0 0x7fec0803ece0 crc :-1 s=READY pgs=204 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:54.897 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.896+0000 7fec2e2fb700 1 -- 172.21.15.84:0/1829874331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec2809eb20 msgr2=0x7fec2809ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:54.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.896+0000 7fec2e2fb700 1 --2- 172.21.15.84:0/1829874331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec2809eb20 0x7fec2809ef50 secure :-1 s=READY pgs=532 cs=0 l=1 rx=0x7fec2807cce0 tx=0x7fec200109b0).stop 2020-01-16T05:48:54.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.896+0000 7fec2e2fb700 1 -- 172.21.15.84:0/1829874331 shutdown_connections 2020-01-16T05:48:54.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.896+0000 7fec2e2fb700 1 --2- 172.21.15.84:0/1829874331 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fec0803c7d0 0x7fec0803ece0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:54.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.896+0000 7fec2e2fb700 1 --2- 172.21.15.84:0/1829874331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec2809eb20 0x7fec2809ef50 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:54.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.896+0000 7fec2e2fb700 1 --2- 172.21.15.84:0/1829874331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec280a8930 0x7fec280a27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:54.898 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.900+0000 7fec2e2fb700 1 -- 172.21.15.84:0/1829874331 shutdown_connections 2020-01-16T05:48:54.899 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.900+0000 7fec2e2fb700 1 -- 172.21.15.84:0/1829874331 wait complete. 2020-01-16T05:48:54.899 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:54.900+0000 7fec2e2fb700 1 -- 172.21.15.84:0/1829874331 >> 172.21.15.84:0/1829874331 conn(0x7fec2805f2f0 msgr2=0x7fec280246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:54.899 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:54.908 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:48:56.909 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:57.043 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.028+0000 7efe2a042700 1 Processor -- start 2020-01-16T05:48:57.043 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.028+0000 7efe2a042700 1 -- start start 2020-01-16T05:48:57.043 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2a042700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efe240a4250 0x7efe240abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:57.044 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2a042700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe24066880 con 0x7efe240a9b30 2020-01-16T05:48:57.044 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2a042700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe24066ab0 con 0x7efe2407ff10 2020-01-16T05:48:57.044 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2a042700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe240a4830 con 0x7efe240a4250 2020-01-16T05:48:57.044 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe29841700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7efe240a9b30 0x7efe240a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53934/0 (socket says 172.21.15.84:53934) 2020-01-16T05:48:57.045 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe29841700 1 -- 172.21.15.84:0/1386760 learned_addr learned my addr 172.21.15.84:0/1386760 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:57.045 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2b2a4700 1 --2- 172.21.15.84:0/1386760 >> v2:172.21.15.142:3300/0 conn(0x7efe240a4250 0x7efe240abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:57.045 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2883f700 1 -- 172.21.15.84:0/1386760 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265284448 0 0) 0x7efe24066880 con 0x7efe240a9b30 2020-01-16T05:48:57.045 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2883f700 1 -- 172.21.15.84:0/1386760 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe10003230 con 0x7efe240a9b30 2020-01-16T05:48:57.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2883f700 1 -- 172.21.15.84:0/1386760 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1416790682 0 0) 0x7efe10003230 con 0x7efe240a9b30 2020-01-16T05:48:57.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2883f700 1 -- 172.21.15.84:0/1386760 >> v2:172.21.15.142:3300/0 conn(0x7efe240a4250 msgr2=0x7efe240abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:57.046 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2883f700 1 --2- 172.21.15.84:0/1386760 >> v2:172.21.15.142:3300/0 conn(0x7efe240a4250 0x7efe240abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:57.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2883f700 1 -- 172.21.15.84:0/1386760 >> v1:172.21.15.142:6789/0 conn(0x7efe2407ff10 legacy=0x7efe2414dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:57.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2883f700 1 -- 172.21.15.84:0/1386760 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe24066ce0 con 0x7efe240a9b30 2020-01-16T05:48:57.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2883f700 1 -- 172.21.15.84:0/1386760 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7efe1c001ad0 con 0x7efe240a9b30 2020-01-16T05:48:57.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2883f700 1 -- 172.21.15.84:0/1386760 >> v1:172.21.15.84:6789/0 conn(0x7efe240a9b30 legacy=0x7efe240a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:57.047 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2883f700 1 --2- 172.21.15.84:0/1386760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe10003860 0x7efe10003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:57.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2883f700 1 --2- 172.21.15.84:0/1386760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe100045a0 0x7efe100049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:57.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2883f700 1 --2- 172.21.15.84:0/1386760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe10004f20 0x7efe1000b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:57.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2883f700 1 -- 172.21.15.84:0/1386760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe240a4830 con 0x7efe100045a0 2020-01-16T05:48:57.048 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2883f700 1 -- 172.21.15.84:0/1386760 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1004fd80 con 0x7efe10004f20 2020-01-16T05:48:57.049 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2883f700 1 -- 172.21.15.84:0/1386760 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1004ffc0 con 0x7efe10003860 2020-01-16T05:48:57.049 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe29841700 1 --2- 172.21.15.84:0/1386760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe10003860 0x7efe10003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:57.049 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe29040700 1 --2- 172.21.15.84:0/1386760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe100045a0 0x7efe100049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:57.049 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2b2a4700 1 --2- 172.21.15.84:0/1386760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe10004f20 0x7efe1000b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:57.049 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe29841700 1 -- 172.21.15.84:0/1386760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe10004f20 msgr2=0x7efe1000b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe29841700 1 --2- 172.21.15.84:0/1386760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe10004f20 0x7efe1000b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe29841700 1 -- 172.21.15.84:0/1386760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe100045a0 msgr2=0x7efe100049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe29841700 1 --2- 172.21.15.84:0/1386760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe100045a0 0x7efe100049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe29841700 1 -- 172.21.15.84:0/1386760 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe100502c0 con 0x7efe10003860 2020-01-16T05:48:57.051 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2b2a4700 1 -- 172.21.15.84:0/1386760 reap_dead start 2020-01-16T05:48:57.051 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe29841700 1 --2- 172.21.15.84:0/1386760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe10003860 0x7efe10003c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efe1c001360 tx=0x7efe1c00c620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:57.051 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe29841700 1 --2- 172.21.15.84:0/1386760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe10003860 0x7efe10003c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efe1c001360 tx=0x7efe1c00c620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:57.051 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe29841700 1 --2- 172.21.15.84:0/1386760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe10003860 0x7efe10003c90 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7efe1c001360 tx=0x7efe1c00c620).ready entity=mon.2 client_cookie=47379b1c8a73bb63 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:57.051 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe29841700 1 --2- 172.21.15.84:0/1386760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe10003860 0x7efe10003c90 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7efe1c001360 tx=0x7efe1c00c620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:57.052 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2883f700 1 -- 172.21.15.84:0/1386760 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe1c005d40 con 0x7efe10003860 2020-01-16T05:48:57.052 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe29841700 1 --2- 172.21.15.84:0/1386760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe10003860 0x7efe10003c90 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7efe1c001360 tx=0x7efe1c00c620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:57.052 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2883f700 1 -- 172.21.15.84:0/1386760 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c005960 con 0x7efe10003860 2020-01-16T05:48:57.052 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe29841700 1 --2- 172.21.15.84:0/1386760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe10003860 0x7efe10003c90 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7efe1c001360 tx=0x7efe1c00c620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:57.053 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2883f700 1 -- 172.21.15.84:0/1386760 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe1c005010 con 0x7efe10003860 2020-01-16T05:48:57.053 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2a042700 1 -- 172.21.15.84:0/1386760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe10003860 msgr2=0x7efe10003c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:57.053 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.032+0000 7efe2a042700 1 --2- 172.21.15.84:0/1386760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe10003860 0x7efe10003c90 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7efe1c001360 tx=0x7efe1c00c620).stop 2020-01-16T05:48:57.053 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe2a042700 1 -- 172.21.15.84:0/1386760 shutdown_connections 2020-01-16T05:48:57.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe2a042700 1 --2- 172.21.15.84:0/1386760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe10003860 0x7efe10003c90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:57.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe2a042700 1 -- 172.21.15.84:0/1386760 shutdown_connections 2020-01-16T05:48:57.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe2a042700 1 -- 172.21.15.84:0/1386760 wait complete. 2020-01-16T05:48:57.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe2a042700 1 -- 172.21.15.84:0/1386760 >> 172.21.15.84:0/1386760 conn(0x7efe240acfc0 msgr2=0x7efe240a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:57.054 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe2a042700 1 Processor -- start 2020-01-16T05:48:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe2a042700 1 -- start start 2020-01-16T05:48:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe2a042700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe24138320 0x7efe24090be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe2a042700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe240a3630 con 0x7efe240a3200 2020-01-16T05:48:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe2a042700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe24066460 con 0x7efe2405bd50 2020-01-16T05:48:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe2a042700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe24090480 con 0x7efe24138320 2020-01-16T05:48:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe29841700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7efe2405bd50 0x7efe24137b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:52172/0 (socket says 172.21.15.84:52172) 2020-01-16T05:48:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe29841700 1 -- 172.21.15.84:0/936644938 learned_addr learned my addr 172.21.15.84:0/936644938 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe29040700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe24138320 0x7efe24090be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778976503 0 0) 0x7efe240a3630 con 0x7efe240a3200 2020-01-16T05:48:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe0c003230 con 0x7efe240a3200 2020-01-16T05:48:57.058 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594450791 0 0) 0x7efe24066460 con 0x7efe2405bd50 2020-01-16T05:48:57.058 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe240a3630 con 0x7efe2405bd50 2020-01-16T05:48:57.058 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1668232083 0 0) 0x7efe0c003230 con 0x7efe240a3200 2020-01-16T05:48:57.058 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.036+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efe24066460 con 0x7efe240a3200 2020-01-16T05:48:57.058 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7efe20001490 con 0x7efe240a3200 2020-01-16T05:48:57.059 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe24138320 msgr2=0x7efe24090be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:57.059 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe167fc700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe24138320 0x7efe24090be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:57.059 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 >> v1:172.21.15.142:6789/0 conn(0x7efe2405bd50 legacy=0x7efe24137b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:57.059 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 >> v1:172.21.15.84:6789/0 conn(0x7efe240a3200 legacy=0x7efe2413ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:57.060 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe167fc700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe0c003c30 0x7efe0c0045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:57.060 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe167fc700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe0c004130 0x7efe0c004b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:57.060 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe167fc700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0097e0 0x7efe0c00bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:57.060 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c00c170 con 0x7efe0c0097e0 2020-01-16T05:48:57.061 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c00c330 con 0x7efe0c004130 2020-01-16T05:48:57.061 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c00c4f0 con 0x7efe0c003c30 2020-01-16T05:48:57.061 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe29040700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe24138320 0x7efe24090be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:48:57.061 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe2b2a4700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0097e0 0x7efe0c00bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:57.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe29841700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe0c003c30 0x7efe0c0045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:57.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe29040700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe0c004130 0x7efe0c004b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:57.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe2b2a4700 1 -- 172.21.15.84:0/936644938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe0c003c30 msgr2=0x7efe0c0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:57.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe2b2a4700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe0c003c30 0x7efe0c0045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:57.062 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe2b2a4700 1 -- 172.21.15.84:0/936644938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe0c004130 msgr2=0x7efe0c004b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:57.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe2b2a4700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe0c004130 0x7efe0c004b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:57.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe2b2a4700 1 -- 172.21.15.84:0/936644938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe241427a0 con 0x7efe0c0097e0 2020-01-16T05:48:57.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe2a042700 1 -- 172.21.15.84:0/936644938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe24138320 con 0x7efe0c0097e0 2020-01-16T05:48:57.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe2b2a4700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0097e0 0x7efe0c00bc20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe20007f00 tx=0x7efe20011580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:57.063 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe2a042700 1 -- 172.21.15.84:0/936644938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe24090be0 con 0x7efe0c0097e0 2020-01-16T05:48:57.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe2b2a4700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0097e0 0x7efe0c00bc20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe20007f00 tx=0x7efe20011580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:57.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe2b2a4700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0097e0 0x7efe0c00bc20 secure :-1 s=READY pgs=535 cs=0 l=1 rx=0x7efe20007f00 tx=0x7efe20011580).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:57.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe2b2a4700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0097e0 0x7efe0c00bc20 secure :-1 s=THROTTLE_DONE pgs=535 cs=0 l=1 rx=0x7efe20007f00 tx=0x7efe20011580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:57.064 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe20005aa0 con 0x7efe0c0097e0 2020-01-16T05:48:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe2b2a4700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0097e0 0x7efe0c00bc20 secure :-1 s=THROTTLE_DONE pgs=535 cs=0 l=1 rx=0x7efe20007f00 tx=0x7efe20011580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe2b2a4700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0097e0 0x7efe0c00bc20 secure :-1 s=THROTTLE_DONE pgs=535 cs=0 l=1 rx=0x7efe20007f00 tx=0x7efe20011580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe200056c0 con 0x7efe0c0097e0 2020-01-16T05:48:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe2000b600 con 0x7efe0c0097e0 2020-01-16T05:48:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe2b2a4700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0097e0 0x7efe0c00bc20 secure :-1 s=THROTTLE_DONE pgs=535 cs=0 l=1 rx=0x7efe20007f00 tx=0x7efe20011580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:57.066 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe2a042700 1 -- 172.21.15.84:0/936644938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe00003360 con 0x7efe0c0097e0 2020-01-16T05:48:57.066 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7efe2000b800 con 0x7efe0c0097e0 2020-01-16T05:48:57.066 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe2b2a4700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0097e0 0x7efe0c00bc20 secure :-1 s=THROTTLE_DONE pgs=535 cs=0 l=1 rx=0x7efe20007f00 tx=0x7efe20011580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:57.066 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe167fc700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7efe0c0457b0 0x7efe0c047cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:57.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.040+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7efe2004d060 con 0x7efe0c0097e0 2020-01-16T05:48:57.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.044+0000 7efe29841700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7efe0c0457b0 0x7efe0c047cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:57.067 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.044+0000 7efe29841700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7efe0c0457b0 0x7efe0c047cc0 crc :-1 s=READY pgs=205 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:57.068 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.048+0000 7efe2b2a4700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0097e0 0x7efe0c00bc20 secure :-1 s=THROTTLE_DONE pgs=535 cs=0 l=1 rx=0x7efe20007f00 tx=0x7efe20011580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:57.068 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.048+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7efe200338e0 con 0x7efe0c0097e0 2020-01-16T05:48:57.198 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.200+0000 7efe2a042700 1 -- 172.21.15.84:0/936644938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe00003790 con 0x7efe0c0097e0 2020-01-16T05:48:57.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.200+0000 7efe2b2a4700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0097e0 0x7efe0c00bc20 secure :-1 s=THROTTLE_DONE pgs=535 cs=0 l=1 rx=0x7efe20007f00 tx=0x7efe20011580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:57.199 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.200+0000 7efe167fc700 1 -- 172.21.15.84:0/936644938 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7efe2000bb10 con 0x7efe0c0097e0 2020-01-16T05:48:57.199 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:57.200 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:57.202 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.204+0000 7efe2a042700 1 -- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7efe0c0457b0 msgr2=0x7efe0c047cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:57.202 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.204+0000 7efe2a042700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7efe0c0457b0 0x7efe0c047cc0 crc :-1 s=READY pgs=205 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:57.203 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.204+0000 7efe2a042700 1 -- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0097e0 msgr2=0x7efe0c00bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:57.203 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.204+0000 7efe2a042700 1 --2- 172.21.15.84:0/936644938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0097e0 0x7efe0c00bc20 secure :-1 s=READY pgs=535 cs=0 l=1 rx=0x7efe20007f00 tx=0x7efe20011580).stop 2020-01-16T05:48:57.203 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.204+0000 7efe2b2a4700 1 -- 172.21.15.84:0/936644938 reap_dead start 2020-01-16T05:48:57.203 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.204+0000 7efe2b2a4700 1 -- 172.21.15.84:0/936644938 reap_dead start 2020-01-16T05:48:57.203 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.204+0000 7efe2a042700 1 -- 172.21.15.84:0/936644938 shutdown_connections 2020-01-16T05:48:57.204 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.204+0000 7efe2a042700 1 -- 172.21.15.84:0/936644938 shutdown_connections 2020-01-16T05:48:57.204 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.204+0000 7efe2a042700 1 -- 172.21.15.84:0/936644938 wait complete. 2020-01-16T05:48:57.204 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:57.204+0000 7efe2a042700 1 -- 172.21.15.84:0/936644938 >> 172.21.15.84:0/936644938 conn(0x7efe240acfc0 msgr2=0x7efe2407da80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:57.205 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:57.221 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:48:59.222 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:48:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2b59e700 1 Processor -- start 2020-01-16T05:48:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2b59e700 1 -- start start 2020-01-16T05:48:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2b59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd2c0a9b30 0x7fdd2c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2b59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdd2c0a4250 0x7fdd2c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:48:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2b59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2c066dd0 con 0x7fdd2c07ff10 2020-01-16T05:48:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2b59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd2c0a4830 con 0x7fdd2c0a9b30 2020-01-16T05:48:59.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2b59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd2c07f9d0 con 0x7fdd2c0a4250 2020-01-16T05:48:59.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd2c0a9b30 0x7fdd2c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:59.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd2c0a9b30 0x7fdd2c0abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36762/0 (socket says 172.21.15.84:36762) 2020-01-16T05:48:59.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2ad9d700 1 -- 172.21.15.84:0/1692567969 learned_addr learned my addr 172.21.15.84:0/1692567969 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:48:59.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd30d3e700 1 --2- 172.21.15.84:0/1692567969 >> v2:172.21.15.142:3300/0 conn(0x7fdd2c0a4250 0x7fdd2c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:59.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2ad9d700 1 -- 172.21.15.84:0/1692567969 >> v2:172.21.15.142:3300/0 conn(0x7fdd2c0a4250 msgr2=0x7fdd2c066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:48:59.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2ad9d700 1 --2- 172.21.15.84:0/1692567969 >> v2:172.21.15.142:3300/0 conn(0x7fdd2c0a4250 0x7fdd2c066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:59.345 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2ad9d700 1 -- 172.21.15.84:0/1692567969 >> v1:172.21.15.84:6789/0 conn(0x7fdd2c07ff10 legacy=0x7fdd2c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2ad9d700 1 -- 172.21.15.84:0/1692567969 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c150ce0 con 0x7fdd2c0a9b30 2020-01-16T05:48:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2ad9d700 1 --2- 172.21.15.84:0/1692567969 >> v2:172.21.15.84:3300/0 conn(0x7fdd2c0a9b30 0x7fdd2c0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdd2c0a49f0 tx=0x7fdd1c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2ad9d700 1 --2- 172.21.15.84:0/1692567969 >> v2:172.21.15.84:3300/0 conn(0x7fdd2c0a9b30 0x7fdd2c0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdd2c0a49f0 tx=0x7fdd1c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2ad9d700 1 --2- 172.21.15.84:0/1692567969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd2c0a9b30 0x7fdd2c0abdd0 secure :-1 s=READY pgs=538 cs=0 l=1 rx=0x7fdd2c0a49f0 tx=0x7fdd1c010230).ready entity=mon.0 client_cookie=c94f16b6a97f533c server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2ad9d700 1 --2- 172.21.15.84:0/1692567969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd2c0a9b30 0x7fdd2c0abdd0 secure :-1 s=THROTTLE_DONE pgs=538 cs=0 l=1 rx=0x7fdd2c0a49f0 tx=0x7fdd1c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd29d9b700 1 -- 172.21.15.84:0/1692567969 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1c00a160 con 0x7fdd2c0a9b30 2020-01-16T05:48:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2ad9d700 1 --2- 172.21.15.84:0/1692567969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd2c0a9b30 0x7fdd2c0abdd0 secure :-1 s=THROTTLE_DONE pgs=538 cs=0 l=1 rx=0x7fdd2c0a49f0 tx=0x7fdd1c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:59.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2ad9d700 1 --2- 172.21.15.84:0/1692567969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd2c0a9b30 0x7fdd2c0abdd0 secure :-1 s=THROTTLE_DONE pgs=538 cs=0 l=1 rx=0x7fdd2c0a49f0 tx=0x7fdd1c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:59.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd29d9b700 1 -- 172.21.15.84:0/1692567969 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c011b70 con 0x7fdd2c0a9b30 2020-01-16T05:48:59.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd29d9b700 1 -- 172.21.15.84:0/1692567969 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1c00a740 con 0x7fdd2c0a9b30 2020-01-16T05:48:59.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2b59e700 1 -- 172.21.15.84:0/1692567969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd2c0a9b30 msgr2=0x7fdd2c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:59.347 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.340+0000 7fdd2b59e700 1 --2- 172.21.15.84:0/1692567969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd2c0a9b30 0x7fdd2c0abdd0 secure :-1 s=READY pgs=538 cs=0 l=1 rx=0x7fdd2c0a49f0 tx=0x7fdd1c010230).stop 2020-01-16T05:48:59.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.344+0000 7fdd2b59e700 1 -- 172.21.15.84:0/1692567969 shutdown_connections 2020-01-16T05:48:59.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.344+0000 7fdd2b59e700 1 --2- 172.21.15.84:0/1692567969 >> v2:172.21.15.142:3300/0 conn(0x7fdd2c0a4250 0x7fdd2c066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:48:59.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.344+0000 7fdd2b59e700 1 --2- 172.21.15.84:0/1692567969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd2c0a9b30 0x7fdd2c0abdd0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:59.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.344+0000 7fdd2b59e700 1 -- 172.21.15.84:0/1692567969 shutdown_connections 2020-01-16T05:48:59.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.344+0000 7fdd2b59e700 1 -- 172.21.15.84:0/1692567969 wait complete. 2020-01-16T05:48:59.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.344+0000 7fdd2b59e700 1 -- 172.21.15.84:0/1692567969 >> 172.21.15.84:0/1692567969 conn(0x7fdd2c0acfc0 msgr2=0x7fdd2c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:59.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.344+0000 7fdd2b59e700 1 Processor -- start 2020-01-16T05:48:59.348 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.344+0000 7fdd2b59e700 1 -- start start 2020-01-16T05:48:59.351 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.344+0000 7fdd2b59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdd2c07c1e0 0x7fdd2c1251b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:59.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.344+0000 7fdd2b59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2c07b480 con 0x7fdd2c1263b0 2020-01-16T05:48:59.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.344+0000 7fdd2b59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2c09f630 con 0x7fdd2c07f300 2020-01-16T05:48:59.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.344+0000 7fdd2b59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd2c1268f0 con 0x7fdd2c07c1e0 2020-01-16T05:48:59.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.344+0000 7fdd2a59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdd2c1263b0 0x7fdd2c07eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53968/0 (socket says 172.21.15.84:53968) 2020-01-16T05:48:59.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd2a59c700 1 -- 172.21.15.84:0/1616604467 learned_addr learned my addr 172.21.15.84:0/1616604467 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:48:59.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd2ad9d700 1 --2- 172.21.15.84:0/1616604467 >> v2:172.21.15.142:3300/0 conn(0x7fdd2c07c1e0 0x7fdd2c1251b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:59.352 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd1b7fe700 1 -- 172.21.15.84:0/1616604467 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854174371 0 0) 0x7fdd2c07b480 con 0x7fdd2c1263b0 2020-01-16T05:48:59.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd1b7fe700 1 -- 172.21.15.84:0/1616604467 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd10003230 con 0x7fdd2c1263b0 2020-01-16T05:48:59.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd1b7fe700 1 -- 172.21.15.84:0/1616604467 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2184017727 0 0) 0x7fdd10003230 con 0x7fdd2c1263b0 2020-01-16T05:48:59.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd1b7fe700 1 -- 172.21.15.84:0/1616604467 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdd2c07b480 con 0x7fdd2c1263b0 2020-01-16T05:48:59.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd1b7fe700 1 -- 172.21.15.84:0/1616604467 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7fdd20001a60 con 0x7fdd2c1263b0 2020-01-16T05:48:59.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd2ad9d700 1 -- 172.21.15.84:0/1616604467 >> v1:172.21.15.142:6789/0 conn(0x7fdd2c07f300 legacy=0x7fdd2c09ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:59.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd2ad9d700 1 -- 172.21.15.84:0/1616604467 >> v1:172.21.15.84:6789/0 conn(0x7fdd2c1263b0 legacy=0x7fdd2c07eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:59.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd2ad9d700 1 -- 172.21.15.84:0/1616604467 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c09f860 con 0x7fdd2c07c1e0 2020-01-16T05:48:59.353 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd2ad9d700 1 --2- 172.21.15.84:0/1616604467 >> v2:172.21.15.142:3300/0 conn(0x7fdd2c07c1e0 0x7fdd2c1251b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd24003070 tx=0x7fdd200017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:59.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd2ad9d700 1 --2- 172.21.15.84:0/1616604467 >> v2:172.21.15.142:3300/0 conn(0x7fdd2c07c1e0 0x7fdd2c1251b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd24003070 tx=0x7fdd200017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:59.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd2ad9d700 1 --2- 172.21.15.84:0/1616604467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd2c07c1e0 0x7fdd2c1251b0 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7fdd24003070 tx=0x7fdd200017b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:59.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd2ad9d700 1 --2- 172.21.15.84:0/1616604467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd2c07c1e0 0x7fdd2c1251b0 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fdd24003070 tx=0x7fdd200017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:59.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd1b7fe700 1 -- 172.21.15.84:0/1616604467 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1c005a40 con 0x7fdd2c07c1e0 2020-01-16T05:48:59.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd2ad9d700 1 --2- 172.21.15.84:0/1616604467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd2c07c1e0 0x7fdd2c1251b0 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fdd24003070 tx=0x7fdd200017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:59.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd2ad9d700 1 --2- 172.21.15.84:0/1616604467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd2c07c1e0 0x7fdd2c1251b0 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fdd24003070 tx=0x7fdd200017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:59.354 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd1b7fe700 1 -- 172.21.15.84:0/1616604467 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c00a360 con 0x7fdd2c07c1e0 2020-01-16T05:48:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd2b59e700 1 -- 172.21.15.84:0/1616604467 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd2c09fa70 con 0x7fdd2c07c1e0 2020-01-16T05:48:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd1b7fe700 1 -- 172.21.15.84:0/1616604467 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1c007340 con 0x7fdd2c07c1e0 2020-01-16T05:48:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd2b59e700 1 -- 172.21.15.84:0/1616604467 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2c13e7a0 con 0x7fdd2c07c1e0 2020-01-16T05:48:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd2ad9d700 1 --2- 172.21.15.84:0/1616604467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd2c07c1e0 0x7fdd2c1251b0 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fdd24003070 tx=0x7fdd200017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd2b59e700 1 -- 172.21.15.84:0/1616604467 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2c05e1c0 con 0x7fdd2c07c1e0 2020-01-16T05:48:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd1b7fe700 1 -- 172.21.15.84:0/1616604467 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fdd1c007650 con 0x7fdd2c07c1e0 2020-01-16T05:48:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.348+0000 7fdd2ad9d700 1 --2- 172.21.15.84:0/1616604467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd2c07c1e0 0x7fdd2c1251b0 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fdd24003070 tx=0x7fdd200017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.352+0000 7fdd1b7fe700 1 --2- 172.21.15.84:0/1616604467 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdd1003cbc0 0x7fdd1003f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:48:59.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.352+0000 7fdd1b7fe700 1 -- 172.21.15.84:0/1616604467 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fdd1c04d330 con 0x7fdd2c07c1e0 2020-01-16T05:48:59.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.352+0000 7fdd2a59c700 1 --2- 172.21.15.84:0/1616604467 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdd1003cbc0 0x7fdd1003f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:48:59.356 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.352+0000 7fdd2a59c700 1 --2- 172.21.15.84:0/1616604467 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdd1003cbc0 0x7fdd1003f0d0 crc :-1 s=READY pgs=206 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:48:59.359 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.360+0000 7fdd2ad9d700 1 --2- 172.21.15.84:0/1616604467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd2c07c1e0 0x7fdd2c1251b0 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fdd24003070 tx=0x7fdd200017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:59.360 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.360+0000 7fdd1b7fe700 1 -- 172.21.15.84:0/1616604467 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fdd1c033950 con 0x7fdd2c07c1e0 2020-01-16T05:48:59.509 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.512+0000 7fdd2b59e700 1 -- 172.21.15.84:0/1616604467 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd2c0a50b0 con 0x7fdd2c07c1e0 2020-01-16T05:48:59.511 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.512+0000 7fdd2ad9d700 1 --2- 172.21.15.84:0/1616604467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd2c07c1e0 0x7fdd2c1251b0 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fdd24003070 tx=0x7fdd200017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:48:59.511 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.512+0000 7fdd1b7fe700 1 -- 172.21.15.84:0/1616604467 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fdd1c033bb0 con 0x7fdd2c07c1e0 2020-01-16T05:48:59.511 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:48:59.511 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:48:59.512 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.512+0000 7fdd2b59e700 1 -- 172.21.15.84:0/1616604467 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdd1003cbc0 msgr2=0x7fdd1003f0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:59.512 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.512+0000 7fdd2b59e700 1 --2- 172.21.15.84:0/1616604467 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdd1003cbc0 0x7fdd1003f0d0 crc :-1 s=READY pgs=206 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:59.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.512+0000 7fdd2b59e700 1 -- 172.21.15.84:0/1616604467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd2c07c1e0 msgr2=0x7fdd2c1251b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:48:59.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.512+0000 7fdd2b59e700 1 --2- 172.21.15.84:0/1616604467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd2c07c1e0 0x7fdd2c1251b0 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7fdd24003070 tx=0x7fdd200017b0).stop 2020-01-16T05:48:59.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.512+0000 7fdd2b59e700 1 -- 172.21.15.84:0/1616604467 shutdown_connections 2020-01-16T05:48:59.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.512+0000 7fdd2b59e700 1 --2- 172.21.15.84:0/1616604467 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fdd1003cbc0 0x7fdd1003f0d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:59.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.512+0000 7fdd2b59e700 1 --2- 172.21.15.84:0/1616604467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd2c07c1e0 0x7fdd2c1251b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:48:59.513 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.512+0000 7fdd2b59e700 1 -- 172.21.15.84:0/1616604467 shutdown_connections 2020-01-16T05:48:59.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.512+0000 7fdd2b59e700 1 -- 172.21.15.84:0/1616604467 wait complete. 2020-01-16T05:48:59.514 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:48:59.512+0000 7fdd2b59e700 1 -- 172.21.15.84:0/1616604467 >> 172.21.15.84:0/1616604467 conn(0x7fdd2c0a6430 msgr2=0x7fdd2c0a3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:48:59.516 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:48:59.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~272s 2020-01-16T05:48:59.524 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:49:01.525 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:49:01.650 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b035a1700 1 Processor -- start 2020-01-16T05:49:01.651 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b035a1700 1 -- start start 2020-01-16T05:49:01.651 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b035a1700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1afc0a2f60 0x7f1afc05b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:01.651 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b035a1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1afc08fd80 0x7f1afc1503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:01.651 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b035a1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1afc07cd60 con 0x7f1afc0a8ff0 2020-01-16T05:49:01.651 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b035a1700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1afc0a3390 con 0x7f1afc0a2f60 2020-01-16T05:49:01.651 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b035a1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0905b0 con 0x7f1afc08fd80 2020-01-16T05:49:01.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b0133d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1afc0a8ff0 0x7f1afc07c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53976/0 (socket says 172.21.15.84:53976) 2020-01-16T05:49:01.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b0133d700 1 -- 172.21.15.84:0/3025326800 learned_addr learned my addr 172.21.15.84:0/3025326800 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:49:01.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b01b3e700 1 --2- 172.21.15.84:0/3025326800 >> v2:172.21.15.142:3300/0 conn(0x7f1afc0a2f60 0x7f1afc05b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:01.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b0233f700 1 --2- 172.21.15.84:0/3025326800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1afc08fd80 0x7f1afc1503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:01.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b00b3c700 1 -- 172.21.15.84:0/3025326800 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599866280 0 0) 0x7f1afc07cd60 con 0x7f1afc0a8ff0 2020-01-16T05:49:01.652 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b00b3c700 1 -- 172.21.15.84:0/3025326800 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ae8003230 con 0x7f1afc0a8ff0 2020-01-16T05:49:01.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b00b3c700 1 -- 172.21.15.84:0/3025326800 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3088618500 0 0) 0x7f1ae8003230 con 0x7f1afc0a8ff0 2020-01-16T05:49:01.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b00b3c700 1 -- 172.21.15.84:0/3025326800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1afc08fd80 msgr2=0x7f1afc1503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:49:01.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b00b3c700 1 --2- 172.21.15.84:0/3025326800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1afc08fd80 0x7f1afc1503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:01.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b00b3c700 1 -- 172.21.15.84:0/3025326800 >> v2:172.21.15.142:3300/0 conn(0x7f1afc0a2f60 msgr2=0x7f1afc05b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:49:01.653 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b00b3c700 1 --2- 172.21.15.84:0/3025326800 >> v2:172.21.15.142:3300/0 conn(0x7f1afc0a2f60 0x7f1afc05b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b00b3c700 1 -- 172.21.15.84:0/3025326800 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc0a9420 con 0x7f1afc0a8ff0 2020-01-16T05:49:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b00b3c700 1 -- 172.21.15.84:0/3025326800 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f1aec001ad0 con 0x7f1afc0a8ff0 2020-01-16T05:49:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b01b3e700 1 --2- 172.21.15.84:0/3025326800 >> v2:172.21.15.142:3300/0 conn(0x7f1afc0a2f60 0x7f1afc05b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:49:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b00b3c700 1 -- 172.21.15.84:0/3025326800 >> v1:172.21.15.84:6789/0 conn(0x7f1afc0a8ff0 legacy=0x7f1afc07c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b00b3c700 1 --2- 172.21.15.84:0/3025326800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ae8003910 0x7f1ae8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b00b3c700 1 --2- 172.21.15.84:0/3025326800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ae80045a0 0x7f1ae80049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b00b3c700 1 --2- 172.21.15.84:0/3025326800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae8004f20 0x7f1ae804f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b00b3c700 1 -- 172.21.15.84:0/3025326800 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0a3390 con 0x7f1ae8004f20 2020-01-16T05:49:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b00b3c700 1 -- 172.21.15.84:0/3025326800 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0905b0 con 0x7f1ae8003910 2020-01-16T05:49:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.644+0000 7f1b00b3c700 1 -- 172.21.15.84:0/3025326800 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae804fd50 con 0x7f1ae80045a0 2020-01-16T05:49:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b0233f700 1 --2- 172.21.15.84:0/3025326800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae8004f20 0x7f1ae804f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b0133d700 1 --2- 172.21.15.84:0/3025326800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ae80045a0 0x7f1ae80049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b01b3e700 1 --2- 172.21.15.84:0/3025326800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ae8003910 0x7f1ae8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b0233f700 1 -- 172.21.15.84:0/3025326800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ae80045a0 msgr2=0x7f1ae80049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:49:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b0233f700 1 --2- 172.21.15.84:0/3025326800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ae80045a0 0x7f1ae80049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b0233f700 1 -- 172.21.15.84:0/3025326800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ae8003910 msgr2=0x7f1ae8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:49:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b0233f700 1 --2- 172.21.15.84:0/3025326800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ae8003910 0x7f1ae8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b0233f700 1 -- 172.21.15.84:0/3025326800 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae804ff70 con 0x7f1ae8004f20 2020-01-16T05:49:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b0233f700 1 --2- 172.21.15.84:0/3025326800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae8004f20 0x7f1ae804f800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1af4002f30 tx=0x7f1af4010150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b0233f700 1 --2- 172.21.15.84:0/3025326800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae8004f20 0x7f1ae804f800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1af4002f30 tx=0x7f1af4010150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b0233f700 1 --2- 172.21.15.84:0/3025326800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae8004f20 0x7f1ae804f800 secure :-1 s=READY pgs=541 cs=0 l=1 rx=0x7f1af4002f30 tx=0x7f1af4010150).ready entity=mon.0 client_cookie=ea4e9829f2997e5 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:01.657 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b0233f700 1 --2- 172.21.15.84:0/3025326800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae8004f20 0x7f1ae804f800 secure :-1 s=THROTTLE_DONE pgs=541 cs=0 l=1 rx=0x7f1af4002f30 tx=0x7f1af4010150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:01.657 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b00b3c700 1 -- 172.21.15.84:0/3025326800 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1af4008950 con 0x7f1ae8004f20 2020-01-16T05:49:01.657 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b0233f700 1 --2- 172.21.15.84:0/3025326800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae8004f20 0x7f1ae804f800 secure :-1 s=THROTTLE_DONE pgs=541 cs=0 l=1 rx=0x7f1af4002f30 tx=0x7f1af4010150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:01.657 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b00b3c700 1 -- 172.21.15.84:0/3025326800 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af4010a60 con 0x7f1ae8004f20 2020-01-16T05:49:01.657 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b0233f700 1 --2- 172.21.15.84:0/3025326800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae8004f20 0x7f1ae804f800 secure :-1 s=THROTTLE_DONE pgs=541 cs=0 l=1 rx=0x7f1af4002f30 tx=0x7f1af4010150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:01.657 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b035a1700 1 -- 172.21.15.84:0/3025326800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae8004f20 msgr2=0x7f1ae804f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:01.657 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b00b3c700 1 -- 172.21.15.84:0/3025326800 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1af40056c0 con 0x7f1ae8004f20 2020-01-16T05:49:01.658 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b035a1700 1 --2- 172.21.15.84:0/3025326800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae8004f20 0x7f1ae804f800 secure :-1 s=READY pgs=541 cs=0 l=1 rx=0x7f1af4002f30 tx=0x7f1af4010150).stop 2020-01-16T05:49:01.658 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b0233f700 1 -- 172.21.15.84:0/3025326800 reap_dead start 2020-01-16T05:49:01.658 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b035a1700 1 -- 172.21.15.84:0/3025326800 shutdown_connections 2020-01-16T05:49:01.658 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b035a1700 1 -- 172.21.15.84:0/3025326800 shutdown_connections 2020-01-16T05:49:01.658 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b035a1700 1 -- 172.21.15.84:0/3025326800 wait complete. 2020-01-16T05:49:01.658 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.648+0000 7f1b035a1700 1 -- 172.21.15.84:0/3025326800 >> 172.21.15.84:0/3025326800 conn(0x7f1afc0abc10 msgr2=0x7f1afc05a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:01.658 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b035a1700 1 Processor -- start 2020-01-16T05:49:01.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b035a1700 1 -- start start 2020-01-16T05:49:01.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b035a1700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1afc09dd30 0x7f1afc09e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:01.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b035a1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1afc124280 0x7f1afc0a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:01.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b035a1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1afc0a1a00 con 0x7f1afc0a1080 2020-01-16T05:49:01.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b035a1700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1afc09fbb0 con 0x7f1afc09dd30 2020-01-16T05:49:01.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b035a1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc09fe50 con 0x7f1afc124280 2020-01-16T05:49:01.659 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b01b3e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1afc09dd30 0x7f1afc09e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:01.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b0233f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1afc124280 0x7f1afc0a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:01.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b01b3e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1afc09dd30 0x7f1afc09e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.84:46774/0 (socket says 172.21.15.84:46774) 2020-01-16T05:49:01.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b0133d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1afc0a1080 0x7f1afc123a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:52214/0 (socket says 172.21.15.84:52214) 2020-01-16T05:49:01.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b0233f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1afc124280 0x7f1afc0a14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:49036/0 (socket says 172.21.15.84:49036) 2020-01-16T05:49:01.660 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b01b3e700 1 -- 172.21.15.84:0/2512623716 learned_addr learned my addr 172.21.15.84:0/2512623716 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:49:01.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b01b3e700 1 -- 172.21.15.84:0/2512623716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1afc124280 msgr2=0x7f1afc0a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:01.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b01b3e700 1 --2- 172.21.15.84:0/2512623716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1afc124280 0x7f1afc0a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:01.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b01b3e700 1 -- 172.21.15.84:0/2512623716 >> v1:172.21.15.142:6789/0 conn(0x7f1afc0a1080 legacy=0x7f1afc123a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:01.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b01b3e700 1 -- 172.21.15.84:0/2512623716 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc0aa2e0 con 0x7f1afc09dd30 2020-01-16T05:49:01.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1afa7fc700 1 -- 172.21.15.84:0/2512623716 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290512534 0 0) 0x7f1afc0a1a00 con 0x7f1afc0a1080 2020-01-16T05:49:01.663 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b0233f700 1 --2- 172.21.15.84:0/2512623716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1afc124280 0x7f1afc0a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:49:01.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b01b3e700 1 --2- 172.21.15.84:0/2512623716 >> v2:172.21.15.142:3300/0 conn(0x7f1afc09dd30 0x7f1afc09e160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1afc09fd70 tx=0x7f1ae4010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:01.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b01b3e700 1 --2- 172.21.15.84:0/2512623716 >> v2:172.21.15.142:3300/0 conn(0x7f1afc09dd30 0x7f1afc09e160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1afc09fd70 tx=0x7f1ae4010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:01.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b01b3e700 1 --2- 172.21.15.84:0/2512623716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1afc09dd30 0x7f1afc09e160 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7f1afc09fd70 tx=0x7f1ae4010e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:01.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b01b3e700 1 --2- 172.21.15.84:0/2512623716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1afc09dd30 0x7f1afc09e160 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f1afc09fd70 tx=0x7f1ae4010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:01.664 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1afa7fc700 1 -- 172.21.15.84:0/2512623716 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ae40058d0 con 0x7f1afc09dd30 2020-01-16T05:49:01.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b01b3e700 1 --2- 172.21.15.84:0/2512623716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1afc09dd30 0x7f1afc09e160 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f1afc09fd70 tx=0x7f1ae4010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:01.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b035a1700 1 -- 172.21.15.84:0/2512623716 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1afc09f0d0 con 0x7f1afc09dd30 2020-01-16T05:49:01.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b01b3e700 1 --2- 172.21.15.84:0/2512623716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1afc09dd30 0x7f1afc09e160 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f1afc09fd70 tx=0x7f1ae4010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:01.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1afa7fc700 1 -- 172.21.15.84:0/2512623716 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae4007160 con 0x7f1afc09dd30 2020-01-16T05:49:01.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1afa7fc700 1 -- 172.21.15.84:0/2512623716 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ae4012510 con 0x7f1afc09dd30 2020-01-16T05:49:01.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.652+0000 7f1b035a1700 1 -- 172.21.15.84:0/2512623716 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1afc13a6d0 con 0x7f1afc09dd30 2020-01-16T05:49:01.665 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.656+0000 7f1b01b3e700 1 --2- 172.21.15.84:0/2512623716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1afc09dd30 0x7f1afc09e160 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f1afc09fd70 tx=0x7f1ae4010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:01.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.656+0000 7f1b035a1700 1 -- 172.21.15.84:0/2512623716 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1afc05e1c0 con 0x7f1afc09dd30 2020-01-16T05:49:01.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.656+0000 7f1afa7fc700 1 -- 172.21.15.84:0/2512623716 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f1ae400e180 con 0x7f1afc09dd30 2020-01-16T05:49:01.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.656+0000 7f1b01b3e700 1 --2- 172.21.15.84:0/2512623716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1afc09dd30 0x7f1afc09e160 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f1afc09fd70 tx=0x7f1ae4010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:01.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.656+0000 7f1afa7fc700 1 --2- 172.21.15.84:0/2512623716 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1ae003c1b0 0x7f1ae003e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:01.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.656+0000 7f1afa7fc700 1 -- 172.21.15.84:0/2512623716 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f1ae404cd60 con 0x7f1afc09dd30 2020-01-16T05:49:01.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.656+0000 7f1b0133d700 1 --2- 172.21.15.84:0/2512623716 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1ae003c1b0 0x7f1ae003e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:01.666 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.656+0000 7f1b0133d700 1 --2- 172.21.15.84:0/2512623716 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1ae003c1b0 0x7f1ae003e6c0 crc :-1 s=READY pgs=207 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:01.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.664+0000 7f1b01b3e700 1 --2- 172.21.15.84:0/2512623716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1afc09dd30 0x7f1afc09e160 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f1afc09fd70 tx=0x7f1ae4010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:01.667 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.664+0000 7f1afa7fc700 1 -- 172.21.15.84:0/2512623716 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f1ae40332e0 con 0x7f1afc09dd30 2020-01-16T05:49:01.817 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.816+0000 7f1b035a1700 1 -- 172.21.15.84:0/2512623716 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1afc0a1eb0 con 0x7f1afc09dd30 2020-01-16T05:49:01.818 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.820+0000 7f1b01b3e700 1 --2- 172.21.15.84:0/2512623716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1afc09dd30 0x7f1afc09e160 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f1afc09fd70 tx=0x7f1ae4010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:01.818 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.820+0000 7f1afa7fc700 1 -- 172.21.15.84:0/2512623716 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f1ae4033540 con 0x7f1afc09dd30 2020-01-16T05:49:01.818 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:49:01.818 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:49:01.820 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.820+0000 7f1b035a1700 1 -- 172.21.15.84:0/2512623716 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1ae003c1b0 msgr2=0x7f1ae003e6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:01.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.820+0000 7f1b035a1700 1 --2- 172.21.15.84:0/2512623716 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1ae003c1b0 0x7f1ae003e6c0 crc :-1 s=READY pgs=207 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:01.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.820+0000 7f1b035a1700 1 -- 172.21.15.84:0/2512623716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1afc09dd30 msgr2=0x7f1afc09e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:01.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.820+0000 7f1b035a1700 1 --2- 172.21.15.84:0/2512623716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1afc09dd30 0x7f1afc09e160 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7f1afc09fd70 tx=0x7f1ae4010e90).stop 2020-01-16T05:49:01.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.820+0000 7f1b035a1700 1 -- 172.21.15.84:0/2512623716 shutdown_connections 2020-01-16T05:49:01.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.820+0000 7f1b035a1700 1 --2- 172.21.15.84:0/2512623716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1afc124280 0x7f1afc0a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:01.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.820+0000 7f1b035a1700 1 --2- 172.21.15.84:0/2512623716 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f1ae003c1b0 0x7f1ae003e6c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:01.821 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.820+0000 7f1b035a1700 1 --2- 172.21.15.84:0/2512623716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1afc09dd30 0x7f1afc09e160 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:01.822 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.820+0000 7f1b035a1700 1 -- 172.21.15.84:0/2512623716 shutdown_connections 2020-01-16T05:49:01.822 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.820+0000 7f1b035a1700 1 -- 172.21.15.84:0/2512623716 wait complete. 2020-01-16T05:49:01.822 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:01.820+0000 7f1b035a1700 1 -- 172.21.15.84:0/2512623716 >> 172.21.15.84:0/2512623716 conn(0x7f1afc08f940 msgr2=0x7f1afc090770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:01.822 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:49:01.835 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:49:03.836 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:49:03.959 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6856616700 1 Processor -- start 2020-01-16T05:49:03.959 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6856616700 1 -- start start 2020-01-16T05:49:03.959 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6856616700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f68500a9b30 0x7f68500abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:03.959 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6856616700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685007ff10 0x7f6850066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:03.959 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6856616700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6850066dd0 con 0x7f68500a4250 2020-01-16T05:49:03.960 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6856616700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68500a4830 con 0x7f68500a9b30 2020-01-16T05:49:03.960 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6856616700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685007f9d0 con 0x7f685007ff10 2020-01-16T05:49:03.960 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6855e15700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f68500a9b30 0x7f68500abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:03.960 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6855614700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685007ff10 0x7f6850066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:03.960 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6857878700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f68500a4250 0x7f68500a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:52226/0 (socket says 172.21.15.84:52226) 2020-01-16T05:49:03.961 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6855e15700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f68500a9b30 0x7f68500abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.84:46780/0 (socket says 172.21.15.84:46780) 2020-01-16T05:49:03.961 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6857878700 1 -- 172.21.15.84:0/956252268 learned_addr learned my addr 172.21.15.84:0/956252268 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:49:03.961 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6855e15700 1 -- 172.21.15.84:0/956252268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685007ff10 msgr2=0x7f6850066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:49:03.961 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6855e15700 1 --2- 172.21.15.84:0/956252268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685007ff10 0x7f6850066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:03.961 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6855e15700 1 -- 172.21.15.84:0/956252268 >> v1:172.21.15.142:6789/0 conn(0x7f68500a4250 legacy=0x7f68500a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:03.961 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6855e15700 1 -- 172.21.15.84:0/956252268 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6850150ce0 con 0x7f68500a9b30 2020-01-16T05:49:03.961 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6855614700 1 --2- 172.21.15.84:0/956252268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685007ff10 0x7f6850066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-16T05:49:03.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6855e15700 1 --2- 172.21.15.84:0/956252268 >> v2:172.21.15.142:3300/0 conn(0x7f68500a9b30 0x7f68500abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6848008c90 tx=0x7f6848010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:03.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6855e15700 1 --2- 172.21.15.84:0/956252268 >> v2:172.21.15.142:3300/0 conn(0x7f68500a9b30 0x7f68500abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6848008c90 tx=0x7f6848010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:03.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.956+0000 7f6855e15700 1 --2- 172.21.15.84:0/956252268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68500a9b30 0x7f68500abdd0 secure :-1 s=READY pgs=325 cs=0 l=1 rx=0x7f6848008c90 tx=0x7f6848010170).ready entity=mon.1 client_cookie=88a172fa1c8381f5 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:03.962 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6855e15700 1 --2- 172.21.15.84:0/956252268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68500a9b30 0x7f68500abdd0 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7f6848008c90 tx=0x7f6848010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:03.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6854e13700 1 -- 172.21.15.84:0/956252268 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f684800a160 con 0x7f68500a9b30 2020-01-16T05:49:03.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6855e15700 1 --2- 172.21.15.84:0/956252268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68500a9b30 0x7f68500abdd0 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7f6848008c90 tx=0x7f6848010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:03.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6855e15700 1 --2- 172.21.15.84:0/956252268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68500a9b30 0x7f68500abdd0 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7f6848008c90 tx=0x7f6848010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:03.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6854e13700 1 -- 172.21.15.84:0/956252268 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6848011af0 con 0x7f68500a9b30 2020-01-16T05:49:03.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6854e13700 1 -- 172.21.15.84:0/956252268 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f684800a740 con 0x7f68500a9b30 2020-01-16T05:49:03.963 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6856616700 1 -- 172.21.15.84:0/956252268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68500a9b30 msgr2=0x7f68500abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:03.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6856616700 1 --2- 172.21.15.84:0/956252268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68500a9b30 0x7f68500abdd0 secure :-1 s=READY pgs=325 cs=0 l=1 rx=0x7f6848008c90 tx=0x7f6848010170).stop 2020-01-16T05:49:03.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6856616700 1 -- 172.21.15.84:0/956252268 shutdown_connections 2020-01-16T05:49:03.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6856616700 1 --2- 172.21.15.84:0/956252268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68500a9b30 0x7f68500abdd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:03.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6856616700 1 --2- 172.21.15.84:0/956252268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685007ff10 0x7f6850066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:03.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6856616700 1 -- 172.21.15.84:0/956252268 shutdown_connections 2020-01-16T05:49:03.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6856616700 1 -- 172.21.15.84:0/956252268 wait complete. 2020-01-16T05:49:03.964 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6856616700 1 -- 172.21.15.84:0/956252268 >> 172.21.15.84:0/956252268 conn(0x7f68500acfc0 msgr2=0x7f68500a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:03.967 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6856616700 1 Processor -- start 2020-01-16T05:49:03.967 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6856616700 1 -- start start 2020-01-16T05:49:03.968 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6856616700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f685005bef0 0x7f68500a8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:03.968 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6856616700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f685009f530 0x7f685009f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:03.968 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6856616700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685007c420 con 0x7f68500a5530 2020-01-16T05:49:03.968 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6856616700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68500a88f0 con 0x7f685005bef0 2020-01-16T05:49:03.968 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.960+0000 7f6856616700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68500a7de0 con 0x7f685009f530 2020-01-16T05:49:03.968 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6855614700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f685005bef0 0x7f68500a8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:03.968 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6855e15700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f68500a5530 0x7f6850124050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54002/0 (socket says 172.21.15.84:54002) 2020-01-16T05:49:03.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6855e15700 1 -- 172.21.15.84:0/1640267111 learned_addr learned my addr 172.21.15.84:0/1640267111 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:49:03.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6857878700 1 --2- 172.21.15.84:0/1640267111 >> v2:172.21.15.142:3300/0 conn(0x7f685009f530 0x7f685009f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:03.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6855614700 1 -- 172.21.15.84:0/1640267111 >> v2:172.21.15.142:3300/0 conn(0x7f685009f530 msgr2=0x7f685009f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:03.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6855614700 1 --2- 172.21.15.84:0/1640267111 >> v2:172.21.15.142:3300/0 conn(0x7f685009f530 0x7f685009f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:03.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6855614700 1 -- 172.21.15.84:0/1640267111 >> v1:172.21.15.84:6789/0 conn(0x7f68500a5530 legacy=0x7f6850124050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:03.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6855614700 1 -- 172.21.15.84:0/1640267111 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68500a7fa0 con 0x7f685005bef0 2020-01-16T05:49:03.969 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6855614700 1 --2- 172.21.15.84:0/1640267111 >> v2:172.21.15.84:3300/0 conn(0x7f685005bef0 0x7f68500a8200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6840002f30 tx=0x7f6840010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:03.970 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6855614700 1 --2- 172.21.15.84:0/1640267111 >> v2:172.21.15.84:3300/0 conn(0x7f685005bef0 0x7f68500a8200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6840002f30 tx=0x7f6840010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:03.970 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6855614700 1 --2- 172.21.15.84:0/1640267111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f685005bef0 0x7f68500a8200 secure :-1 s=READY pgs=543 cs=0 l=1 rx=0x7f6840002f30 tx=0x7f6840010df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:03.970 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6855614700 1 --2- 172.21.15.84:0/1640267111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f685005bef0 0x7f68500a8200 secure :-1 s=THROTTLE_DONE pgs=543 cs=0 l=1 rx=0x7f6840002f30 tx=0x7f6840010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:03.970 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f68467fc700 1 -- 172.21.15.84:0/1640267111 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6840007540 con 0x7f685005bef0 2020-01-16T05:49:03.970 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6855614700 1 --2- 172.21.15.84:0/1640267111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f685005bef0 0x7f68500a8200 secure :-1 s=THROTTLE_DONE pgs=543 cs=0 l=1 rx=0x7f6840002f30 tx=0x7f6840010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:03.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6855614700 1 --2- 172.21.15.84:0/1640267111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f685005bef0 0x7f68500a8200 secure :-1 s=THROTTLE_DONE pgs=543 cs=0 l=1 rx=0x7f6840002f30 tx=0x7f6840010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:03.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f68467fc700 1 -- 172.21.15.84:0/1640267111 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6840007160 con 0x7f685005bef0 2020-01-16T05:49:03.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6856616700 1 -- 172.21.15.84:0/1640267111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f685013d380 con 0x7f685005bef0 2020-01-16T05:49:03.971 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f68467fc700 1 -- 172.21.15.84:0/1640267111 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68400124b0 con 0x7f685005bef0 2020-01-16T05:49:03.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6856616700 1 -- 172.21.15.84:0/1640267111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685013d880 con 0x7f685005bef0 2020-01-16T05:49:03.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6855614700 1 --2- 172.21.15.84:0/1640267111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f685005bef0 0x7f68500a8200 secure :-1 s=THROTTLE_DONE pgs=543 cs=0 l=1 rx=0x7f6840002f30 tx=0x7f6840010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:03.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6856616700 1 -- 172.21.15.84:0/1640267111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685005e1c0 con 0x7f685005bef0 2020-01-16T05:49:03.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f68467fc700 1 -- 172.21.15.84:0/1640267111 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f68400127c0 con 0x7f685005bef0 2020-01-16T05:49:03.972 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f6855614700 1 --2- 172.21.15.84:0/1640267111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f685005bef0 0x7f68500a8200 secure :-1 s=THROTTLE_DONE pgs=543 cs=0 l=1 rx=0x7f6840002f30 tx=0x7f6840010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:03.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f68467fc700 1 --2- 172.21.15.84:0/1640267111 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f683803c270 0x7f683803e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:03.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.964+0000 7f68467fc700 1 -- 172.21.15.84:0/1640267111 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f684004cc90 con 0x7f685005bef0 2020-01-16T05:49:03.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.968+0000 7f6855e15700 1 --2- 172.21.15.84:0/1640267111 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f683803c270 0x7f683803e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:03.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.968+0000 7f6855e15700 1 --2- 172.21.15.84:0/1640267111 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f683803c270 0x7f683803e780 crc :-1 s=READY pgs=208 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:03.973 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.972+0000 7f6855614700 1 --2- 172.21.15.84:0/1640267111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f685005bef0 0x7f68500a8200 secure :-1 s=THROTTLE_DONE pgs=543 cs=0 l=1 rx=0x7f6840002f30 tx=0x7f6840010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:03.974 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:03.972+0000 7f68467fc700 1 -- 172.21.15.84:0/1640267111 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f6840033250 con 0x7f685005bef0 2020-01-16T05:49:04.123 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:04.124+0000 7f6856616700 1 -- 172.21.15.84:0/1640267111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6850123e20 con 0x7f685005bef0 2020-01-16T05:49:04.124 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:04.124+0000 7f6855614700 1 --2- 172.21.15.84:0/1640267111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f685005bef0 0x7f68500a8200 secure :-1 s=THROTTLE_DONE pgs=543 cs=0 l=1 rx=0x7f6840002f30 tx=0x7f6840010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:04.124 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:04.124+0000 7f68467fc700 1 -- 172.21.15.84:0/1640267111 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f68400334b0 con 0x7f685005bef0 2020-01-16T05:49:04.125 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:49:04.125 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:49:04.126 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:04.128+0000 7f6856616700 1 -- 172.21.15.84:0/1640267111 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f683803c270 msgr2=0x7f683803e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:04.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:04.128+0000 7f6856616700 1 --2- 172.21.15.84:0/1640267111 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f683803c270 0x7f683803e780 crc :-1 s=READY pgs=208 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:04.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:04.128+0000 7f6856616700 1 -- 172.21.15.84:0/1640267111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f685005bef0 msgr2=0x7f68500a8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:04.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:04.128+0000 7f6856616700 1 --2- 172.21.15.84:0/1640267111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f685005bef0 0x7f68500a8200 secure :-1 s=READY pgs=543 cs=0 l=1 rx=0x7f6840002f30 tx=0x7f6840010df0).stop 2020-01-16T05:49:04.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:04.128+0000 7f6856616700 1 -- 172.21.15.84:0/1640267111 shutdown_connections 2020-01-16T05:49:04.127 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:04.128+0000 7f6856616700 1 --2- 172.21.15.84:0/1640267111 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f683803c270 0x7f683803e780 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:04.128+0000 7f6856616700 1 --2- 172.21.15.84:0/1640267111 >> v2:172.21.15.142:3300/0 conn(0x7f685009f530 0x7f685009f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:04.128+0000 7f6856616700 1 --2- 172.21.15.84:0/1640267111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f685005bef0 0x7f68500a8200 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:04.128+0000 7f6856616700 1 -- 172.21.15.84:0/1640267111 shutdown_connections 2020-01-16T05:49:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:04.128+0000 7f6856616700 1 -- 172.21.15.84:0/1640267111 wait complete. 2020-01-16T05:49:04.129 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:04.128+0000 7f6856616700 1 -- 172.21.15.84:0/1640267111 >> 172.21.15.84:0/1640267111 conn(0x7f68500a4d70 msgr2=0x7f685007ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:04.129 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:49:04.138 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:49:05.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~279s 2020-01-16T05:49:06.139 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:49:06.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e13211700 1 Processor -- start 2020-01-16T05:49:06.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e13211700 1 -- start start 2020-01-16T05:49:06.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e13211700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5e0c0a9b30 0x7f5e0c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:06.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e13211700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0c066880 con 0x7f5e0c0a4250 2020-01-16T05:49:06.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e13211700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0c066ab0 con 0x7f5e0c07ff10 2020-01-16T05:49:06.263 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e13211700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0c0a4830 con 0x7f5e0c0a9b30 2020-01-16T05:49:06.264 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e14473700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5e0c0a4250 0x7f5e0c14fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54014/0 (socket says 172.21.15.84:54014) 2020-01-16T05:49:06.264 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e14473700 1 -- 172.21.15.84:0/2039805849 learned_addr learned my addr 172.21.15.84:0/2039805849 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:49:06.264 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e12a10700 1 --2- 172.21.15.84:0/2039805849 >> v2:172.21.15.142:3300/0 conn(0x7f5e0c0a9b30 0x7f5e0c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:06.264 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e11a0e700 1 -- 172.21.15.84:0/2039805849 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498107191 0 0) 0x7f5e0c066880 con 0x7f5e0c0a4250 2020-01-16T05:49:06.264 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e11a0e700 1 -- 172.21.15.84:0/2039805849 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5df8003230 con 0x7f5e0c0a4250 2020-01-16T05:49:06.264 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e11a0e700 1 -- 172.21.15.84:0/2039805849 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3813322909 0 0) 0x7f5df8003230 con 0x7f5e0c0a4250 2020-01-16T05:49:06.264 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e11a0e700 1 -- 172.21.15.84:0/2039805849 >> v2:172.21.15.142:3300/0 conn(0x7f5e0c0a9b30 msgr2=0x7f5e0c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:49:06.265 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e11a0e700 1 --2- 172.21.15.84:0/2039805849 >> v2:172.21.15.142:3300/0 conn(0x7f5e0c0a9b30 0x7f5e0c0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:06.265 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e11a0e700 1 -- 172.21.15.84:0/2039805849 >> v1:172.21.15.142:6789/0 conn(0x7f5e0c07ff10 legacy=0x7f5e0c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:06.265 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e11a0e700 1 -- 172.21.15.84:0/2039805849 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c066ce0 con 0x7f5e0c0a4250 2020-01-16T05:49:06.265 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e11a0e700 1 -- 172.21.15.84:0/2039805849 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7f5e08001750 con 0x7f5e0c0a4250 2020-01-16T05:49:06.265 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e11a0e700 1 -- 172.21.15.84:0/2039805849 >> v1:172.21.15.84:6789/0 conn(0x7f5e0c0a4250 legacy=0x7f5e0c14fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:06.265 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e11a0e700 1 --2- 172.21.15.84:0/2039805849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5df8003860 0x7f5df8003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:06.265 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e11a0e700 1 --2- 172.21.15.84:0/2039805849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5df80045a0 0x7f5df80049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:06.266 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e11a0e700 1 --2- 172.21.15.84:0/2039805849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df8004f20 0x7f5df800b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:06.266 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e11a0e700 1 -- 172.21.15.84:0/2039805849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0a4830 con 0x7f5df80045a0 2020-01-16T05:49:06.266 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e11a0e700 1 -- 172.21.15.84:0/2039805849 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df804fd50 con 0x7f5df8004f20 2020-01-16T05:49:06.266 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e11a0e700 1 -- 172.21.15.84:0/2039805849 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df804ff90 con 0x7f5df8003860 2020-01-16T05:49:06.266 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e1220f700 1 --2- 172.21.15.84:0/2039805849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5df80045a0 0x7f5df80049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:06.266 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e14473700 1 --2- 172.21.15.84:0/2039805849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df8004f20 0x7f5df800b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:06.266 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e12a10700 1 --2- 172.21.15.84:0/2039805849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5df8003860 0x7f5df8003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:06.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e1220f700 1 -- 172.21.15.84:0/2039805849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5df8003860 msgr2=0x7f5df8003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:49:06.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e1220f700 1 --2- 172.21.15.84:0/2039805849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5df8003860 0x7f5df8003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:06.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e1220f700 1 -- 172.21.15.84:0/2039805849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df8004f20 msgr2=0x7f5df800b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:49:06.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e1220f700 1 --2- 172.21.15.84:0/2039805849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df8004f20 0x7f5df800b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:06.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e14473700 1 -- 172.21.15.84:0/2039805849 reap_dead start 2020-01-16T05:49:06.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e1220f700 1 -- 172.21.15.84:0/2039805849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df8050290 con 0x7f5df80045a0 2020-01-16T05:49:06.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e12a10700 1 --2- 172.21.15.84:0/2039805849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5df8003860 0x7f5df8003c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:49:06.267 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e1220f700 1 --2- 172.21.15.84:0/2039805849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5df80045a0 0x7f5df80049d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5e00001360 tx=0x7f5e00010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:06.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e1220f700 1 --2- 172.21.15.84:0/2039805849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5df80045a0 0x7f5df80049d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5e00001360 tx=0x7f5e00010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:06.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e1220f700 1 --2- 172.21.15.84:0/2039805849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5df80045a0 0x7f5df80049d0 secure :-1 s=READY pgs=545 cs=0 l=1 rx=0x7f5e00001360 tx=0x7f5e00010300).ready entity=mon.0 client_cookie=938ef5534edf078a server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:06.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e1220f700 1 --2- 172.21.15.84:0/2039805849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5df80045a0 0x7f5df80049d0 secure :-1 s=THROTTLE_DONE pgs=545 cs=0 l=1 rx=0x7f5e00001360 tx=0x7f5e00010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:06.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e11a0e700 1 -- 172.21.15.84:0/2039805849 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e00006c40 con 0x7f5df80045a0 2020-01-16T05:49:06.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e1220f700 1 --2- 172.21.15.84:0/2039805849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5df80045a0 0x7f5df80049d0 secure :-1 s=THROTTLE_DONE pgs=545 cs=0 l=1 rx=0x7f5e00001360 tx=0x7f5e00010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:06.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e11a0e700 1 -- 172.21.15.84:0/2039805849 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e00006860 con 0x7f5df80045a0 2020-01-16T05:49:06.268 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e1220f700 1 --2- 172.21.15.84:0/2039805849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5df80045a0 0x7f5df80049d0 secure :-1 s=THROTTLE_DONE pgs=545 cs=0 l=1 rx=0x7f5e00001360 tx=0x7f5e00010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:06.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e13211700 1 -- 172.21.15.84:0/2039805849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5df80045a0 msgr2=0x7f5df80049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:06.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e11a0e700 1 -- 172.21.15.84:0/2039805849 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e00002920 con 0x7f5df80045a0 2020-01-16T05:49:06.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.260+0000 7f5e13211700 1 --2- 172.21.15.84:0/2039805849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5df80045a0 0x7f5df80049d0 secure :-1 s=READY pgs=545 cs=0 l=1 rx=0x7f5e00001360 tx=0x7f5e00010300).stop 2020-01-16T05:49:06.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.264+0000 7f5e13211700 1 -- 172.21.15.84:0/2039805849 shutdown_connections 2020-01-16T05:49:06.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.264+0000 7f5e13211700 1 --2- 172.21.15.84:0/2039805849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5df80045a0 0x7f5df80049d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:06.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.264+0000 7f5e13211700 1 -- 172.21.15.84:0/2039805849 shutdown_connections 2020-01-16T05:49:06.269 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.264+0000 7f5e13211700 1 -- 172.21.15.84:0/2039805849 wait complete. 2020-01-16T05:49:06.270 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.264+0000 7f5e13211700 1 -- 172.21.15.84:0/2039805849 >> 172.21.15.84:0/2039805849 conn(0x7f5e0c0acfc0 msgr2=0x7f5e0c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:06.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.264+0000 7f5e13211700 1 Processor -- start 2020-01-16T05:49:06.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.264+0000 7f5e13211700 1 -- start start 2020-01-16T05:49:06.273 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.264+0000 7f5e13211700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e0c0a32a0 0x7f5e0c0a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:06.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.264+0000 7f5e13211700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5e0c0a10f0 0x7f5e0c135300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:06.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.264+0000 7f5e13211700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0c127cf0 con 0x7f5e0c0a0cc0 2020-01-16T05:49:06.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.264+0000 7f5e13211700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0c0a1e00 con 0x7f5e0c0a10f0 2020-01-16T05:49:06.275 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.264+0000 7f5e13211700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0a04d0 con 0x7f5e0c0a32a0 2020-01-16T05:49:06.275 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.264+0000 7f5e14473700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5e0c0a10f0 0x7f5e0c135300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:06.275 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.264+0000 7f5e14473700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5e0c0a10f0 0x7f5e0c135300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36826/0 (socket says 172.21.15.84:36826) 2020-01-16T05:49:06.275 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.264+0000 7f5e1220f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5e0c0a0cc0 0x7f5e0c134b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54024/0 (socket says 172.21.15.84:54024) 2020-01-16T05:49:06.275 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e14473700 1 -- 172.21.15.84:0/2561744141 learned_addr learned my addr 172.21.15.84:0/2561744141 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:49:06.276 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e12a10700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e0c0a32a0 0x7f5e0c0a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:06.276 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e14473700 1 -- 172.21.15.84:0/2561744141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e0c0a32a0 msgr2=0x7f5e0c0a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:06.276 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e14473700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e0c0a32a0 0x7f5e0c0a0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:06.276 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e14473700 1 -- 172.21.15.84:0/2561744141 >> v1:172.21.15.84:6789/0 conn(0x7f5e0c0a0cc0 legacy=0x7f5e0c134b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:06.276 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5dff7fe700 1 -- 172.21.15.84:0/2561744141 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919641247 0 0) 0x7f5e000013a0 con 0x7f5e0c0a0cc0 2020-01-16T05:49:06.276 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e14473700 1 -- 172.21.15.84:0/2561744141 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c0a6c60 con 0x7f5e0c0a10f0 2020-01-16T05:49:06.277 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e12a10700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e0c0a32a0 0x7f5e0c0a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:49:06.277 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e14473700 1 --2- 172.21.15.84:0/2561744141 >> v2:172.21.15.84:3300/0 conn(0x7f5e0c0a10f0 0x7f5e0c135300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e0c0a1fc0 tx=0x7f5e08001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:06.277 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e14473700 1 --2- 172.21.15.84:0/2561744141 >> v2:172.21.15.84:3300/0 conn(0x7f5e0c0a10f0 0x7f5e0c135300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e0c0a1fc0 tx=0x7f5e08001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:06.277 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e14473700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c0a10f0 0x7f5e0c135300 secure :-1 s=READY pgs=547 cs=0 l=1 rx=0x7f5e0c0a1fc0 tx=0x7f5e08001800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:06.277 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e14473700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c0a10f0 0x7f5e0c135300 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f5e0c0a1fc0 tx=0x7f5e08001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:06.277 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5dff7fe700 1 -- 172.21.15.84:0/2561744141 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e08012960 con 0x7f5e0c0a10f0 2020-01-16T05:49:06.277 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e14473700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c0a10f0 0x7f5e0c135300 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f5e0c0a1fc0 tx=0x7f5e08001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:06.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5dff7fe700 1 -- 172.21.15.84:0/2561744141 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e08012580 con 0x7f5e0c0a10f0 2020-01-16T05:49:06.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e14473700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c0a10f0 0x7f5e0c135300 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f5e0c0a1fc0 tx=0x7f5e08001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:06.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e13211700 1 -- 172.21.15.84:0/2561744141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0c0a1af0 con 0x7f5e0c0a10f0 2020-01-16T05:49:06.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5dff7fe700 1 -- 172.21.15.84:0/2561744141 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e080044f0 con 0x7f5e0c0a10f0 2020-01-16T05:49:06.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e13211700 1 -- 172.21.15.84:0/2561744141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0c08ef10 con 0x7f5e0c0a10f0 2020-01-16T05:49:06.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e14473700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c0a10f0 0x7f5e0c135300 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f5e0c0a1fc0 tx=0x7f5e08001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:06.278 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5dff7fe700 1 -- 172.21.15.84:0/2561744141 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f5e080046f0 con 0x7f5e0c0a10f0 2020-01-16T05:49:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e14473700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c0a10f0 0x7f5e0c135300 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f5e0c0a1fc0 tx=0x7f5e08001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5dff7fe700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5df403c190 0x7f5df403e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5dff7fe700 1 -- 172.21.15.84:0/2561744141 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f5e0804c790 con 0x7f5e0c0a10f0 2020-01-16T05:49:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e12a10700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5df403c190 0x7f5df403e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e13211700 1 -- 172.21.15.84:0/2561744141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0c05e1c0 con 0x7f5e0c0a10f0 2020-01-16T05:49:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.268+0000 7f5e12a10700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5df403c190 0x7f5df403e6a0 crc :-1 s=READY pgs=209 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.272+0000 7f5e14473700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c0a10f0 0x7f5e0c135300 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f5e0c0a1fc0 tx=0x7f5e08001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.272+0000 7f5dff7fe700 1 -- 172.21.15.84:0/2561744141 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f5e08032ff0 con 0x7f5e0c0a10f0 2020-01-16T05:49:06.424 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.424+0000 7f5e13211700 1 -- 172.21.15.84:0/2561744141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e0c0a2000 con 0x7f5e0c0a10f0 2020-01-16T05:49:06.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.428+0000 7f5e14473700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c0a10f0 0x7f5e0c135300 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f5e0c0a1fc0 tx=0x7f5e08001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:06.425 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.428+0000 7f5dff7fe700 1 -- 172.21.15.84:0/2561744141 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f5e08007220 con 0x7f5e0c0a10f0 2020-01-16T05:49:06.426 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:49:06.426 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:49:06.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.428+0000 7f5e13211700 1 -- 172.21.15.84:0/2561744141 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5df403c190 msgr2=0x7f5df403e6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:06.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.428+0000 7f5e13211700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5df403c190 0x7f5df403e6a0 crc :-1 s=READY pgs=209 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:06.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.428+0000 7f5e13211700 1 -- 172.21.15.84:0/2561744141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c0a10f0 msgr2=0x7f5e0c135300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:06.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.428+0000 7f5e13211700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c0a10f0 0x7f5e0c135300 secure :-1 s=READY pgs=547 cs=0 l=1 rx=0x7f5e0c0a1fc0 tx=0x7f5e08001800).stop 2020-01-16T05:49:06.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.432+0000 7f5e13211700 1 -- 172.21.15.84:0/2561744141 shutdown_connections 2020-01-16T05:49:06.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.432+0000 7f5e13211700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f5df403c190 0x7f5df403e6a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:06.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.432+0000 7f5e13211700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c0a10f0 0x7f5e0c135300 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:06.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.432+0000 7f5e13211700 1 --2- 172.21.15.84:0/2561744141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e0c0a32a0 0x7f5e0c0a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:06.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.432+0000 7f5e13211700 1 -- 172.21.15.84:0/2561744141 shutdown_connections 2020-01-16T05:49:06.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.432+0000 7f5e13211700 1 -- 172.21.15.84:0/2561744141 wait complete. 2020-01-16T05:49:06.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:06.432+0000 7f5e13211700 1 -- 172.21.15.84:0/2561744141 >> 172.21.15.84:0/2561744141 conn(0x7f5e0c05bbb0 msgr2=0x7f5e0c07ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:06.431 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:49:06.446 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:49:08.447 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:49:08.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.564+0000 7f76723d9700 1 Processor -- start 2020-01-16T05:49:08.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.564+0000 7f76723d9700 1 -- start start 2020-01-16T05:49:08.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76723d9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f766c07ff10 0x7f766c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:08.570 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76723d9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f766c0a4250 0x7f766c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:08.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76723d9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766c066dd0 con 0x7f766c0a9b30 2020-01-16T05:49:08.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76723d9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766c0a4830 con 0x7f766c07ff10 2020-01-16T05:49:08.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76723d9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766c07f9d0 con 0x7f766c0a4250 2020-01-16T05:49:08.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76713d7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f766c07ff10 0x7f766c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:08.571 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76713d7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f766c07ff10 0x7f766c0abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36834/0 (socket says 172.21.15.84:36834) 2020-01-16T05:49:08.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76713d7700 1 -- 172.21.15.84:0/312504205 learned_addr learned my addr 172.21.15.84:0/312504205 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:49:08.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f7671bd8700 1 --1- 172.21.15.84:0/312504205 >> v1:172.21.15.84:6789/0 conn(0x7f766c0a9b30 0x7f766c0a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54034/0 (socket says 172.21.15.84:54034) 2020-01-16T05:49:08.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f767363b700 1 --2- 172.21.15.84:0/312504205 >> v2:172.21.15.142:3300/0 conn(0x7f766c0a4250 0x7f766c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:08.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76713d7700 1 -- 172.21.15.84:0/312504205 >> v2:172.21.15.142:3300/0 conn(0x7f766c0a4250 msgr2=0x7f766c066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:49:08.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76713d7700 1 --2- 172.21.15.84:0/312504205 >> v2:172.21.15.142:3300/0 conn(0x7f766c0a4250 0x7f766c066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:08.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76713d7700 1 -- 172.21.15.84:0/312504205 >> v1:172.21.15.84:6789/0 conn(0x7f766c0a9b30 legacy=0x7f766c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:08.572 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76713d7700 1 -- 172.21.15.84:0/312504205 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c150ce0 con 0x7f766c07ff10 2020-01-16T05:49:08.573 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76713d7700 1 --2- 172.21.15.84:0/312504205 >> v2:172.21.15.84:3300/0 conn(0x7f766c07ff10 0x7f766c0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f766c0a49f0 tx=0x7f766000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:08.573 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76713d7700 1 --2- 172.21.15.84:0/312504205 >> v2:172.21.15.84:3300/0 conn(0x7f766c07ff10 0x7f766c0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f766c0a49f0 tx=0x7f766000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:08.573 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76713d7700 1 --2- 172.21.15.84:0/312504205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f766c07ff10 0x7f766c0abdd0 secure :-1 s=READY pgs=551 cs=0 l=1 rx=0x7f766c0a49f0 tx=0x7f766000feb0).ready entity=mon.0 client_cookie=5a136d737aa120e1 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:08.573 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76713d7700 1 --2- 172.21.15.84:0/312504205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f766c07ff10 0x7f766c0abdd0 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f766c0a49f0 tx=0x7f766000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:08.573 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f7670bd6700 1 -- 172.21.15.84:0/312504205 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76600116e0 con 0x7f766c07ff10 2020-01-16T05:49:08.573 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76713d7700 1 --2- 172.21.15.84:0/312504205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f766c07ff10 0x7f766c0abdd0 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f766c0a49f0 tx=0x7f766000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:08.574 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76713d7700 1 --2- 172.21.15.84:0/312504205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f766c07ff10 0x7f766c0abdd0 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f766c0a49f0 tx=0x7f766000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:08.574 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f7670bd6700 1 -- 172.21.15.84:0/312504205 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7660008d30 con 0x7f766c07ff10 2020-01-16T05:49:08.574 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f7670bd6700 1 -- 172.21.15.84:0/312504205 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7660011cc0 con 0x7f766c07ff10 2020-01-16T05:49:08.574 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76723d9700 1 -- 172.21.15.84:0/312504205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f766c07ff10 msgr2=0x7f766c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:08.574 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76723d9700 1 --2- 172.21.15.84:0/312504205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f766c07ff10 0x7f766c0abdd0 secure :-1 s=READY pgs=551 cs=0 l=1 rx=0x7f766c0a49f0 tx=0x7f766000feb0).stop 2020-01-16T05:49:08.575 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76723d9700 1 -- 172.21.15.84:0/312504205 shutdown_connections 2020-01-16T05:49:08.575 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76723d9700 1 --2- 172.21.15.84:0/312504205 >> v2:172.21.15.142:3300/0 conn(0x7f766c0a4250 0x7f766c066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:08.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76723d9700 1 --2- 172.21.15.84:0/312504205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f766c07ff10 0x7f766c0abdd0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:08.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76723d9700 1 -- 172.21.15.84:0/312504205 shutdown_connections 2020-01-16T05:49:08.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76723d9700 1 -- 172.21.15.84:0/312504205 wait complete. 2020-01-16T05:49:08.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.568+0000 7f76723d9700 1 -- 172.21.15.84:0/312504205 >> 172.21.15.84:0/312504205 conn(0x7f766c0acfc0 msgr2=0x7f766c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:08.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76723d9700 1 Processor -- start 2020-01-16T05:49:08.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76723d9700 1 -- start start 2020-01-16T05:49:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76723d9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f766c0a4ec0 0x7f766c09f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76723d9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f766c09f6e0 0x7f766c125d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76723d9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f766c075700 0x7f766c126290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76723d9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766c126f90 con 0x7f766c09f6e0 2020-01-16T05:49:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76723d9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766c1267e0 con 0x7f766c0a4ec0 2020-01-16T05:49:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76723d9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c126a50 con 0x7f766c075700 2020-01-16T05:49:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76713d7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f766c09f6e0 0x7f766c125d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76713d7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f766c09f6e0 0x7f766c125d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36840/0 (socket says 172.21.15.84:36840) 2020-01-16T05:49:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76713d7700 1 -- 172.21.15.84:0/2258212449 learned_addr learned my addr 172.21.15.84:0/2258212449 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:49:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f7671bd8700 1 --2- 172.21.15.84:0/2258212449 >> v2:172.21.15.142:3300/0 conn(0x7f766c0a4ec0 0x7f766c09f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f767363b700 1 --2- 172.21.15.84:0/2258212449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f766c075700 0x7f766c126290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76713d7700 1 -- 172.21.15.84:0/2258212449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f766c075700 msgr2=0x7f766c126290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76713d7700 1 --2- 172.21.15.84:0/2258212449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f766c075700 0x7f766c126290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76713d7700 1 -- 172.21.15.84:0/2258212449 >> v2:172.21.15.142:3300/0 conn(0x7f766c0a4ec0 msgr2=0x7f766c09f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76713d7700 1 --2- 172.21.15.84:0/2258212449 >> v2:172.21.15.142:3300/0 conn(0x7f766c0a4ec0 0x7f766c09f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76713d7700 1 -- 172.21.15.84:0/2258212449 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c0a3810 con 0x7f766c09f6e0 2020-01-16T05:49:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f7671bd8700 1 --2- 172.21.15.84:0/2258212449 >> v2:172.21.15.142:3300/0 conn(0x7f766c0a4ec0 0x7f766c09f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-01-16T05:49:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76713d7700 1 --2- 172.21.15.84:0/2258212449 >> v2:172.21.15.84:3300/0 conn(0x7f766c09f6e0 0x7f766c125d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f766c0a49f0 tx=0x7f7660011820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76713d7700 1 --2- 172.21.15.84:0/2258212449 >> v2:172.21.15.84:3300/0 conn(0x7f766c09f6e0 0x7f766c125d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f766c0a49f0 tx=0x7f7660011820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76713d7700 1 --2- 172.21.15.84:0/2258212449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f766c09f6e0 0x7f766c125d40 secure :-1 s=READY pgs=552 cs=0 l=1 rx=0x7f766c0a49f0 tx=0x7f7660011820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76713d7700 1 --2- 172.21.15.84:0/2258212449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f766c09f6e0 0x7f766c125d40 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7f766c0a49f0 tx=0x7f7660011820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:08.584 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76713d7700 1 --2- 172.21.15.84:0/2258212449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f766c09f6e0 0x7f766c125d40 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7f766c0a49f0 tx=0x7f7660011820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:08.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76713d7700 1 --2- 172.21.15.84:0/2258212449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f766c09f6e0 0x7f766c125d40 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7f766c0a49f0 tx=0x7f7660011820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:08.585 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f766a7fc700 1 -- 172.21.15.84:0/2258212449 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f766000f800 con 0x7f766c09f6e0 2020-01-16T05:49:08.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f766a7fc700 1 -- 172.21.15.84:0/2258212449 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76600118e0 con 0x7f766c09f6e0 2020-01-16T05:49:08.586 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76723d9700 1 -- 172.21.15.84:0/2258212449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766c135c70 con 0x7f766c09f6e0 2020-01-16T05:49:08.587 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f766a7fc700 1 -- 172.21.15.84:0/2258212449 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7660007530 con 0x7f766c09f6e0 2020-01-16T05:49:08.587 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.572+0000 7f76723d9700 1 -- 172.21.15.84:0/2258212449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766c1242d0 con 0x7f766c09f6e0 2020-01-16T05:49:08.587 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.576+0000 7f76713d7700 1 --2- 172.21.15.84:0/2258212449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f766c09f6e0 0x7f766c125d40 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7f766c0a49f0 tx=0x7f7660011820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:08.587 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.576+0000 7f76723d9700 1 -- 172.21.15.84:0/2258212449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766c125b30 con 0x7f766c09f6e0 2020-01-16T05:49:08.587 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.576+0000 7f766a7fc700 1 -- 172.21.15.84:0/2258212449 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f76600056c0 con 0x7f766c09f6e0 2020-01-16T05:49:08.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.576+0000 7f76713d7700 1 --2- 172.21.15.84:0/2258212449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f766c09f6e0 0x7f766c125d40 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7f766c0a49f0 tx=0x7f7660011820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:08.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.576+0000 7f766a7fc700 1 --2- 172.21.15.84:0/2258212449 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f764c03c2f0 0x7f764c03e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:08.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.576+0000 7f766a7fc700 1 -- 172.21.15.84:0/2258212449 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f766004cfa0 con 0x7f766c09f6e0 2020-01-16T05:49:08.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.576+0000 7f7671bd8700 1 --2- 172.21.15.84:0/2258212449 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f764c03c2f0 0x7f764c03e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:08.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.576+0000 7f7671bd8700 1 --2- 172.21.15.84:0/2258212449 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f764c03c2f0 0x7f764c03e800 crc :-1 s=READY pgs=210 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:08.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.584+0000 7f76713d7700 1 --2- 172.21.15.84:0/2258212449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f766c09f6e0 0x7f766c125d40 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7f766c0a49f0 tx=0x7f7660011820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:08.588 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.584+0000 7f766a7fc700 1 -- 172.21.15.84:0/2258212449 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f76600335c0 con 0x7f766c09f6e0 2020-01-16T05:49:08.733 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.736+0000 7f76723d9700 1 -- 172.21.15.84:0/2258212449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f766c05e1c0 con 0x7f766c09f6e0 2020-01-16T05:49:08.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.736+0000 7f76713d7700 1 --2- 172.21.15.84:0/2258212449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f766c09f6e0 0x7f766c125d40 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7f766c0a49f0 tx=0x7f7660011820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:08.734 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.736+0000 7f766a7fc700 1 -- 172.21.15.84:0/2258212449 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f7660033820 con 0x7f766c09f6e0 2020-01-16T05:49:08.734 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:49:08.734 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:49:08.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.736+0000 7f76723d9700 1 -- 172.21.15.84:0/2258212449 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f764c03c2f0 msgr2=0x7f764c03e800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:08.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.736+0000 7f76723d9700 1 --2- 172.21.15.84:0/2258212449 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f764c03c2f0 0x7f764c03e800 crc :-1 s=READY pgs=210 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:08.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.736+0000 7f76723d9700 1 -- 172.21.15.84:0/2258212449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f766c09f6e0 msgr2=0x7f766c125d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:08.736 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.736+0000 7f76723d9700 1 --2- 172.21.15.84:0/2258212449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f766c09f6e0 0x7f766c125d40 secure :-1 s=READY pgs=552 cs=0 l=1 rx=0x7f766c0a49f0 tx=0x7f7660011820).stop 2020-01-16T05:49:08.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.736+0000 7f76723d9700 1 -- 172.21.15.84:0/2258212449 shutdown_connections 2020-01-16T05:49:08.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.736+0000 7f76723d9700 1 --2- 172.21.15.84:0/2258212449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f766c075700 0x7f766c126290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:08.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.736+0000 7f76723d9700 1 --2- 172.21.15.84:0/2258212449 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f764c03c2f0 0x7f764c03e800 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:08.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.736+0000 7f76723d9700 1 --2- 172.21.15.84:0/2258212449 >> v2:172.21.15.142:3300/0 conn(0x7f766c0a4ec0 0x7f766c09f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:08.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.736+0000 7f76723d9700 1 --2- 172.21.15.84:0/2258212449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f766c09f6e0 0x7f766c125d40 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:08.737 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.736+0000 7f76723d9700 1 -- 172.21.15.84:0/2258212449 shutdown_connections 2020-01-16T05:49:08.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.736+0000 7f76723d9700 1 -- 172.21.15.84:0/2258212449 wait complete. 2020-01-16T05:49:08.738 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:08.736+0000 7f76723d9700 1 -- 172.21.15.84:0/2258212449 >> 172.21.15.84:0/2258212449 conn(0x7f766c066650 msgr2=0x7f766c07dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:08.738 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:49:08.747 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:49:10.749 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:49:10.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd081d6b700 1 Processor -- start 2020-01-16T05:49:10.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd081d6b700 1 -- start start 2020-01-16T05:49:10.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd081d6b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd07c0a9b30 0x7fd07c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:10.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd081d6b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd07c0a4250 0x7fd07c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:10.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd081d6b700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd07c066dd0 con 0x7fd07c07ff10 2020-01-16T05:49:10.871 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd081d6b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd07c0a4830 con 0x7fd07c0a9b30 2020-01-16T05:49:10.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd081d6b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c07f9d0 con 0x7fd07c0a4250 2020-01-16T05:49:10.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd08156a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd07c0a9b30 0x7fd07c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:10.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd08156a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd07c0a9b30 0x7fd07c0abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36858/0 (socket says 172.21.15.84:36858) 2020-01-16T05:49:10.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd08156a700 1 -- 172.21.15.84:0/289730553 learned_addr learned my addr 172.21.15.84:0/289730553 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:49:10.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd082fcd700 1 --2- 172.21.15.84:0/289730553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd07c0a4250 0x7fd07c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:10.872 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd08156a700 1 -- 172.21.15.84:0/289730553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd07c0a4250 msgr2=0x7fd07c066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:49:10.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd08156a700 1 --2- 172.21.15.84:0/289730553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd07c0a4250 0x7fd07c066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:10.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd08156a700 1 -- 172.21.15.84:0/289730553 >> v1:172.21.15.142:6789/0 conn(0x7fd07c07ff10 legacy=0x7fd07c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:10.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd08156a700 1 -- 172.21.15.84:0/289730553 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd07c150ce0 con 0x7fd07c0a9b30 2020-01-16T05:49:10.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd08156a700 1 --2- 172.21.15.84:0/289730553 >> v2:172.21.15.84:3300/0 conn(0x7fd07c0a9b30 0x7fd07c0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd07c0a49f0 tx=0x7fd07800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:10.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd08156a700 1 --2- 172.21.15.84:0/289730553 >> v2:172.21.15.84:3300/0 conn(0x7fd07c0a9b30 0x7fd07c0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd07c0a49f0 tx=0x7fd07800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:10.873 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd08156a700 1 --2- 172.21.15.84:0/289730553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd07c0a9b30 0x7fd07c0abdd0 secure :-1 s=READY pgs=553 cs=0 l=1 rx=0x7fd07c0a49f0 tx=0x7fd07800feb0).ready entity=mon.0 client_cookie=257b246ed93dbd2f server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd08156a700 1 --2- 172.21.15.84:0/289730553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd07c0a9b30 0x7fd07c0abdd0 secure :-1 s=THROTTLE_DONE pgs=553 cs=0 l=1 rx=0x7fd07c0a49f0 tx=0x7fd07800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd08156a700 1 --2- 172.21.15.84:0/289730553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd07c0a9b30 0x7fd07c0abdd0 secure :-1 s=THROTTLE_DONE pgs=553 cs=0 l=1 rx=0x7fd07c0a49f0 tx=0x7fd07800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd08156a700 1 --2- 172.21.15.84:0/289730553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd07c0a9b30 0x7fd07c0abdd0 secure :-1 s=THROTTLE_DONE pgs=553 cs=0 l=1 rx=0x7fd07c0a49f0 tx=0x7fd07800feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd073fff700 1 -- 172.21.15.84:0/289730553 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd078011720 con 0x7fd07c0a9b30 2020-01-16T05:49:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd073fff700 1 -- 172.21.15.84:0/289730553 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd078008d30 con 0x7fd07c0a9b30 2020-01-16T05:49:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd073fff700 1 -- 172.21.15.84:0/289730553 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd078011d00 con 0x7fd07c0a9b30 2020-01-16T05:49:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd081d6b700 1 -- 172.21.15.84:0/289730553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd07c0a9b30 msgr2=0x7fd07c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.868+0000 7fd081d6b700 1 --2- 172.21.15.84:0/289730553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd07c0a9b30 0x7fd07c0abdd0 secure :-1 s=READY pgs=553 cs=0 l=1 rx=0x7fd07c0a49f0 tx=0x7fd07800feb0).stop 2020-01-16T05:49:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd081d6b700 1 -- 172.21.15.84:0/289730553 shutdown_connections 2020-01-16T05:49:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd081d6b700 1 --2- 172.21.15.84:0/289730553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd07c0a4250 0x7fd07c066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd081d6b700 1 --2- 172.21.15.84:0/289730553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd07c0a9b30 0x7fd07c0abdd0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd081d6b700 1 -- 172.21.15.84:0/289730553 shutdown_connections 2020-01-16T05:49:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd081d6b700 1 -- 172.21.15.84:0/289730553 wait complete. 2020-01-16T05:49:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd081d6b700 1 -- 172.21.15.84:0/289730553 >> 172.21.15.84:0/289730553 conn(0x7fd07c0acfc0 msgr2=0x7fd07c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd081d6b700 1 Processor -- start 2020-01-16T05:49:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd081d6b700 1 -- start start 2020-01-16T05:49:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd081d6b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd07c1247d0 0x7fd07c1348d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd081d6b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd07c123440 con 0x7fd07c137e90 2020-01-16T05:49:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd081d6b700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd07c138ac0 con 0x7fd07c125030 2020-01-16T05:49:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd081d6b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd07c135050 con 0x7fd07c1247d0 2020-01-16T05:49:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd080d69700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd07c1247d0 0x7fd07c1348d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd080d69700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd07c1247d0 0x7fd07c1348d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36864/0 (socket says 172.21.15.84:36864) 2020-01-16T05:49:10.877 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd082fcd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd07c137e90 0x7fd07c1382c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54066/0 (socket says 172.21.15.84:54066) 2020-01-16T05:49:10.877 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd080d69700 1 -- 172.21.15.84:0/2873546822 learned_addr learned my addr 172.21.15.84:0/2873546822 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:49:10.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd071ffb700 1 -- 172.21.15.84:0/2873546822 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643867812 0 0) 0x7fd07c123440 con 0x7fd07c137e90 2020-01-16T05:49:10.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd080d69700 1 -- 172.21.15.84:0/2873546822 >> v1:172.21.15.142:6789/0 conn(0x7fd07c125030 legacy=0x7fd07c122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:10.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd080d69700 1 -- 172.21.15.84:0/2873546822 >> v1:172.21.15.84:6789/0 conn(0x7fd07c137e90 legacy=0x7fd07c1382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:10.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd080d69700 1 -- 172.21.15.84:0/2873546822 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd07c138cf0 con 0x7fd07c1247d0 2020-01-16T05:49:10.879 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd080d69700 1 --2- 172.21.15.84:0/2873546822 >> v2:172.21.15.84:3300/0 conn(0x7fd07c1247d0 0x7fd07c1348d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd074001210 tx=0x7fd074010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:10.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd080d69700 1 --2- 172.21.15.84:0/2873546822 >> v2:172.21.15.84:3300/0 conn(0x7fd07c1247d0 0x7fd07c1348d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd074001210 tx=0x7fd074010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:10.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd080d69700 1 --2- 172.21.15.84:0/2873546822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd07c1247d0 0x7fd07c1348d0 secure :-1 s=READY pgs=555 cs=0 l=1 rx=0x7fd074001210 tx=0x7fd074010df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:10.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd080d69700 1 --2- 172.21.15.84:0/2873546822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd07c1247d0 0x7fd07c1348d0 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7fd074001210 tx=0x7fd074010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:10.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd071ffb700 1 -- 172.21.15.84:0/2873546822 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0740101c0 con 0x7fd07c1247d0 2020-01-16T05:49:10.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd080d69700 1 --2- 172.21.15.84:0/2873546822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd07c1247d0 0x7fd07c1348d0 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7fd074001210 tx=0x7fd074010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:10.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd081d6b700 1 -- 172.21.15.84:0/2873546822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd07c140520 con 0x7fd07c1247d0 2020-01-16T05:49:10.880 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd080d69700 1 --2- 172.21.15.84:0/2873546822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd07c1247d0 0x7fd07c1348d0 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7fd074001210 tx=0x7fd074010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd071ffb700 1 -- 172.21.15.84:0/2873546822 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07400cbc0 con 0x7fd07c1247d0 2020-01-16T05:49:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd071ffb700 1 -- 172.21.15.84:0/2873546822 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd074012470 con 0x7fd07c1247d0 2020-01-16T05:49:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.872+0000 7fd081d6b700 1 -- 172.21.15.84:0/2873546822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd07c140a50 con 0x7fd07c1247d0 2020-01-16T05:49:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.876+0000 7fd080d69700 1 --2- 172.21.15.84:0/2873546822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd07c1247d0 0x7fd07c1348d0 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7fd074001210 tx=0x7fd074010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.876+0000 7fd071ffb700 1 -- 172.21.15.84:0/2873546822 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fd074006860 con 0x7fd07c1247d0 2020-01-16T05:49:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.876+0000 7fd080d69700 1 --2- 172.21.15.84:0/2873546822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd07c1247d0 0x7fd07c1348d0 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7fd074001210 tx=0x7fd074010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:10.881 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.876+0000 7fd081d6b700 1 -- 172.21.15.84:0/2873546822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07c05e1c0 con 0x7fd07c1247d0 2020-01-16T05:49:10.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.876+0000 7fd071ffb700 1 --2- 172.21.15.84:0/2873546822 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd05c03c170 0x7fd05c03e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:10.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.876+0000 7fd071ffb700 1 -- 172.21.15.84:0/2873546822 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fd07404cbc0 con 0x7fd07c1247d0 2020-01-16T05:49:10.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.876+0000 7fd08156a700 1 --2- 172.21.15.84:0/2873546822 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd05c03c170 0x7fd05c03e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:10.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.876+0000 7fd08156a700 1 --2- 172.21.15.84:0/2873546822 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd05c03c170 0x7fd05c03e680 crc :-1 s=READY pgs=211 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:10.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.880+0000 7fd080d69700 1 --2- 172.21.15.84:0/2873546822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd07c1247d0 0x7fd07c1348d0 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7fd074001210 tx=0x7fd074010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:10.882 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:10.880+0000 7fd071ffb700 1 -- 172.21.15.84:0/2873546822 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fd07c138cf0 con 0x7fd07c1247d0 2020-01-16T05:49:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:11.032+0000 7fd081d6b700 1 -- 172.21.15.84:0/2873546822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd07c134e20 con 0x7fd07c1247d0 2020-01-16T05:49:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:11.032+0000 7fd080d69700 1 --2- 172.21.15.84:0/2873546822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd07c1247d0 0x7fd07c1348d0 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7fd074001210 tx=0x7fd074010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:11.032+0000 7fd071ffb700 1 -- 172.21.15.84:0/2873546822 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fd0740331c0 con 0x7fd07c1247d0 2020-01-16T05:49:11.030 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:49:11.031 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:49:11.032 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:11.032+0000 7fd081d6b700 1 -- 172.21.15.84:0/2873546822 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd05c03c170 msgr2=0x7fd05c03e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:11.033 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:11.032+0000 7fd081d6b700 1 --2- 172.21.15.84:0/2873546822 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd05c03c170 0x7fd05c03e680 crc :-1 s=READY pgs=211 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:11.033 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:11.032+0000 7fd081d6b700 1 -- 172.21.15.84:0/2873546822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd07c1247d0 msgr2=0x7fd07c1348d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:11.033 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:11.032+0000 7fd081d6b700 1 --2- 172.21.15.84:0/2873546822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd07c1247d0 0x7fd07c1348d0 secure :-1 s=READY pgs=555 cs=0 l=1 rx=0x7fd074001210 tx=0x7fd074010df0).stop 2020-01-16T05:49:11.033 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:11.032+0000 7fd081d6b700 1 -- 172.21.15.84:0/2873546822 shutdown_connections 2020-01-16T05:49:11.034 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:11.032+0000 7fd081d6b700 1 --2- 172.21.15.84:0/2873546822 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fd05c03c170 0x7fd05c03e680 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:11.034 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:11.032+0000 7fd081d6b700 1 --2- 172.21.15.84:0/2873546822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd07c1247d0 0x7fd07c1348d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:11.034 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:11.032+0000 7fd081d6b700 1 -- 172.21.15.84:0/2873546822 shutdown_connections 2020-01-16T05:49:11.034 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:11.032+0000 7fd081d6b700 1 -- 172.21.15.84:0/2873546822 wait complete. 2020-01-16T05:49:11.035 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:11.032+0000 7fd081d6b700 1 -- 172.21.15.84:0/2873546822 >> 172.21.15.84:0/2873546822 conn(0x7fd07c066650 msgr2=0x7fd07c1282b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:11.035 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:49:11.044 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:49:12.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~285s 2020-01-16T05:49:13.044 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:49:13.167 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f57fff700 1 Processor -- start 2020-01-16T05:49:13.167 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f57fff700 1 -- start start 2020-01-16T05:49:13.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f57fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9f580a9b30 0x7f9f580abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:13.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f57fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f58066880 con 0x7f9f580a4250 2020-01-16T05:49:13.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f57fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f58066ab0 con 0x7f9f5807ff10 2020-01-16T05:49:13.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f57fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f580a4830 con 0x7f9f580a9b30 2020-01-16T05:49:13.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f577fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9f580a9b30 0x7f9f580abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:13.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f577fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9f580a9b30 0x7f9f580abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36872/0 (socket says 172.21.15.84:36872) 2020-01-16T05:49:13.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f577fe700 1 -- 172.21.15.84:0/1556140447 learned_addr learned my addr 172.21.15.84:0/1556140447 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:49:13.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f577fe700 1 -- 172.21.15.84:0/1556140447 >> v1:172.21.15.142:6789/0 conn(0x7f9f5807ff10 legacy=0x7f9f580a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:13.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f577fe700 1 -- 172.21.15.84:0/1556140447 >> v1:172.21.15.84:6789/0 conn(0x7f9f580a4250 legacy=0x7f9f5814fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:13.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f567fc700 1 -- 172.21.15.84:0/1556140447 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517171916 0 0) 0x7f9f58066880 con 0x7f9f580a4250 2020-01-16T05:49:13.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f577fe700 1 -- 172.21.15.84:0/1556140447 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f58066ce0 con 0x7f9f580a9b30 2020-01-16T05:49:13.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f577fe700 1 --2- 172.21.15.84:0/1556140447 >> v2:172.21.15.84:3300/0 conn(0x7f9f580a9b30 0x7f9f580abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9f50008c90 tx=0x7f9f500101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:13.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f577fe700 1 --2- 172.21.15.84:0/1556140447 >> v2:172.21.15.84:3300/0 conn(0x7f9f580a9b30 0x7f9f580abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9f50008c90 tx=0x7f9f500101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:13.170 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f577fe700 1 --2- 172.21.15.84:0/1556140447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f580a9b30 0x7f9f580abdd0 secure :-1 s=READY pgs=559 cs=0 l=1 rx=0x7f9f50008c90 tx=0x7f9f500101b0).ready entity=mon.0 client_cookie=c110f73c7d6ec384 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:13.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f577fe700 1 --2- 172.21.15.84:0/1556140447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f580a9b30 0x7f9f580abdd0 secure :-1 s=THROTTLE_DONE pgs=559 cs=0 l=1 rx=0x7f9f50008c90 tx=0x7f9f500101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:13.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f567fc700 1 -- 172.21.15.84:0/1556140447 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f5000a160 con 0x7f9f580a9b30 2020-01-16T05:49:13.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f577fe700 1 --2- 172.21.15.84:0/1556140447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f580a9b30 0x7f9f580abdd0 secure :-1 s=THROTTLE_DONE pgs=559 cs=0 l=1 rx=0x7f9f50008c90 tx=0x7f9f500101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:13.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f577fe700 1 --2- 172.21.15.84:0/1556140447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f580a9b30 0x7f9f580abdd0 secure :-1 s=THROTTLE_DONE pgs=559 cs=0 l=1 rx=0x7f9f50008c90 tx=0x7f9f500101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:13.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f567fc700 1 -- 172.21.15.84:0/1556140447 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f50011c20 con 0x7f9f580a9b30 2020-01-16T05:49:13.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f567fc700 1 -- 172.21.15.84:0/1556140447 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f5000a740 con 0x7f9f580a9b30 2020-01-16T05:49:13.171 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f57fff700 1 -- 172.21.15.84:0/1556140447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f580a9b30 msgr2=0x7f9f580abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:13.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.164+0000 7f9f57fff700 1 --2- 172.21.15.84:0/1556140447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f580a9b30 0x7f9f580abdd0 secure :-1 s=READY pgs=559 cs=0 l=1 rx=0x7f9f50008c90 tx=0x7f9f500101b0).stop 2020-01-16T05:49:13.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.168+0000 7f9f57fff700 1 -- 172.21.15.84:0/1556140447 shutdown_connections 2020-01-16T05:49:13.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.168+0000 7f9f57fff700 1 --2- 172.21.15.84:0/1556140447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f580a9b30 0x7f9f580abdd0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:13.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.168+0000 7f9f57fff700 1 -- 172.21.15.84:0/1556140447 shutdown_connections 2020-01-16T05:49:13.172 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.168+0000 7f9f57fff700 1 -- 172.21.15.84:0/1556140447 wait complete. 2020-01-16T05:49:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.168+0000 7f9f57fff700 1 -- 172.21.15.84:0/1556140447 >> 172.21.15.84:0/1556140447 conn(0x7f9f580acfc0 msgr2=0x7f9f580a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.168+0000 7f9f57fff700 1 Processor -- start 2020-01-16T05:49:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.168+0000 7f9f57fff700 1 -- start start 2020-01-16T05:49:13.175 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.168+0000 7f9f57fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9f58127390 0x7f9f5808ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:13.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.168+0000 7f9f57fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9f5808ef10 0x7f9f580a2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:13.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.168+0000 7f9f57fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f58090520 con 0x7f9f580a2f70 2020-01-16T05:49:13.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.168+0000 7f9f57fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f580a6610 con 0x7f9f5808ef10 2020-01-16T05:49:13.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.168+0000 7f9f57fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5808fa90 con 0x7f9f58127390 2020-01-16T05:49:13.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.168+0000 7f9f56ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9f5808ef10 0x7f9f580a2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:13.176 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.168+0000 7f9f56ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9f5808ef10 0x7f9f580a2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36878/0 (socket says 172.21.15.84:36878) 2020-01-16T05:49:13.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.168+0000 7f9f56ffd700 1 -- 172.21.15.84:0/1174503417 learned_addr learned my addr 172.21.15.84:0/1174503417 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:49:13.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.168+0000 7f9f577fe700 1 --2- 172.21.15.84:0/1174503417 >> v2:172.21.15.142:3300/0 conn(0x7f9f58127390 0x7f9f5808ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:13.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f56ffd700 1 -- 172.21.15.84:0/1174503417 >> v2:172.21.15.142:3300/0 conn(0x7f9f58127390 msgr2=0x7f9f5808ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:13.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f56ffd700 1 --2- 172.21.15.84:0/1174503417 >> v2:172.21.15.142:3300/0 conn(0x7f9f58127390 0x7f9f5808ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:13.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f56ffd700 1 -- 172.21.15.84:0/1174503417 >> v1:172.21.15.142:6789/0 conn(0x7f9f580a2f70 legacy=0x7f9f580a7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:13.177 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f56ffd700 1 -- 172.21.15.84:0/1174503417 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f580a6250 con 0x7f9f5808ef10 2020-01-16T05:49:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f56ffd700 1 --2- 172.21.15.84:0/1174503417 >> v2:172.21.15.84:3300/0 conn(0x7f9f5808ef10 0x7f9f580a2a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9f5808fc50 tx=0x7f9f40010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f56ffd700 1 --2- 172.21.15.84:0/1174503417 >> v2:172.21.15.84:3300/0 conn(0x7f9f5808ef10 0x7f9f580a2a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9f5808fc50 tx=0x7f9f40010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f56ffd700 1 --2- 172.21.15.84:0/1174503417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f5808ef10 0x7f9f580a2a20 secure :-1 s=READY pgs=560 cs=0 l=1 rx=0x7f9f5808fc50 tx=0x7f9f40010b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f56ffd700 1 --2- 172.21.15.84:0/1174503417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f5808ef10 0x7f9f580a2a20 secure :-1 s=THROTTLE_DONE pgs=560 cs=0 l=1 rx=0x7f9f5808fc50 tx=0x7f9f40010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f4ffff700 1 -- 172.21.15.84:0/1174503417 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f4000cbf0 con 0x7f9f5808ef10 2020-01-16T05:49:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f56ffd700 1 --2- 172.21.15.84:0/1174503417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f5808ef10 0x7f9f580a2a20 secure :-1 s=THROTTLE_DONE pgs=560 cs=0 l=1 rx=0x7f9f5808fc50 tx=0x7f9f40010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:13.179 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f56ffd700 1 --2- 172.21.15.84:0/1174503417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f5808ef10 0x7f9f580a2a20 secure :-1 s=THROTTLE_DONE pgs=560 cs=0 l=1 rx=0x7f9f5808fc50 tx=0x7f9f40010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:13.179 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f4ffff700 1 -- 172.21.15.84:0/1174503417 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4000c810 con 0x7f9f5808ef10 2020-01-16T05:49:13.179 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f57fff700 1 -- 172.21.15.84:0/1174503417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5808f410 con 0x7f9f5808ef10 2020-01-16T05:49:13.179 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f4ffff700 1 -- 172.21.15.84:0/1174503417 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f40012310 con 0x7f9f5808ef10 2020-01-16T05:49:13.179 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f57fff700 1 -- 172.21.15.84:0/1174503417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f581381c0 con 0x7f9f5808ef10 2020-01-16T05:49:13.179 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f56ffd700 1 --2- 172.21.15.84:0/1174503417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f5808ef10 0x7f9f580a2a20 secure :-1 s=THROTTLE_DONE pgs=560 cs=0 l=1 rx=0x7f9f5808fc50 tx=0x7f9f40010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:13.179 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f56ffd700 1 --2- 172.21.15.84:0/1174503417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f5808ef10 0x7f9f580a2a20 secure :-1 s=THROTTLE_DONE pgs=560 cs=0 l=1 rx=0x7f9f5808fc50 tx=0x7f9f40010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:13.180 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f4ffff700 1 -- 172.21.15.84:0/1174503417 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f9f40012620 con 0x7f9f5808ef10 2020-01-16T05:49:13.180 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f57fff700 1 -- 172.21.15.84:0/1174503417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5805e1c0 con 0x7f9f5808ef10 2020-01-16T05:49:13.181 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f4ffff700 1 --2- 172.21.15.84:0/1174503417 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9f3c03c330 0x7f9f3c03e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:13.181 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f4ffff700 1 -- 172.21.15.84:0/1174503417 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f9f4004c840 con 0x7f9f5808ef10 2020-01-16T05:49:13.181 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.172+0000 7f9f577fe700 1 --2- 172.21.15.84:0/1174503417 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9f3c03c330 0x7f9f3c03e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:13.181 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.176+0000 7f9f577fe700 1 --2- 172.21.15.84:0/1174503417 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9f3c03c330 0x7f9f3c03e840 crc :-1 s=READY pgs=212 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:13.182 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.180+0000 7f9f56ffd700 1 --2- 172.21.15.84:0/1174503417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f5808ef10 0x7f9f580a2a20 secure :-1 s=THROTTLE_DONE pgs=560 cs=0 l=1 rx=0x7f9f5808fc50 tx=0x7f9f40010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:13.182 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.180+0000 7f9f4ffff700 1 -- 172.21.15.84:0/1174503417 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f9f40032e60 con 0x7f9f5808ef10 2020-01-16T05:49:13.329 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.332+0000 7f9f57fff700 1 -- 172.21.15.84:0/1174503417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f580a3710 con 0x7f9f5808ef10 2020-01-16T05:49:13.330 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.332+0000 7f9f56ffd700 1 --2- 172.21.15.84:0/1174503417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f5808ef10 0x7f9f580a2a20 secure :-1 s=THROTTLE_DONE pgs=560 cs=0 l=1 rx=0x7f9f5808fc50 tx=0x7f9f40010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:13.330 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.332+0000 7f9f4ffff700 1 -- 172.21.15.84:0/1174503417 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f9f400330c0 con 0x7f9f5808ef10 2020-01-16T05:49:13.331 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:49:13.331 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:49:13.332 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.332+0000 7f9f57fff700 1 -- 172.21.15.84:0/1174503417 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9f3c03c330 msgr2=0x7f9f3c03e840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:13.332 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.332+0000 7f9f57fff700 1 --2- 172.21.15.84:0/1174503417 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9f3c03c330 0x7f9f3c03e840 crc :-1 s=READY pgs=212 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:13.332 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.332+0000 7f9f57fff700 1 -- 172.21.15.84:0/1174503417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f5808ef10 msgr2=0x7f9f580a2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:13.332 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.332+0000 7f9f57fff700 1 --2- 172.21.15.84:0/1174503417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f5808ef10 0x7f9f580a2a20 secure :-1 s=READY pgs=560 cs=0 l=1 rx=0x7f9f5808fc50 tx=0x7f9f40010b20).stop 2020-01-16T05:49:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.332+0000 7f9f57fff700 1 -- 172.21.15.84:0/1174503417 shutdown_connections 2020-01-16T05:49:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.332+0000 7f9f57fff700 1 --2- 172.21.15.84:0/1174503417 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f9f3c03c330 0x7f9f3c03e840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.332+0000 7f9f57fff700 1 --2- 172.21.15.84:0/1174503417 >> v2:172.21.15.142:3300/0 conn(0x7f9f58127390 0x7f9f5808ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.332+0000 7f9f57fff700 1 --2- 172.21.15.84:0/1174503417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f5808ef10 0x7f9f580a2a20 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.332+0000 7f9f57fff700 1 -- 172.21.15.84:0/1174503417 shutdown_connections 2020-01-16T05:49:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.332+0000 7f9f57fff700 1 -- 172.21.15.84:0/1174503417 wait complete. 2020-01-16T05:49:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:13.332+0000 7f9f57fff700 1 -- 172.21.15.84:0/1174503417 >> 172.21.15.84:0/1174503417 conn(0x7f9f580ab6b0 msgr2=0x7f9f580a3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:13.334 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:49:13.343 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:49:14.922 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:49:14.924 INFO:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-01-16T05:49:15.344 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:49:15.469 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.464+0000 7fc211075700 1 Processor -- start 2020-01-16T05:49:15.469 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.464+0000 7fc211075700 1 -- start start 2020-01-16T05:49:15.469 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.464+0000 7fc211075700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc20c0a9b30 0x7fc20c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:15.469 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.464+0000 7fc211075700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc20c0a4250 0x7fc20c066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:15.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.464+0000 7fc211075700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c066dd0 con 0x7fc20c07ff10 2020-01-16T05:49:15.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.464+0000 7fc211075700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c0a4830 con 0x7fc20c0a9b30 2020-01-16T05:49:15.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.464+0000 7fc211075700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c07f9d0 con 0x7fc20c0a4250 2020-01-16T05:49:15.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc210874700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc20c0a9b30 0x7fc20c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:15.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc210874700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc20c0a9b30 0x7fc20c0abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36884/0 (socket says 172.21.15.84:36884) 2020-01-16T05:49:15.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc210874700 1 -- 172.21.15.84:0/1688420672 learned_addr learned my addr 172.21.15.84:0/1688420672 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:49:15.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc2122d7700 1 --2- 172.21.15.84:0/1688420672 >> v2:172.21.15.142:3300/0 conn(0x7fc20c0a4250 0x7fc20c066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:15.471 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc210874700 1 -- 172.21.15.84:0/1688420672 >> v2:172.21.15.142:3300/0 conn(0x7fc20c0a4250 msgr2=0x7fc20c066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:49:15.471 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc210874700 1 --2- 172.21.15.84:0/1688420672 >> v2:172.21.15.142:3300/0 conn(0x7fc20c0a4250 0x7fc20c066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:15.471 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc210874700 1 -- 172.21.15.84:0/1688420672 >> v1:172.21.15.142:6789/0 conn(0x7fc20c07ff10 legacy=0x7fc20c0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:15.471 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc210874700 1 -- 172.21.15.84:0/1688420672 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c150ce0 con 0x7fc20c0a9b30 2020-01-16T05:49:15.471 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc210874700 1 --2- 172.21.15.84:0/1688420672 >> v2:172.21.15.84:3300/0 conn(0x7fc20c0a9b30 0x7fc20c0abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc20c0a49f0 tx=0x7fc1fc00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:15.471 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc210874700 1 --2- 172.21.15.84:0/1688420672 >> v2:172.21.15.84:3300/0 conn(0x7fc20c0a9b30 0x7fc20c0abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc20c0a49f0 tx=0x7fc1fc00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:15.471 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc210874700 1 --2- 172.21.15.84:0/1688420672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc20c0a9b30 0x7fc20c0abdd0 secure :-1 s=READY pgs=561 cs=0 l=1 rx=0x7fc20c0a49f0 tx=0x7fc1fc00feb0).ready entity=mon.0 client_cookie=1c7afa9429c6cb4b server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:15.472 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc210874700 1 --2- 172.21.15.84:0/1688420672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc20c0a9b30 0x7fc20c0abdd0 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7fc20c0a49f0 tx=0x7fc1fc00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:15.472 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc210874700 1 --2- 172.21.15.84:0/1688420672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc20c0a9b30 0x7fc20c0abdd0 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7fc20c0a49f0 tx=0x7fc1fc00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:15.472 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc20b7fe700 1 -- 172.21.15.84:0/1688420672 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1fc0116e0 con 0x7fc20c0a9b30 2020-01-16T05:49:15.472 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc210874700 1 --2- 172.21.15.84:0/1688420672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc20c0a9b30 0x7fc20c0abdd0 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7fc20c0a49f0 tx=0x7fc1fc00feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:15.472 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc20b7fe700 1 -- 172.21.15.84:0/1688420672 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc008d30 con 0x7fc20c0a9b30 2020-01-16T05:49:15.472 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc20b7fe700 1 -- 172.21.15.84:0/1688420672 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1fc011cc0 con 0x7fc20c0a9b30 2020-01-16T05:49:15.472 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc211075700 1 -- 172.21.15.84:0/1688420672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc20c0a9b30 msgr2=0x7fc20c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:15.473 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc211075700 1 --2- 172.21.15.84:0/1688420672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc20c0a9b30 0x7fc20c0abdd0 secure :-1 s=READY pgs=561 cs=0 l=1 rx=0x7fc20c0a49f0 tx=0x7fc1fc00feb0).stop 2020-01-16T05:49:15.473 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc211075700 1 -- 172.21.15.84:0/1688420672 shutdown_connections 2020-01-16T05:49:15.473 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc211075700 1 --2- 172.21.15.84:0/1688420672 >> v2:172.21.15.142:3300/0 conn(0x7fc20c0a4250 0x7fc20c066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:15.473 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc211075700 1 --2- 172.21.15.84:0/1688420672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc20c0a9b30 0x7fc20c0abdd0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:15.473 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc211075700 1 -- 172.21.15.84:0/1688420672 shutdown_connections 2020-01-16T05:49:15.474 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc211075700 1 -- 172.21.15.84:0/1688420672 wait complete. 2020-01-16T05:49:15.474 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.468+0000 7fc211075700 1 -- 172.21.15.84:0/1688420672 >> 172.21.15.84:0/1688420672 conn(0x7fc20c0acfc0 msgr2=0x7fc20c0a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:15.474 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc211075700 1 Processor -- start 2020-01-16T05:49:15.474 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc211075700 1 -- start start 2020-01-16T05:49:15.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc211075700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc20c0a8920 0x7fc20c13d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:15.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc211075700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c07b710 con 0x7fc20c07da80 2020-01-16T05:49:15.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc211075700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c0a74e0 con 0x7fc20c125380 2020-01-16T05:49:15.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc211075700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c1257b0 con 0x7fc20c0a8920 2020-01-16T05:49:15.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc210874700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc20c07da80 0x7fc20c09f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54088/0 (socket says 172.21.15.84:54088) 2020-01-16T05:49:15.479 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc210874700 1 -- 172.21.15.84:0/3388895123 learned_addr learned my addr 172.21.15.84:0/3388895123 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:49:15.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2122d7700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc20c0a8920 0x7fc20c13d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:15.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363248956 0 0) 0x7fc20c07b710 con 0x7fc20c07da80 2020-01-16T05:49:15.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1ec003230 con 0x7fc20c07da80 2020-01-16T05:49:15.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716155624 0 0) 0x7fc20c0a74e0 con 0x7fc20c125380 2020-01-16T05:49:15.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc20c07b710 con 0x7fc20c125380 2020-01-16T05:49:15.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2725518376 0 0) 0x7fc1ec003230 con 0x7fc20c07da80 2020-01-16T05:49:15.480 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc20c0a74e0 con 0x7fc20c07da80 2020-01-16T05:49:15.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1137577903 0 0) 0x7fc1fc007a40 con 0x7fc20c07da80 2020-01-16T05:49:15.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc20c0a8920 msgr2=0x7fc20c13d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:15.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2097fa700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc20c0a8920 0x7fc20c13d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:15.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 >> v1:172.21.15.142:6789/0 conn(0x7fc20c125380 legacy=0x7fc20c0a8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:15.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 >> v1:172.21.15.84:6789/0 conn(0x7fc20c07da80 legacy=0x7fc20c09f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:15.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2097fa700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1ec003c30 0x7fc1ec0045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:15.481 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2097fa700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec004110 0x7fc1ec004b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:15.482 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2097fa700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1ec0097e0 0x7fc1ec00bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:15.482 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec005210 con 0x7fc1ec004110 2020-01-16T05:49:15.482 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec00c170 con 0x7fc1ec003c30 2020-01-16T05:49:15.482 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec00c330 con 0x7fc1ec0097e0 2020-01-16T05:49:15.482 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc20bfff700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec004110 0x7fc1ec004b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:15.482 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc2122d7700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1ec0097e0 0x7fc1ec00bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:15.482 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc210874700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1ec003c30 0x7fc1ec0045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:15.483 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc20bfff700 1 -- 172.21.15.84:0/3388895123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1ec0097e0 msgr2=0x7fc1ec00bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:15.483 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc20bfff700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1ec0097e0 0x7fc1ec00bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:15.483 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc20bfff700 1 -- 172.21.15.84:0/3388895123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1ec003c30 msgr2=0x7fc1ec0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:15.483 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc20bfff700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1ec003c30 0x7fc1ec0045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:15.483 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc20bfff700 1 -- 172.21.15.84:0/3388895123 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c13f640 con 0x7fc1ec004110 2020-01-16T05:49:15.483 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc211075700 1 -- 172.21.15.84:0/3388895123 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc20c0a8920 con 0x7fc1ec004110 2020-01-16T05:49:15.483 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.472+0000 7fc20bfff700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec004110 0x7fc1ec004b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc200002220 tx=0x7fc200010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:15.484 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.476+0000 7fc211075700 1 -- 172.21.15.84:0/3388895123 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20c13b0c0 con 0x7fc1ec004110 2020-01-16T05:49:15.484 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.476+0000 7fc20bfff700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec004110 0x7fc1ec004b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc200002220 tx=0x7fc200010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:15.485 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.476+0000 7fc20bfff700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec004110 0x7fc1ec004b70 secure :-1 s=READY pgs=563 cs=0 l=1 rx=0x7fc200002220 tx=0x7fc200010d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:15.485 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.476+0000 7fc20bfff700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec004110 0x7fc1ec004b70 secure :-1 s=THROTTLE_DONE pgs=563 cs=0 l=1 rx=0x7fc200002220 tx=0x7fc200010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:15.485 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.476+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc200012b30 con 0x7fc1ec004110 2020-01-16T05:49:15.485 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.476+0000 7fc20bfff700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec004110 0x7fc1ec004b70 secure :-1 s=THROTTLE_DONE pgs=563 cs=0 l=1 rx=0x7fc200002220 tx=0x7fc200010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:15.486 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.476+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc200012750 con 0x7fc1ec004110 2020-01-16T05:49:15.486 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.476+0000 7fc20bfff700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec004110 0x7fc1ec004b70 secure :-1 s=THROTTLE_DONE pgs=563 cs=0 l=1 rx=0x7fc200002220 tx=0x7fc200010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:15.486 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.476+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc20000c730 con 0x7fc1ec004110 2020-01-16T05:49:15.486 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.476+0000 7fc20bfff700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec004110 0x7fc1ec004b70 secure :-1 s=THROTTLE_DONE pgs=563 cs=0 l=1 rx=0x7fc200002220 tx=0x7fc200010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:15.486 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.476+0000 7fc211075700 1 -- 172.21.15.84:0/3388895123 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e4003360 con 0x7fc1ec004110 2020-01-16T05:49:15.486 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.476+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fc20000c930 con 0x7fc1ec004110 2020-01-16T05:49:15.487 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.476+0000 7fc20bfff700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec004110 0x7fc1ec004b70 secure :-1 s=THROTTLE_DONE pgs=563 cs=0 l=1 rx=0x7fc200002220 tx=0x7fc200010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:15.487 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.476+0000 7fc2097fa700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc1ec0454c0 0x7fc1ec0479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:15.487 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.476+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fc20004cab0 con 0x7fc1ec004110 2020-01-16T05:49:15.487 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.476+0000 7fc210874700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc1ec0454c0 0x7fc1ec0479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:15.487 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.476+0000 7fc210874700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc1ec0454c0 0x7fc1ec0479d0 crc :-1 s=READY pgs=213 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:15.488 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.480+0000 7fc20bfff700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec004110 0x7fc1ec004b70 secure :-1 s=THROTTLE_DONE pgs=563 cs=0 l=1 rx=0x7fc200002220 tx=0x7fc200010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:15.488 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.480+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fc2000330b0 con 0x7fc1ec004110 2020-01-16T05:49:15.633 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.636+0000 7fc211075700 1 -- 172.21.15.84:0/3388895123 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1e4003790 con 0x7fc1ec004110 2020-01-16T05:49:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.636+0000 7fc20bfff700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec004110 0x7fc1ec004b70 secure :-1 s=THROTTLE_DONE pgs=563 cs=0 l=1 rx=0x7fc200002220 tx=0x7fc200010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.636+0000 7fc2097fa700 1 -- 172.21.15.84:0/3388895123 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fc200033310 con 0x7fc1ec004110 2020-01-16T05:49:15.634 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:49:15.634 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:49:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.636+0000 7fc211075700 1 -- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc1ec0454c0 msgr2=0x7fc1ec0479d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.636+0000 7fc211075700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fc1ec0454c0 0x7fc1ec0479d0 crc :-1 s=READY pgs=213 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.636+0000 7fc211075700 1 -- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec004110 msgr2=0x7fc1ec004b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.636+0000 7fc2122d7700 1 -- 172.21.15.84:0/3388895123 reap_dead start 2020-01-16T05:49:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.636+0000 7fc211075700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec004110 0x7fc1ec004b70 secure :-1 s=READY pgs=563 cs=0 l=1 rx=0x7fc200002220 tx=0x7fc200010d10).stop 2020-01-16T05:49:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.636+0000 7fc211075700 1 -- 172.21.15.84:0/3388895123 shutdown_connections 2020-01-16T05:49:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.636+0000 7fc211075700 1 --2- 172.21.15.84:0/3388895123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec004110 0x7fc1ec004b70 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.636+0000 7fc211075700 1 -- 172.21.15.84:0/3388895123 shutdown_connections 2020-01-16T05:49:15.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.636+0000 7fc211075700 1 -- 172.21.15.84:0/3388895123 wait complete. 2020-01-16T05:49:15.637 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:15.636+0000 7fc211075700 1 -- 172.21.15.84:0/3388895123 >> 172.21.15.84:0/3388895123 conn(0x7fc20c0a9b30 msgr2=0x7fc20c07cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:15.637 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:49:15.652 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:49:17.652 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:49:17.776 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.772+0000 7fe6d3ad4700 1 Processor -- start 2020-01-16T05:49:17.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.772+0000 7fe6d3ad4700 1 -- start start 2020-01-16T05:49:17.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d3ad4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe6cc05b0f0 0x7fe6cc0a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:17.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d3ad4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6cc07cd60 con 0x7fe6cc0a2f60 2020-01-16T05:49:17.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d3ad4700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6cc08f570 con 0x7fe6cc08fd80 2020-01-16T05:49:17.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d3ad4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6cc0a3390 con 0x7fe6cc05b0f0 2020-01-16T05:49:17.777 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d2071700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe6cc0a2f60 0x7fe6cc07c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54102/0 (socket says 172.21.15.84:54102) 2020-01-16T05:49:17.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d2071700 1 -- 172.21.15.84:0/3480510285 learned_addr learned my addr 172.21.15.84:0/3480510285 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:49:17.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d1870700 1 --2- 172.21.15.84:0/3480510285 >> v2:172.21.15.84:3300/0 conn(0x7fe6cc05b0f0 0x7fe6cc0a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:17.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d1870700 1 -- 172.21.15.84:0/3480510285 >> v1:172.21.15.142:6789/0 conn(0x7fe6cc08fd80 legacy=0x7fe6cc1503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:17.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d1870700 1 -- 172.21.15.84:0/3480510285 >> v1:172.21.15.84:6789/0 conn(0x7fe6cc0a2f60 legacy=0x7fe6cc07c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:17.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d1870700 1 -- 172.21.15.84:0/3480510285 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc05b520 con 0x7fe6cc05b0f0 2020-01-16T05:49:17.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d1870700 1 --2- 172.21.15.84:0/3480510285 >> v2:172.21.15.84:3300/0 conn(0x7fe6cc05b0f0 0x7fe6cc0a8ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe6bc002f30 tx=0x7fe6bc00fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:17.778 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d1870700 1 --2- 172.21.15.84:0/3480510285 >> v2:172.21.15.84:3300/0 conn(0x7fe6cc05b0f0 0x7fe6cc0a8ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe6bc002f30 tx=0x7fe6bc00fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:17.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d1870700 1 --2- 172.21.15.84:0/3480510285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6cc05b0f0 0x7fe6cc0a8ff0 secure :-1 s=READY pgs=565 cs=0 l=1 rx=0x7fe6bc002f30 tx=0x7fe6bc00fd70).ready entity=mon.0 client_cookie=4d12d1e068d7e20d server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:17.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d1870700 1 --2- 172.21.15.84:0/3480510285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6cc05b0f0 0x7fe6cc0a8ff0 secure :-1 s=THROTTLE_DONE pgs=565 cs=0 l=1 rx=0x7fe6bc002f30 tx=0x7fe6bc00fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:17.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d106f700 1 -- 172.21.15.84:0/3480510285 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6bc0115a0 con 0x7fe6cc05b0f0 2020-01-16T05:49:17.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d1870700 1 --2- 172.21.15.84:0/3480510285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6cc05b0f0 0x7fe6cc0a8ff0 secure :-1 s=THROTTLE_DONE pgs=565 cs=0 l=1 rx=0x7fe6bc002f30 tx=0x7fe6bc00fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:17.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d1870700 1 --2- 172.21.15.84:0/3480510285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6cc05b0f0 0x7fe6cc0a8ff0 secure :-1 s=THROTTLE_DONE pgs=565 cs=0 l=1 rx=0x7fe6bc002f30 tx=0x7fe6bc00fd70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:17.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d106f700 1 -- 172.21.15.84:0/3480510285 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6bc008d40 con 0x7fe6cc05b0f0 2020-01-16T05:49:17.779 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d106f700 1 -- 172.21.15.84:0/3480510285 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6bc011b80 con 0x7fe6cc05b0f0 2020-01-16T05:49:17.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d3ad4700 1 -- 172.21.15.84:0/3480510285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6cc05b0f0 msgr2=0x7fe6cc0a8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:17.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d3ad4700 1 --2- 172.21.15.84:0/3480510285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6cc05b0f0 0x7fe6cc0a8ff0 secure :-1 s=READY pgs=565 cs=0 l=1 rx=0x7fe6bc002f30 tx=0x7fe6bc00fd70).stop 2020-01-16T05:49:17.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d3ad4700 1 -- 172.21.15.84:0/3480510285 shutdown_connections 2020-01-16T05:49:17.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d3ad4700 1 --2- 172.21.15.84:0/3480510285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6cc05b0f0 0x7fe6cc0a8ff0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:17.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d3ad4700 1 -- 172.21.15.84:0/3480510285 shutdown_connections 2020-01-16T05:49:17.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d3ad4700 1 -- 172.21.15.84:0/3480510285 wait complete. 2020-01-16T05:49:17.780 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.776+0000 7fe6d3ad4700 1 -- 172.21.15.84:0/3480510285 >> 172.21.15.84:0/3480510285 conn(0x7fe6cc0abc10 msgr2=0x7fe6cc05a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:17.783 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.780+0000 7fe6d3ad4700 1 Processor -- start 2020-01-16T05:49:17.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.780+0000 7fe6d3ad4700 1 -- start start 2020-01-16T05:49:17.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.780+0000 7fe6d3ad4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6cc0a1a10 0x7fe6cc07fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:17.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.780+0000 7fe6d3ad4700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe6cc1398e0 0x7fe6cc13bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:17.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.780+0000 7fe6d3ad4700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6cc127640 con 0x7fe6cc069b40 2020-01-16T05:49:17.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.780+0000 7fe6d3ad4700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6cc061200 con 0x7fe6cc1398e0 2020-01-16T05:49:17.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.780+0000 7fe6d3ad4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc0614a0 con 0x7fe6cc0a1a10 2020-01-16T05:49:17.784 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.780+0000 7fe6d2071700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6cc0a1a10 0x7fe6cc07fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:17.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.780+0000 7fe6d2872700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe6cc1398e0 0x7fe6cc13bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:17.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.780+0000 7fe6d2071700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6cc0a1a10 0x7fe6cc07fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.84:49152/0 (socket says 172.21.15.84:49152) 2020-01-16T05:49:17.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.780+0000 7fe6d2071700 1 -- 172.21.15.84:0/24298077 learned_addr learned my addr 172.21.15.84:0/24298077 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:49:17.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.780+0000 7fe6d1870700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe6cc069b40 0x7fe6cc126e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.84:52334/0 (socket says 172.21.15.84:52334) 2020-01-16T05:49:17.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6d2071700 1 -- 172.21.15.84:0/24298077 >> v2:172.21.15.142:3300/0 conn(0x7fe6cc1398e0 msgr2=0x7fe6cc13bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:17.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6d2071700 1 --2- 172.21.15.84:0/24298077 >> v2:172.21.15.142:3300/0 conn(0x7fe6cc1398e0 0x7fe6cc13bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:17.785 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6d2071700 1 -- 172.21.15.84:0/24298077 >> v1:172.21.15.142:6789/0 conn(0x7fe6cc069b40 legacy=0x7fe6cc126e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:17.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6d2071700 1 -- 172.21.15.84:0/24298077 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc0619e0 con 0x7fe6cc0a1a10 2020-01-16T05:49:17.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6d2071700 1 --2- 172.21.15.84:0/24298077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6cc0a1a10 0x7fe6cc07fb60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe6c8004520 tx=0x7fe6c8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:17.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6d2071700 1 --2- 172.21.15.84:0/24298077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6cc0a1a10 0x7fe6cc07fb60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe6c8004520 tx=0x7fe6c8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:17.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6d2071700 1 --2- 172.21.15.84:0/24298077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6cc0a1a10 0x7fe6cc07fb60 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7fe6c8004520 tx=0x7fe6c8010b80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:17.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6d2071700 1 --2- 172.21.15.84:0/24298077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6cc0a1a10 0x7fe6cc07fb60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fe6c8004520 tx=0x7fe6c8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:17.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6d2071700 1 --2- 172.21.15.84:0/24298077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6cc0a1a10 0x7fe6cc07fb60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fe6c8004520 tx=0x7fe6c8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:17.786 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6c2ffd700 1 -- 172.21.15.84:0/24298077 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6c800c840 con 0x7fe6cc0a1a10 2020-01-16T05:49:17.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6d2071700 1 --2- 172.21.15.84:0/24298077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6cc0a1a10 0x7fe6cc07fb60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fe6c8004520 tx=0x7fe6c8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:17.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6c2ffd700 1 -- 172.21.15.84:0/24298077 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c8013060 con 0x7fe6cc0a1a10 2020-01-16T05:49:17.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6c2ffd700 1 -- 172.21.15.84:0/24298077 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6c80045b0 con 0x7fe6cc0a1a10 2020-01-16T05:49:17.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6d3ad4700 1 -- 172.21.15.84:0/24298077 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6cc069f70 con 0x7fe6cc0a1a10 2020-01-16T05:49:17.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6d3ad4700 1 -- 172.21.15.84:0/24298077 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6cc0a5ab0 con 0x7fe6cc0a1a10 2020-01-16T05:49:17.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6d2071700 1 --2- 172.21.15.84:0/24298077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6cc0a1a10 0x7fe6cc07fb60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fe6c8004520 tx=0x7fe6c8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:17.787 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6d3ad4700 1 -- 172.21.15.84:0/24298077 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6cc05e1c0 con 0x7fe6cc0a1a10 2020-01-16T05:49:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6d2071700 1 --2- 172.21.15.84:0/24298077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6cc0a1a10 0x7fe6cc07fb60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fe6c8004520 tx=0x7fe6c8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6c2ffd700 1 -- 172.21.15.84:0/24298077 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fe6c8004880 con 0x7fe6cc0a1a10 2020-01-16T05:49:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6c2ffd700 1 --2- 172.21.15.84:0/24298077 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe6b403c270 0x7fe6b403e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:17.799 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6c2ffd700 1 -- 172.21.15.84:0/24298077 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fe6c804c720 con 0x7fe6cc0a1a10 2020-01-16T05:49:17.800 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6d1870700 1 --2- 172.21.15.84:0/24298077 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe6b403c270 0x7fe6b403e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:17.800 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.784+0000 7fe6d1870700 1 --2- 172.21.15.84:0/24298077 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe6b403c270 0x7fe6b403e780 crc :-1 s=READY pgs=214 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:17.800 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.796+0000 7fe6d2071700 1 --2- 172.21.15.84:0/24298077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6cc0a1a10 0x7fe6cc07fb60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fe6c8004520 tx=0x7fe6c8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:17.801 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.796+0000 7fe6c2ffd700 1 -- 172.21.15.84:0/24298077 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fe6c8032f60 con 0x7fe6cc0a1a10 2020-01-16T05:49:17.946 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.948+0000 7fe6d3ad4700 1 -- 172.21.15.84:0/24298077 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6cc08f350 con 0x7fe6cc0a1a10 2020-01-16T05:49:17.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.948+0000 7fe6d2071700 1 --2- 172.21.15.84:0/24298077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6cc0a1a10 0x7fe6cc07fb60 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fe6c8004520 tx=0x7fe6c8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:17.947 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.948+0000 7fe6c2ffd700 1 -- 172.21.15.84:0/24298077 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fe6c80345f0 con 0x7fe6cc0a1a10 2020-01-16T05:49:17.948 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:49:17.948 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:49:17.951 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.952+0000 7fe6d3ad4700 1 -- 172.21.15.84:0/24298077 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe6b403c270 msgr2=0x7fe6b403e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:17.951 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.952+0000 7fe6d3ad4700 1 --2- 172.21.15.84:0/24298077 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe6b403c270 0x7fe6b403e780 crc :-1 s=READY pgs=214 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:17.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.952+0000 7fe6d3ad4700 1 -- 172.21.15.84:0/24298077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6cc0a1a10 msgr2=0x7fe6cc07fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:17.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.952+0000 7fe6d3ad4700 1 --2- 172.21.15.84:0/24298077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6cc0a1a10 0x7fe6cc07fb60 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7fe6c8004520 tx=0x7fe6c8010b80).stop 2020-01-16T05:49:17.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.952+0000 7fe6d3ad4700 1 -- 172.21.15.84:0/24298077 shutdown_connections 2020-01-16T05:49:17.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.952+0000 7fe6d3ad4700 1 --2- 172.21.15.84:0/24298077 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fe6b403c270 0x7fe6b403e780 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:17.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.952+0000 7fe6d3ad4700 1 --2- 172.21.15.84:0/24298077 >> v2:172.21.15.142:3300/0 conn(0x7fe6cc1398e0 0x7fe6cc13bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:17.952 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.952+0000 7fe6d3ad4700 1 --2- 172.21.15.84:0/24298077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6cc0a1a10 0x7fe6cc07fb60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:17.953 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.952+0000 7fe6d3ad4700 1 -- 172.21.15.84:0/24298077 shutdown_connections 2020-01-16T05:49:17.953 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.952+0000 7fe6d3ad4700 1 -- 172.21.15.84:0/24298077 wait complete. 2020-01-16T05:49:17.953 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:17.952+0000 7fe6d3ad4700 1 -- 172.21.15.84:0/24298077 >> 172.21.15.84:0/24298077 conn(0x7fe6cc08ef10 msgr2=0x7fe6cc0a3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:17.953 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:49:17.964 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 10, "feature_flags": { "enable_multiple": false, "ever_enabled_multiple": false }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2020-01-16T05:44:03.929689+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 10, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4359": { "addr": "172.21.15.84:6835/571032774", "addrs": { "addrvec": [ { "addr": "172.21.15.84:6834", "nonce": 571032774, "type": "v2" }, { "addr": "172.21.15.84:6835", "nonce": 571032774, "type": "v1" } ] }, "export_targets": [], "features": 4540138292836696063, "flags": 0, "gid": 4359, "incarnation": 6, "laggy_since": "2020-01-16T05:45:26.539100+0000", "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 25, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 2, "min_compat_client": "0 (unknown)", "modified": "2020-01-16T05:45:26.539180+0000", "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4359 } } } ], "standbys": [] } 2020-01-16T05:49:18.458 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~291s 2020-01-16T05:49:19.966 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:49:20.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.076+0000 7fa2a8cc5700 1 Processor -- start 2020-01-16T05:49:20.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.076+0000 7fa2a8cc5700 1 -- start start 2020-01-16T05:49:20.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a8cc5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2a407ff10 0x7fa2a40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:20.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a8cc5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a40a4250 0x7fa2a4066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:20.082 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a8cc5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a4066dd0 con 0x7fa2a40a9b30 2020-01-16T05:49:20.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a8cc5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a40a4830 con 0x7fa2a407ff10 2020-01-16T05:49:20.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a8cc5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a407f9d0 con 0x7fa2a40a4250 2020-01-16T05:49:20.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa2a40a9b30 0x7fa2a40a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54116/0 (socket says 172.21.15.84:54116) 2020-01-16T05:49:20.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a3fff700 1 -- 172.21.15.84:0/1832947023 learned_addr learned my addr 172.21.15.84:0/1832947023 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:49:20.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/1832947023 >> v2:172.21.15.84:3300/0 conn(0x7fa2a407ff10 0x7fa2a40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:20.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a9f27700 1 --2- 172.21.15.84:0/1832947023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a40a4250 0x7fa2a4066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:20.083 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a2ffd700 1 -- 172.21.15.84:0/1832947023 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938202270 0 0) 0x7fa2a4066dd0 con 0x7fa2a40a9b30 2020-01-16T05:49:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a2ffd700 1 -- 172.21.15.84:0/1832947023 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa290003230 con 0x7fa2a40a9b30 2020-01-16T05:49:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a37fe700 1 -- 172.21.15.84:0/1832947023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a40a4250 msgr2=0x7fa2a4066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:49:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/1832947023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a40a4250 0x7fa2a4066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a2ffd700 1 -- 172.21.15.84:0/1832947023 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2864313525 0 0) 0x7fa290003230 con 0x7fa2a40a9b30 2020-01-16T05:49:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a37fe700 1 -- 172.21.15.84:0/1832947023 >> v1:172.21.15.84:6789/0 conn(0x7fa2a40a9b30 legacy=0x7fa2a40a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a37fe700 1 -- 172.21.15.84:0/1832947023 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a4150ce0 con 0x7fa2a407ff10 2020-01-16T05:49:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/1832947023 >> v2:172.21.15.84:3300/0 conn(0x7fa2a407ff10 0x7fa2a40abdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa294001d10 tx=0x7fa294001d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:20.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/1832947023 >> v2:172.21.15.84:3300/0 conn(0x7fa2a407ff10 0x7fa2a40abdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa294001d10 tx=0x7fa294001d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:20.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/1832947023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a407ff10 0x7fa2a40abdd0 secure :-1 s=READY pgs=567 cs=0 l=1 rx=0x7fa294001d10 tx=0x7fa294001d50).ready entity=mon.0 client_cookie=a762da3df84388cf server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:20.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/1832947023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a407ff10 0x7fa2a40abdd0 secure :-1 s=THROTTLE_DONE pgs=567 cs=0 l=1 rx=0x7fa294001d10 tx=0x7fa294001d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:20.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a2ffd700 1 -- 172.21.15.84:0/1832947023 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa294001ad0 con 0x7fa2a407ff10 2020-01-16T05:49:20.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/1832947023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a407ff10 0x7fa2a40abdd0 secure :-1 s=THROTTLE_DONE pgs=567 cs=0 l=1 rx=0x7fa294001d10 tx=0x7fa294001d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:20.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/1832947023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a407ff10 0x7fa2a40abdd0 secure :-1 s=THROTTLE_DONE pgs=567 cs=0 l=1 rx=0x7fa294001d10 tx=0x7fa294001d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:20.085 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a2ffd700 1 -- 172.21.15.84:0/1832947023 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2940018e0 con 0x7fa2a407ff10 2020-01-16T05:49:20.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a2ffd700 1 -- 172.21.15.84:0/1832947023 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa28c011750 con 0x7fa2a407ff10 2020-01-16T05:49:20.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a8cc5700 1 -- 172.21.15.84:0/1832947023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a407ff10 msgr2=0x7fa2a40abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:20.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.080+0000 7fa2a8cc5700 1 --2- 172.21.15.84:0/1832947023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a407ff10 0x7fa2a40abdd0 secure :-1 s=READY pgs=567 cs=0 l=1 rx=0x7fa294001d10 tx=0x7fa294001d50).stop 2020-01-16T05:49:20.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.084+0000 7fa2a8cc5700 1 -- 172.21.15.84:0/1832947023 shutdown_connections 2020-01-16T05:49:20.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.084+0000 7fa2a8cc5700 1 --2- 172.21.15.84:0/1832947023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a40a4250 0x7fa2a4066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:20.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.084+0000 7fa2a8cc5700 1 --2- 172.21.15.84:0/1832947023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a407ff10 0x7fa2a40abdd0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:20.086 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.084+0000 7fa2a8cc5700 1 -- 172.21.15.84:0/1832947023 shutdown_connections 2020-01-16T05:49:20.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.084+0000 7fa2a8cc5700 1 -- 172.21.15.84:0/1832947023 wait complete. 2020-01-16T05:49:20.087 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.084+0000 7fa2a8cc5700 1 -- 172.21.15.84:0/1832947023 >> 172.21.15.84:0/1832947023 conn(0x7fa2a40acfc0 msgr2=0x7fa2a40a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:20.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.084+0000 7fa2a8cc5700 1 Processor -- start 2020-01-16T05:49:20.090 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.084+0000 7fa2a8cc5700 1 -- start start 2020-01-16T05:49:20.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.084+0000 7fa2a8cc5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2a408f980 0x7fa2a408fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:20.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.084+0000 7fa2a8cc5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a413adf0 0x7fa2a413d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:20.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.084+0000 7fa2a8cc5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a4091cf0 con 0x7fa2a40a5320 2020-01-16T05:49:20.091 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.084+0000 7fa2a8cc5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a40917b0 con 0x7fa2a408f980 2020-01-16T05:49:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.084+0000 7fa2a8cc5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a4091a50 con 0x7fa2a413adf0 2020-01-16T05:49:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.084+0000 7fa2a3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa2a40a5320 0x7fa2a4126630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54122/0 (socket says 172.21.15.84:54122) 2020-01-16T05:49:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a3fff700 1 -- 172.21.15.84:0/2892037804 learned_addr learned my addr 172.21.15.84:0/2892037804 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:49:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/2892037804 >> v2:172.21.15.84:3300/0 conn(0x7fa2a408f980 0x7fa2a408fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a9f27700 1 --2- 172.21.15.84:0/2892037804 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a413adf0 0x7fa2a413d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a37fe700 1 -- 172.21.15.84:0/2892037804 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a413adf0 msgr2=0x7fa2a413d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/2892037804 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a413adf0 0x7fa2a413d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:20.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a37fe700 1 -- 172.21.15.84:0/2892037804 >> v1:172.21.15.84:6789/0 conn(0x7fa2a40a5320 legacy=0x7fa2a4126630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:20.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a0ff9700 1 -- 172.21.15.84:0/2892037804 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758865107 0 0) 0x7fa2a4091cf0 con 0x7fa2a40a5320 2020-01-16T05:49:20.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a37fe700 1 -- 172.21.15.84:0/2892037804 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a4090300 con 0x7fa2a408f980 2020-01-16T05:49:20.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/2892037804 >> v2:172.21.15.84:3300/0 conn(0x7fa2a408f980 0x7fa2a408fdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa294001d10 tx=0x7fa28c008f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:20.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/2892037804 >> v2:172.21.15.84:3300/0 conn(0x7fa2a408f980 0x7fa2a408fdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa294001d10 tx=0x7fa28c008f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:20.093 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/2892037804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a408f980 0x7fa2a408fdb0 secure :-1 s=READY pgs=569 cs=0 l=1 rx=0x7fa294001d10 tx=0x7fa28c008f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:20.094 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/2892037804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a408f980 0x7fa2a408fdb0 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fa294001d10 tx=0x7fa28c008f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:20.094 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/2892037804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a408f980 0x7fa2a408fdb0 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fa294001d10 tx=0x7fa28c008f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:20.094 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a0ff9700 1 -- 172.21.15.84:0/2892037804 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa28c007340 con 0x7fa2a408f980 2020-01-16T05:49:20.094 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/2892037804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a408f980 0x7fa2a408fdb0 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fa294001d10 tx=0x7fa28c008f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:20.094 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a0ff9700 1 -- 172.21.15.84:0/2892037804 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c011370 con 0x7fa2a408f980 2020-01-16T05:49:20.094 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a0ff9700 1 -- 172.21.15.84:0/2892037804 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa28c00f740 con 0x7fa2a408f980 2020-01-16T05:49:20.094 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a8cc5700 1 -- 172.21.15.84:0/2892037804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a4091380 con 0x7fa2a408f980 2020-01-16T05:49:20.095 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a8cc5700 1 -- 172.21.15.84:0/2892037804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a409fb50 con 0x7fa2a408f980 2020-01-16T05:49:20.095 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/2892037804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a408f980 0x7fa2a408fdb0 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fa294001d10 tx=0x7fa28c008f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:20.095 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a8cc5700 1 -- 172.21.15.84:0/2892037804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a405e1c0 con 0x7fa2a408f980 2020-01-16T05:49:20.095 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a0ff9700 1 -- 172.21.15.84:0/2892037804 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fa28c0056c0 con 0x7fa2a408f980 2020-01-16T05:49:20.095 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/2892037804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a408f980 0x7fa2a408fdb0 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fa294001d10 tx=0x7fa28c008f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:20.095 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a0ff9700 1 --2- 172.21.15.84:0/2892037804 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa28803c1e0 0x7fa28803e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:20.095 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a0ff9700 1 -- 172.21.15.84:0/2892037804 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fa28c04cb30 con 0x7fa2a408f980 2020-01-16T05:49:20.095 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.088+0000 7fa2a3fff700 1 --2- 172.21.15.84:0/2892037804 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa28803c1e0 0x7fa28803e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:20.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.092+0000 7fa2a3fff700 1 --2- 172.21.15.84:0/2892037804 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa28803c1e0 0x7fa28803e6f0 crc :-1 s=READY pgs=215 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:20.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.096+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/2892037804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a408f980 0x7fa2a408fdb0 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fa294001d10 tx=0x7fa28c008f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:20.096 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.096+0000 7fa2a0ff9700 1 -- 172.21.15.84:0/2892037804 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fa28c033150 con 0x7fa2a408f980 2020-01-16T05:49:20.247 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.248+0000 7fa2a8cc5700 1 -- 172.21.15.84:0/2892037804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2a405cbc0 con 0x7fa2a408f980 2020-01-16T05:49:20.248 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.248+0000 7fa2a37fe700 1 --2- 172.21.15.84:0/2892037804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a408f980 0x7fa2a408fdb0 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fa294001d10 tx=0x7fa28c008f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:20.248 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.248+0000 7fa2a0ff9700 1 -- 172.21.15.84:0/2892037804 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fa28c0333b0 con 0x7fa2a408f980 2020-01-16T05:49:20.248 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:49:20.248 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:49:20.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.252+0000 7fa2a8cc5700 1 -- 172.21.15.84:0/2892037804 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa28803c1e0 msgr2=0x7fa28803e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:20.250 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.252+0000 7fa2a8cc5700 1 --2- 172.21.15.84:0/2892037804 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa28803c1e0 0x7fa28803e6f0 crc :-1 s=READY pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:20.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.252+0000 7fa2a8cc5700 1 -- 172.21.15.84:0/2892037804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a408f980 msgr2=0x7fa2a408fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:20.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.252+0000 7fa2a8cc5700 1 --2- 172.21.15.84:0/2892037804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a408f980 0x7fa2a408fdb0 secure :-1 s=READY pgs=569 cs=0 l=1 rx=0x7fa294001d10 tx=0x7fa28c008f60).stop 2020-01-16T05:49:20.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.252+0000 7fa2a8cc5700 1 -- 172.21.15.84:0/2892037804 shutdown_connections 2020-01-16T05:49:20.252 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.252+0000 7fa2a8cc5700 1 --2- 172.21.15.84:0/2892037804 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fa28803c1e0 0x7fa28803e6f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:20.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.252+0000 7fa2a8cc5700 1 --2- 172.21.15.84:0/2892037804 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a413adf0 0x7fa2a413d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:20.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.252+0000 7fa2a8cc5700 1 --2- 172.21.15.84:0/2892037804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a408f980 0x7fa2a408fdb0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:20.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.252+0000 7fa2a8cc5700 1 -- 172.21.15.84:0/2892037804 shutdown_connections 2020-01-16T05:49:20.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.252+0000 7fa2a8cc5700 1 -- 172.21.15.84:0/2892037804 wait complete. 2020-01-16T05:49:20.253 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:20.252+0000 7fa2a8cc5700 1 -- 172.21.15.84:0/2892037804 >> 172.21.15.84:0/2892037804 conn(0x7fa2a40a9b30 msgr2=0x7fa2a40a3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:20.254 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:49:20.263 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:49:22.264 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:49:22.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91614e700 1 Processor -- start 2020-01-16T05:49:22.395 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91614e700 1 -- start start 2020-01-16T05:49:22.396 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91614e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9100a9b30 0x7fb9100abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:22.396 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91614e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb91007ff10 0x7fb910066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:22.396 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91614e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb9100a4250 0x7fb9100a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:22.396 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91614e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9100a4830 con 0x7fb91007ff10 2020-01-16T05:49:22.396 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91614e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91007f9d0 con 0x7fb9100a4250 2020-01-16T05:49:22.396 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91614e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91007fc70 con 0x7fb9100a9b30 2020-01-16T05:49:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91514c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb91007ff10 0x7fb910066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91514c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb91007ff10 0x7fb910066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36934/0 (socket says 172.21.15.84:36934) 2020-01-16T05:49:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91514c700 1 -- 172.21.15.84:0/3895033008 learned_addr learned my addr 172.21.15.84:0/3895033008 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:49:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb9173b0700 1 --2- 172.21.15.84:0/3895033008 >> v2:172.21.15.142:3300/0 conn(0x7fb9100a4250 0x7fb9100a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91594d700 1 --2- 172.21.15.84:0/3895033008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9100a9b30 0x7fb9100abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:22.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91514c700 1 -- 172.21.15.84:0/3895033008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9100a9b30 msgr2=0x7fb9100abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:49:22.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91514c700 1 --2- 172.21.15.84:0/3895033008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9100a9b30 0x7fb9100abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:22.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91514c700 1 -- 172.21.15.84:0/3895033008 >> v2:172.21.15.142:3300/0 conn(0x7fb9100a4250 msgr2=0x7fb9100a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:49:22.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91514c700 1 --2- 172.21.15.84:0/3895033008 >> v2:172.21.15.142:3300/0 conn(0x7fb9100a4250 0x7fb9100a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:22.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91514c700 1 -- 172.21.15.84:0/3895033008 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb910066dd0 con 0x7fb91007ff10 2020-01-16T05:49:22.398 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91514c700 1 --2- 172.21.15.84:0/3895033008 >> v2:172.21.15.84:3300/0 conn(0x7fb91007ff10 0x7fb910066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb9100a49f0 tx=0x7fb90400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:22.399 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91514c700 1 --2- 172.21.15.84:0/3895033008 >> v2:172.21.15.84:3300/0 conn(0x7fb91007ff10 0x7fb910066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb9100a49f0 tx=0x7fb90400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:22.399 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91514c700 1 --2- 172.21.15.84:0/3895033008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb91007ff10 0x7fb910066880 secure :-1 s=READY pgs=570 cs=0 l=1 rx=0x7fb9100a49f0 tx=0x7fb90400ff30).ready entity=mon.0 client_cookie=dca58832fc8eea8f server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:22.399 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91514c700 1 --2- 172.21.15.84:0/3895033008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb91007ff10 0x7fb910066880 secure :-1 s=THROTTLE_DONE pgs=570 cs=0 l=1 rx=0x7fb9100a49f0 tx=0x7fb90400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:22.399 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91494b700 1 -- 172.21.15.84:0/3895033008 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb904011760 con 0x7fb91007ff10 2020-01-16T05:49:22.399 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91514c700 1 --2- 172.21.15.84:0/3895033008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb91007ff10 0x7fb910066880 secure :-1 s=THROTTLE_DONE pgs=570 cs=0 l=1 rx=0x7fb9100a49f0 tx=0x7fb90400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:22.399 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91494b700 1 -- 172.21.15.84:0/3895033008 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb904008d30 con 0x7fb91007ff10 2020-01-16T05:49:22.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91514c700 1 --2- 172.21.15.84:0/3895033008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb91007ff10 0x7fb910066880 secure :-1 s=THROTTLE_DONE pgs=570 cs=0 l=1 rx=0x7fb9100a49f0 tx=0x7fb90400ff30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:22.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91494b700 1 -- 172.21.15.84:0/3895033008 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb904011d40 con 0x7fb91007ff10 2020-01-16T05:49:22.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91614e700 1 -- 172.21.15.84:0/3895033008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb91007ff10 msgr2=0x7fb910066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:22.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.388+0000 7fb91614e700 1 --2- 172.21.15.84:0/3895033008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb91007ff10 0x7fb910066880 secure :-1 s=READY pgs=570 cs=0 l=1 rx=0x7fb9100a49f0 tx=0x7fb90400ff30).stop 2020-01-16T05:49:22.400 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.392+0000 7fb91614e700 1 -- 172.21.15.84:0/3895033008 shutdown_connections 2020-01-16T05:49:22.401 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.392+0000 7fb91614e700 1 --2- 172.21.15.84:0/3895033008 >> v2:172.21.15.142:3300/0 conn(0x7fb9100a4250 0x7fb9100a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:22.401 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.392+0000 7fb91614e700 1 --2- 172.21.15.84:0/3895033008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9100a9b30 0x7fb9100abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:22.401 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.392+0000 7fb91614e700 1 --2- 172.21.15.84:0/3895033008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb91007ff10 0x7fb910066880 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:22.401 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.392+0000 7fb91614e700 1 -- 172.21.15.84:0/3895033008 shutdown_connections 2020-01-16T05:49:22.401 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.392+0000 7fb91614e700 1 -- 172.21.15.84:0/3895033008 wait complete. 2020-01-16T05:49:22.401 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.392+0000 7fb91614e700 1 -- 172.21.15.84:0/3895033008 >> 172.21.15.84:0/3895033008 conn(0x7fb9100acfc0 msgr2=0x7fb9100a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:22.402 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.392+0000 7fb91614e700 1 Processor -- start 2020-01-16T05:49:22.402 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.392+0000 7fb91614e700 1 -- start start 2020-01-16T05:49:22.402 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91614e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb910127ba0 0x7fb9100a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:22.402 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91614e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb91009f480 0x7fb91009f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:22.402 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91614e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb910127500 con 0x7fb9100a1050 2020-01-16T05:49:22.403 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91614e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9100a2ba0 con 0x7fb91009f480 2020-01-16T05:49:22.403 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91614e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9100a2e40 con 0x7fb910127ba0 2020-01-16T05:49:22.403 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91514c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb91009f480 0x7fb91009f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:22.403 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91514c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb91009f480 0x7fb91009f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36938/0 (socket says 172.21.15.84:36938) 2020-01-16T05:49:22.403 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91514c700 1 -- 172.21.15.84:0/3513389775 learned_addr learned my addr 172.21.15.84:0/3513389775 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:49:22.403 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91594d700 1 --2- 172.21.15.84:0/3513389775 >> v2:172.21.15.142:3300/0 conn(0x7fb910127ba0 0x7fb9100a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:22.404 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91514c700 1 -- 172.21.15.84:0/3513389775 >> v2:172.21.15.142:3300/0 conn(0x7fb910127ba0 msgr2=0x7fb9100a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:22.404 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91514c700 1 --2- 172.21.15.84:0/3513389775 >> v2:172.21.15.142:3300/0 conn(0x7fb910127ba0 0x7fb9100a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:22.404 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91514c700 1 -- 172.21.15.84:0/3513389775 >> v1:172.21.15.142:6789/0 conn(0x7fb9100a1050 legacy=0x7fb9100a1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:22.404 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91514c700 1 -- 172.21.15.84:0/3513389775 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9100a0b20 con 0x7fb91009f480 2020-01-16T05:49:22.404 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb90e7fc700 1 -- 172.21.15.84:0/3513389775 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768103566 0 0) 0x7fb910127500 con 0x7fb9100a1050 2020-01-16T05:49:22.404 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91514c700 1 --2- 172.21.15.84:0/3513389775 >> v2:172.21.15.84:3300/0 conn(0x7fb91009f480 0x7fb91009f8b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb9100a2d60 tx=0x7fb904011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:22.405 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91514c700 1 --2- 172.21.15.84:0/3513389775 >> v2:172.21.15.84:3300/0 conn(0x7fb91009f480 0x7fb91009f8b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb9100a2d60 tx=0x7fb904011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:22.405 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91514c700 1 --2- 172.21.15.84:0/3513389775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb91009f480 0x7fb91009f8b0 secure :-1 s=READY pgs=571 cs=0 l=1 rx=0x7fb9100a2d60 tx=0x7fb904011850).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:22.405 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91514c700 1 --2- 172.21.15.84:0/3513389775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb91009f480 0x7fb91009f8b0 secure :-1 s=THROTTLE_DONE pgs=571 cs=0 l=1 rx=0x7fb9100a2d60 tx=0x7fb904011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:22.405 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb90e7fc700 1 -- 172.21.15.84:0/3513389775 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb90400f700 con 0x7fb91009f480 2020-01-16T05:49:22.405 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91514c700 1 --2- 172.21.15.84:0/3513389775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb91009f480 0x7fb91009f8b0 secure :-1 s=THROTTLE_DONE pgs=571 cs=0 l=1 rx=0x7fb9100a2d60 tx=0x7fb904011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:22.405 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91514c700 1 --2- 172.21.15.84:0/3513389775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb91009f480 0x7fb91009f8b0 secure :-1 s=THROTTLE_DONE pgs=571 cs=0 l=1 rx=0x7fb9100a2d60 tx=0x7fb904011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:22.405 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb90e7fc700 1 -- 172.21.15.84:0/3513389775 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb904011960 con 0x7fb91009f480 2020-01-16T05:49:22.406 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb90e7fc700 1 -- 172.21.15.84:0/3513389775 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb904007530 con 0x7fb91009f480 2020-01-16T05:49:22.406 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91614e700 1 -- 172.21.15.84:0/3513389775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91013d200 con 0x7fb91009f480 2020-01-16T05:49:22.406 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91614e700 1 -- 172.21.15.84:0/3513389775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91013d410 con 0x7fb91009f480 2020-01-16T05:49:22.406 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91514c700 1 --2- 172.21.15.84:0/3513389775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb91009f480 0x7fb91009f8b0 secure :-1 s=THROTTLE_DONE pgs=571 cs=0 l=1 rx=0x7fb9100a2d60 tx=0x7fb904011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:22.407 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91614e700 1 -- 172.21.15.84:0/3513389775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91005e1c0 con 0x7fb91009f480 2020-01-16T05:49:22.407 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb90e7fc700 1 -- 172.21.15.84:0/3513389775 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7fb9040056c0 con 0x7fb91009f480 2020-01-16T05:49:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91514c700 1 --2- 172.21.15.84:0/3513389775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb91009f480 0x7fb91009f8b0 secure :-1 s=THROTTLE_DONE pgs=571 cs=0 l=1 rx=0x7fb9100a2d60 tx=0x7fb904011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb90e7fc700 1 --2- 172.21.15.84:0/3513389775 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb8f003c190 0x7fb8f003e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb90e7fc700 1 -- 172.21.15.84:0/3513389775 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7fb904090da0 con 0x7fb91009f480 2020-01-16T05:49:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.396+0000 7fb91594d700 1 --2- 172.21.15.84:0/3513389775 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb8f003c190 0x7fb8f003e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.400+0000 7fb91594d700 1 --2- 172.21.15.84:0/3513389775 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb8f003c190 0x7fb8f003e6a0 crc :-1 s=READY pgs=216 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.400+0000 7fb91514c700 1 --2- 172.21.15.84:0/3513389775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb91009f480 0x7fb91009f8b0 secure :-1 s=THROTTLE_DONE pgs=571 cs=0 l=1 rx=0x7fb9100a2d60 tx=0x7fb904011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:22.409 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.400+0000 7fb90e7fc700 1 -- 172.21.15.84:0/3513389775 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7fb9100a0b20 con 0x7fb91009f480 2020-01-16T05:49:22.550 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.552+0000 7fb91614e700 1 -- 172.21.15.84:0/3513389775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9100a8e90 con 0x7fb91009f480 2020-01-16T05:49:22.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.552+0000 7fb91514c700 1 --2- 172.21.15.84:0/3513389775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb91009f480 0x7fb91009f8b0 secure :-1 s=THROTTLE_DONE pgs=571 cs=0 l=1 rx=0x7fb9100a2d60 tx=0x7fb904011850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:22.551 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.552+0000 7fb90e7fc700 1 -- 172.21.15.84:0/3513389775 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7fb9040773a0 con 0x7fb91009f480 2020-01-16T05:49:22.551 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:49:22.552 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:49:22.553 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.552+0000 7fb91614e700 1 -- 172.21.15.84:0/3513389775 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb8f003c190 msgr2=0x7fb8f003e6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:22.553 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.552+0000 7fb91614e700 1 --2- 172.21.15.84:0/3513389775 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb8f003c190 0x7fb8f003e6a0 crc :-1 s=READY pgs=216 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:22.553 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.552+0000 7fb91614e700 1 -- 172.21.15.84:0/3513389775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb91009f480 msgr2=0x7fb91009f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:22.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.552+0000 7fb91614e700 1 --2- 172.21.15.84:0/3513389775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb91009f480 0x7fb91009f8b0 secure :-1 s=READY pgs=571 cs=0 l=1 rx=0x7fb9100a2d60 tx=0x7fb904011850).stop 2020-01-16T05:49:22.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.552+0000 7fb91614e700 1 -- 172.21.15.84:0/3513389775 shutdown_connections 2020-01-16T05:49:22.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.552+0000 7fb91614e700 1 --2- 172.21.15.84:0/3513389775 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7fb8f003c190 0x7fb8f003e6a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:22.554 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.552+0000 7fb91614e700 1 --2- 172.21.15.84:0/3513389775 >> v2:172.21.15.142:3300/0 conn(0x7fb910127ba0 0x7fb9100a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:22.555 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.552+0000 7fb91614e700 1 --2- 172.21.15.84:0/3513389775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb91009f480 0x7fb91009f8b0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:22.556 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.556+0000 7fb91614e700 1 -- 172.21.15.84:0/3513389775 shutdown_connections 2020-01-16T05:49:22.556 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.556+0000 7fb91614e700 1 -- 172.21.15.84:0/3513389775 wait complete. 2020-01-16T05:49:22.556 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:22.556+0000 7fb91614e700 1 -- 172.21.15.84:0/3513389775 >> 172.21.15.84:0/3513389775 conn(0x7fb910066650 msgr2=0x7fb91007dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:22.556 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:49:22.564 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:49:24.565 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:49:24.690 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61facb8700 1 Processor -- start 2020-01-16T05:49:24.690 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61facb8700 1 -- start start 2020-01-16T05:49:24.691 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61facb8700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f61f40a9b30 0x7f61f40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:24.691 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61facb8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f407ff10 0x7f61f4066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:24.691 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61facb8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f4066dd0 con 0x7f61f40a4250 2020-01-16T05:49:24.691 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61facb8700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f40a4830 con 0x7f61f40a9b30 2020-01-16T05:49:24.691 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61facb8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f407f9d0 con 0x7f61f407ff10 2020-01-16T05:49:24.692 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61fbf1a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f61f40a4250 0x7f61f40a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54152/0 (socket says 172.21.15.84:54152) 2020-01-16T05:49:24.692 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61fbf1a700 1 -- 172.21.15.84:0/3991554264 learned_addr learned my addr 172.21.15.84:0/3991554264 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:49:24.692 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61fa4b7700 1 --2- 172.21.15.84:0/3991554264 >> v2:172.21.15.142:3300/0 conn(0x7f61f40a9b30 0x7f61f40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:24.692 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61f9cb6700 1 --2- 172.21.15.84:0/3991554264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f407ff10 0x7f61f4066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:24.692 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61f94b5700 1 -- 172.21.15.84:0/3991554264 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555274517 0 0) 0x7f61f4066dd0 con 0x7f61f40a4250 2020-01-16T05:49:24.693 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61f94b5700 1 -- 172.21.15.84:0/3991554264 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e0003230 con 0x7f61f40a4250 2020-01-16T05:49:24.693 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61f9cb6700 1 -- 172.21.15.84:0/3991554264 >> v2:172.21.15.142:3300/0 conn(0x7f61f40a9b30 msgr2=0x7f61f40abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:49:24.693 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61f9cb6700 1 --2- 172.21.15.84:0/3991554264 >> v2:172.21.15.142:3300/0 conn(0x7f61f40a9b30 0x7f61f40abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:24.693 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61f9cb6700 1 -- 172.21.15.84:0/3991554264 >> v1:172.21.15.84:6789/0 conn(0x7f61f40a4250 legacy=0x7f61f40a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:24.693 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61f9cb6700 1 -- 172.21.15.84:0/3991554264 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f4150ce0 con 0x7f61f407ff10 2020-01-16T05:49:24.693 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61f9cb6700 1 --2- 172.21.15.84:0/3991554264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f407ff10 0x7f61f4066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f61dc008c90 tx=0x7f61dc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:24.694 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61f9cb6700 1 --2- 172.21.15.84:0/3991554264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f407ff10 0x7f61f4066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f61dc008c90 tx=0x7f61dc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:24.694 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61f9cb6700 1 --2- 172.21.15.84:0/3991554264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f407ff10 0x7f61f4066880 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f61dc008c90 tx=0x7f61dc010170).ready entity=mon.2 client_cookie=a3b052dd8b62019f server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:24.694 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61f9cb6700 1 --2- 172.21.15.84:0/3991554264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f407ff10 0x7f61f4066880 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f61dc008c90 tx=0x7f61dc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:24.694 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61f94b5700 1 -- 172.21.15.84:0/3991554264 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61dc00a160 con 0x7f61f407ff10 2020-01-16T05:49:24.694 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61f9cb6700 1 --2- 172.21.15.84:0/3991554264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f407ff10 0x7f61f4066880 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f61dc008c90 tx=0x7f61dc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:24.694 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61f94b5700 1 -- 172.21.15.84:0/3991554264 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc011af0 con 0x7f61f407ff10 2020-01-16T05:49:24.695 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61f9cb6700 1 --2- 172.21.15.84:0/3991554264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f407ff10 0x7f61f4066880 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f61dc008c90 tx=0x7f61dc010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:24.695 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61f94b5700 1 -- 172.21.15.84:0/3991554264 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61dc00a740 con 0x7f61f407ff10 2020-01-16T05:49:24.695 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61facb8700 1 -- 172.21.15.84:0/3991554264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f407ff10 msgr2=0x7f61f4066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:24.696 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.688+0000 7f61facb8700 1 --2- 172.21.15.84:0/3991554264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f407ff10 0x7f61f4066880 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f61dc008c90 tx=0x7f61dc010170).stop 2020-01-16T05:49:24.696 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61facb8700 1 -- 172.21.15.84:0/3991554264 shutdown_connections 2020-01-16T05:49:24.696 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61facb8700 1 --2- 172.21.15.84:0/3991554264 >> v2:172.21.15.142:3300/0 conn(0x7f61f40a9b30 0x7f61f40abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:24.696 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61facb8700 1 --2- 172.21.15.84:0/3991554264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f407ff10 0x7f61f4066880 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:24.696 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61facb8700 1 -- 172.21.15.84:0/3991554264 shutdown_connections 2020-01-16T05:49:24.696 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61facb8700 1 -- 172.21.15.84:0/3991554264 wait complete. 2020-01-16T05:49:24.697 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61facb8700 1 -- 172.21.15.84:0/3991554264 >> 172.21.15.84:0/3991554264 conn(0x7f61f40acfc0 msgr2=0x7f61f40a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:24.701 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61facb8700 1 Processor -- start 2020-01-16T05:49:24.701 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61facb8700 1 -- start start 2020-01-16T05:49:24.701 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61facb8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f61f4065870 0x7f61f4094910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:24.701 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61facb8700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f61f407ed20 0x7f61f407f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:24.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61facb8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f4090200 con 0x7f61f4092c50 2020-01-16T05:49:24.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61facb8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f4090630 con 0x7f61f4065870 2020-01-16T05:49:24.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61facb8700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f40908d0 con 0x7f61f407ed20 2020-01-16T05:49:24.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61fa4b7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f61f4065870 0x7f61f4094910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:24.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61fbf1a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f61f4092c50 0x7f61f4093080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54158/0 (socket says 172.21.15.84:54158) 2020-01-16T05:49:24.702 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61fa4b7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f61f4065870 0x7f61f4094910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36954/0 (socket says 172.21.15.84:36954) 2020-01-16T05:49:24.703 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61fbf1a700 1 -- 172.21.15.84:0/375910113 learned_addr learned my addr 172.21.15.84:0/375910113 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:49:24.703 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61f9cb6700 1 --2- 172.21.15.84:0/375910113 >> v2:172.21.15.142:3300/0 conn(0x7f61f407ed20 0x7f61f407f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:24.703 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61fa4b7700 1 -- 172.21.15.84:0/375910113 >> v2:172.21.15.142:3300/0 conn(0x7f61f407ed20 msgr2=0x7f61f407f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:24.703 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61fa4b7700 1 --2- 172.21.15.84:0/375910113 >> v2:172.21.15.142:3300/0 conn(0x7f61f407ed20 0x7f61f407f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:24.703 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61fa4b7700 1 -- 172.21.15.84:0/375910113 >> v1:172.21.15.84:6789/0 conn(0x7f61f4092c50 legacy=0x7f61f4093080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:24.703 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61fa4b7700 1 -- 172.21.15.84:0/375910113 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f41403f0 con 0x7f61f4065870 2020-01-16T05:49:24.704 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61fa4b7700 1 --2- 172.21.15.84:0/375910113 >> v2:172.21.15.84:3300/0 conn(0x7f61f4065870 0x7f61f4094910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f61f407f920 tx=0x7f61ec010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:24.704 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61fa4b7700 1 --2- 172.21.15.84:0/375910113 >> v2:172.21.15.84:3300/0 conn(0x7f61f4065870 0x7f61f4094910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f61f407f920 tx=0x7f61ec010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:24.704 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.692+0000 7f61fa4b7700 1 --2- 172.21.15.84:0/375910113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f4065870 0x7f61f4094910 secure :-1 s=READY pgs=574 cs=0 l=1 rx=0x7f61f407f920 tx=0x7f61ec010c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:24.704 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.696+0000 7f61fa4b7700 1 --2- 172.21.15.84:0/375910113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f4065870 0x7f61f4094910 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7f61f407f920 tx=0x7f61ec010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:24.704 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.696+0000 7f61f2ffd700 1 -- 172.21.15.84:0/375910113 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61ec005aa0 con 0x7f61f4065870 2020-01-16T05:49:24.704 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.696+0000 7f61fa4b7700 1 --2- 172.21.15.84:0/375910113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f4065870 0x7f61f4094910 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7f61f407f920 tx=0x7f61ec010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:24.704 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.696+0000 7f61fa4b7700 1 --2- 172.21.15.84:0/375910113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f4065870 0x7f61f4094910 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7f61f407f920 tx=0x7f61ec010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:24.705 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.696+0000 7f61f2ffd700 1 -- 172.21.15.84:0/375910113 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ec0056c0 con 0x7f61f4065870 2020-01-16T05:49:24.705 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.696+0000 7f61f2ffd700 1 -- 172.21.15.84:0/375910113 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61ec0126a0 con 0x7f61f4065870 2020-01-16T05:49:24.705 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.696+0000 7f61facb8700 1 -- 172.21.15.84:0/375910113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f413f3e0 con 0x7f61f4065870 2020-01-16T05:49:24.705 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.696+0000 7f61facb8700 1 -- 172.21.15.84:0/375910113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f413f910 con 0x7f61f4065870 2020-01-16T05:49:24.705 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.696+0000 7f61fa4b7700 1 --2- 172.21.15.84:0/375910113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f4065870 0x7f61f4094910 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7f61f407f920 tx=0x7f61ec010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:24.705 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.696+0000 7f61facb8700 1 -- 172.21.15.84:0/375910113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f4090430 con 0x7f61f4065870 2020-01-16T05:49:24.706 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.696+0000 7f61f2ffd700 1 -- 172.21.15.84:0/375910113 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f61ec0129c0 con 0x7f61f4065870 2020-01-16T05:49:24.706 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.696+0000 7f61fa4b7700 1 --2- 172.21.15.84:0/375910113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f4065870 0x7f61f4094910 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7f61f407f920 tx=0x7f61ec010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:24.706 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.696+0000 7f61f2ffd700 1 --2- 172.21.15.84:0/375910113 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f61d803c2b0 0x7f61d803e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:24.706 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.696+0000 7f61f2ffd700 1 -- 172.21.15.84:0/375910113 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f61ec04ccb0 con 0x7f61f4065870 2020-01-16T05:49:24.706 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.696+0000 7f61f9cb6700 1 --2- 172.21.15.84:0/375910113 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f61d803c2b0 0x7f61d803e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:24.706 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.696+0000 7f61f9cb6700 1 --2- 172.21.15.84:0/375910113 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f61d803c2b0 0x7f61d803e7c0 crc :-1 s=READY pgs=217 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:24.707 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.704+0000 7f61fa4b7700 1 --2- 172.21.15.84:0/375910113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f4065870 0x7f61f4094910 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7f61f407f920 tx=0x7f61ec010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:24.707 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.704+0000 7f61f2ffd700 1 -- 172.21.15.84:0/375910113 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f61ec00d0a0 con 0x7f61f4065870 2020-01-16T05:49:24.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~298s 2020-01-16T05:49:24.852 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.852+0000 7f61facb8700 1 -- 172.21.15.84:0/375910113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61f405e1c0 con 0x7f61f4065870 2020-01-16T05:49:24.853 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.856+0000 7f61fa4b7700 1 --2- 172.21.15.84:0/375910113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f4065870 0x7f61f4094910 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7f61f407f920 tx=0x7f61ec010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:24.853 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.856+0000 7f61f2ffd700 1 -- 172.21.15.84:0/375910113 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f61ec013060 con 0x7f61f4065870 2020-01-16T05:49:24.853 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:49:24.854 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:49:24.854 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.856+0000 7f61facb8700 1 -- 172.21.15.84:0/375910113 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f61d803c2b0 msgr2=0x7f61d803e7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:24.854 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.856+0000 7f61facb8700 1 --2- 172.21.15.84:0/375910113 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f61d803c2b0 0x7f61d803e7c0 crc :-1 s=READY pgs=217 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:24.854 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.856+0000 7f61facb8700 1 -- 172.21.15.84:0/375910113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f4065870 msgr2=0x7f61f4094910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:24.855 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.856+0000 7f61facb8700 1 --2- 172.21.15.84:0/375910113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f4065870 0x7f61f4094910 secure :-1 s=READY pgs=574 cs=0 l=1 rx=0x7f61f407f920 tx=0x7f61ec010c10).stop 2020-01-16T05:49:24.855 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.856+0000 7f61facb8700 1 -- 172.21.15.84:0/375910113 shutdown_connections 2020-01-16T05:49:24.856 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.856+0000 7f61facb8700 1 --2- 172.21.15.84:0/375910113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f4065870 0x7f61f4094910 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:24.856 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.856+0000 7f61facb8700 1 --2- 172.21.15.84:0/375910113 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f61d803c2b0 0x7f61d803e7c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:24.856 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.856+0000 7f61facb8700 1 --2- 172.21.15.84:0/375910113 >> v2:172.21.15.142:3300/0 conn(0x7f61f407ed20 0x7f61f407f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:24.856 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.856+0000 7f61facb8700 1 -- 172.21.15.84:0/375910113 shutdown_connections 2020-01-16T05:49:24.856 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.856+0000 7f61facb8700 1 -- 172.21.15.84:0/375910113 wait complete. 2020-01-16T05:49:24.856 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:24.856+0000 7f61facb8700 1 -- 172.21.15.84:0/375910113 >> 172.21.15.84:0/375910113 conn(0x7f61f4066730 msgr2=0x7f61f40a5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:24.857 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:49:24.866 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:49:26.868 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:49:26.995 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba415d700 1 Processor -- start 2020-01-16T05:49:26.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba415d700 1 -- start start 2020-01-16T05:49:26.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba415d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8b9c0a8ff0 0x7f8b9c08fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:26.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba415d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9c0902d0 con 0x7f8b9c05b0f0 2020-01-16T05:49:26.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba415d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9c07cd60 con 0x7f8b9c0a2f60 2020-01-16T05:49:26.996 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba415d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9c0a3390 con 0x7f8b9c0a8ff0 2020-01-16T05:49:26.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba1ef9700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8b9c05b0f0 0x7f8b9c14e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54166/0 (socket says 172.21.15.84:54166) 2020-01-16T05:49:26.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba1ef9700 1 -- 172.21.15.84:0/1904182501 learned_addr learned my addr 172.21.15.84:0/1904182501 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:49:26.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba2efb700 1 --2- 172.21.15.84:0/1904182501 >> v2:172.21.15.142:3300/0 conn(0x7f8b9c0a8ff0 0x7f8b9c08fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:26.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba16f8700 1 -- 172.21.15.84:0/1904182501 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896041415 0 0) 0x7f8b90001450 con 0x7f8b9c05b0f0 2020-01-16T05:49:26.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba16f8700 1 -- 172.21.15.84:0/1904182501 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b88003230 con 0x7f8b9c05b0f0 2020-01-16T05:49:26.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba2efb700 1 -- 172.21.15.84:0/1904182501 >> v1:172.21.15.142:6789/0 conn(0x7f8b9c0a2f60 legacy=0x7f8b9c07c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:26.997 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba2efb700 1 -- 172.21.15.84:0/1904182501 >> v1:172.21.15.84:6789/0 conn(0x7f8b9c05b0f0 legacy=0x7f8b9c14e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:26.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba16f8700 1 -- 172.21.15.84:0/1904182501 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3847321886 0 0) 0x7f8b88003230 con 0x7f8b9c05b0f0 2020-01-16T05:49:26.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba2efb700 1 -- 172.21.15.84:0/1904182501 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c05b520 con 0x7f8b9c0a8ff0 2020-01-16T05:49:26.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba2efb700 1 --2- 172.21.15.84:0/1904182501 >> v2:172.21.15.142:3300/0 conn(0x7f8b9c0a8ff0 0x7f8b9c08fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8b90001f40 tx=0x7f8b90001a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:26.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba2efb700 1 --2- 172.21.15.84:0/1904182501 >> v2:172.21.15.142:3300/0 conn(0x7f8b9c0a8ff0 0x7f8b9c08fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8b90001f40 tx=0x7f8b90001a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:26.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba2efb700 1 --2- 172.21.15.84:0/1904182501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b9c0a8ff0 0x7f8b9c08fd80 secure :-1 s=READY pgs=339 cs=0 l=1 rx=0x7f8b90001f40 tx=0x7f8b90001a50).ready entity=mon.1 client_cookie=4f8446a9ac6681a8 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:26.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba2efb700 1 --2- 172.21.15.84:0/1904182501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b9c0a8ff0 0x7f8b9c08fd80 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7f8b90001f40 tx=0x7f8b90001a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:26.998 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba16f8700 1 -- 172.21.15.84:0/1904182501 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b90001d00 con 0x7f8b9c0a8ff0 2020-01-16T05:49:26.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba2efb700 1 --2- 172.21.15.84:0/1904182501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b9c0a8ff0 0x7f8b9c08fd80 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7f8b90001f40 tx=0x7f8b90001a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:26.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba16f8700 1 -- 172.21.15.84:0/1904182501 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b90001b10 con 0x7f8b9c0a8ff0 2020-01-16T05:49:26.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba415d700 1 -- 172.21.15.84:0/1904182501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b9c0a8ff0 msgr2=0x7f8b9c08fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:26.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba2efb700 1 --2- 172.21.15.84:0/1904182501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b9c0a8ff0 0x7f8b9c08fd80 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7f8b90001f40 tx=0x7f8b90001a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:26.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba415d700 1 --2- 172.21.15.84:0/1904182501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b9c0a8ff0 0x7f8b9c08fd80 secure :-1 s=READY pgs=339 cs=0 l=1 rx=0x7f8b90001f40 tx=0x7f8b90001a50).stop 2020-01-16T05:49:26.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba16f8700 1 -- 172.21.15.84:0/1904182501 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b94011770 con 0x7f8b9c0a8ff0 2020-01-16T05:49:26.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba415d700 1 -- 172.21.15.84:0/1904182501 shutdown_connections 2020-01-16T05:49:26.999 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.988+0000 7f8ba415d700 1 --2- 172.21.15.84:0/1904182501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b9c0a8ff0 0x7f8b9c08fd80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:27.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba415d700 1 -- 172.21.15.84:0/1904182501 shutdown_connections 2020-01-16T05:49:27.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba415d700 1 -- 172.21.15.84:0/1904182501 wait complete. 2020-01-16T05:49:27.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba415d700 1 -- 172.21.15.84:0/1904182501 >> 172.21.15.84:0/1904182501 conn(0x7f8b9c0abc10 msgr2=0x7f8b9c05a750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:27.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba415d700 1 Processor -- start 2020-01-16T05:49:27.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba415d700 1 -- start start 2020-01-16T05:49:27.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba415d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8b9c0a0100 0x7f8b9c133960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:27.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba415d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b9c12f8b0 0x7f8b9c0a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:27.000 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba415d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9c132e70 con 0x7f8b9c07ba30 2020-01-16T05:49:27.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba415d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9c133180 con 0x7f8b9c12f8b0 2020-01-16T05:49:27.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba415d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9c133420 con 0x7f8b9c0a0100 2020-01-16T05:49:27.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba1ef9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b9c12f8b0 0x7f8b9c0a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:27.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba1ef9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b9c12f8b0 0x7f8b9c0a0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36976/0 (socket says 172.21.15.84:36976) 2020-01-16T05:49:27.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba1ef9700 1 -- 172.21.15.84:0/1305186167 learned_addr learned my addr 172.21.15.84:0/1305186167 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:49:27.001 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba26fa700 1 --2- 172.21.15.84:0/1305186167 >> v2:172.21.15.142:3300/0 conn(0x7f8b9c0a0100 0x7f8b9c133960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:27.002 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba1ef9700 1 -- 172.21.15.84:0/1305186167 >> v2:172.21.15.142:3300/0 conn(0x7f8b9c0a0100 msgr2=0x7f8b9c133960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:27.003 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba1ef9700 1 --2- 172.21.15.84:0/1305186167 >> v2:172.21.15.142:3300/0 conn(0x7f8b9c0a0100 0x7f8b9c133960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:27.003 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba1ef9700 1 -- 172.21.15.84:0/1305186167 >> v1:172.21.15.142:6789/0 conn(0x7f8b9c07ba30 legacy=0x7f8b9c09ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:27.003 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8b8effd700 1 -- 172.21.15.84:0/1305186167 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100943598 0 0) 0x7f8b9c132e70 con 0x7f8b9c07ba30 2020-01-16T05:49:27.003 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba1ef9700 1 -- 172.21.15.84:0/1305186167 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c12fce0 con 0x7f8b9c12f8b0 2020-01-16T05:49:27.003 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba1ef9700 1 --2- 172.21.15.84:0/1305186167 >> v2:172.21.15.84:3300/0 conn(0x7f8b9c12f8b0 0x7f8b9c0a0a60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8b9c133340 tx=0x7f8b90010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:27.003 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba1ef9700 1 --2- 172.21.15.84:0/1305186167 >> v2:172.21.15.84:3300/0 conn(0x7f8b9c12f8b0 0x7f8b9c0a0a60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8b9c133340 tx=0x7f8b90010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:27.003 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba1ef9700 1 --2- 172.21.15.84:0/1305186167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b9c12f8b0 0x7f8b9c0a0a60 secure :-1 s=READY pgs=576 cs=0 l=1 rx=0x7f8b9c133340 tx=0x7f8b90010ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:27.004 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba1ef9700 1 --2- 172.21.15.84:0/1305186167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b9c12f8b0 0x7f8b9c0a0a60 secure :-1 s=THROTTLE_DONE pgs=576 cs=0 l=1 rx=0x7f8b9c133340 tx=0x7f8b90010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:27.004 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8b8effd700 1 -- 172.21.15.84:0/1305186167 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b9000ccb0 con 0x7f8b9c12f8b0 2020-01-16T05:49:27.004 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba1ef9700 1 --2- 172.21.15.84:0/1305186167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b9c12f8b0 0x7f8b9c0a0a60 secure :-1 s=THROTTLE_DONE pgs=576 cs=0 l=1 rx=0x7f8b9c133340 tx=0x7f8b90010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:27.004 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba1ef9700 1 --2- 172.21.15.84:0/1305186167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b9c12f8b0 0x7f8b9c0a0a60 secure :-1 s=THROTTLE_DONE pgs=576 cs=0 l=1 rx=0x7f8b9c133340 tx=0x7f8b90010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:27.004 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8b8effd700 1 -- 172.21.15.84:0/1305186167 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9000c8d0 con 0x7f8b9c12f8b0 2020-01-16T05:49:27.005 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.992+0000 7f8ba415d700 1 -- 172.21.15.84:0/1305186167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9c0a0fb0 con 0x7f8b9c12f8b0 2020-01-16T05:49:27.005 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.996+0000 7f8b8effd700 1 -- 172.21.15.84:0/1305186167 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b90004c50 con 0x7f8b9c12f8b0 2020-01-16T05:49:27.005 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.996+0000 7f8ba415d700 1 -- 172.21.15.84:0/1305186167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9c07be60 con 0x7f8b9c12f8b0 2020-01-16T05:49:27.005 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.996+0000 7f8ba1ef9700 1 --2- 172.21.15.84:0/1305186167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b9c12f8b0 0x7f8b9c0a0a60 secure :-1 s=THROTTLE_DONE pgs=576 cs=0 l=1 rx=0x7f8b9c133340 tx=0x7f8b90010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:27.005 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.996+0000 7f8b8effd700 1 -- 172.21.15.84:0/1305186167 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f8b90012850 con 0x7f8b9c12f8b0 2020-01-16T05:49:27.005 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.996+0000 7f8ba1ef9700 1 --2- 172.21.15.84:0/1305186167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b9c12f8b0 0x7f8b9c0a0a60 secure :-1 s=THROTTLE_DONE pgs=576 cs=0 l=1 rx=0x7f8b9c133340 tx=0x7f8b90010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:27.005 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.996+0000 7f8b8effd700 1 --2- 172.21.15.84:0/1305186167 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f8b8403c210 0x7f8b8403e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:27.006 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.996+0000 7f8b8effd700 1 -- 172.21.15.84:0/1305186167 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f8b9c0902d0 con 0x7f8b9c12f8b0 2020-01-16T05:49:27.006 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.996+0000 7f8ba26fa700 1 --2- 172.21.15.84:0/1305186167 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f8b8403c210 0x7f8b8403e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:27.006 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.996+0000 7f8ba415d700 1 -- 172.21.15.84:0/1305186167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b9c05e1c0 con 0x7f8b9c12f8b0 2020-01-16T05:49:27.006 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:26.996+0000 7f8ba26fa700 1 --2- 172.21.15.84:0/1305186167 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f8b8403c210 0x7f8b8403e720 crc :-1 s=READY pgs=218 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:27.007 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:27.004+0000 7f8ba1ef9700 1 --2- 172.21.15.84:0/1305186167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b9c12f8b0 0x7f8b9c0a0a60 secure :-1 s=THROTTLE_DONE pgs=576 cs=0 l=1 rx=0x7f8b9c133340 tx=0x7f8b90010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:27.008 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:27.004+0000 7f8b8effd700 1 -- 172.21.15.84:0/1305186167 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f8b90033100 con 0x7f8b9c12f8b0 2020-01-16T05:49:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:27.160+0000 7f8ba415d700 1 -- 172.21.15.84:0/1305186167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b9c08f350 con 0x7f8b9c12f8b0 2020-01-16T05:49:27.158 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:27.160+0000 7f8ba1ef9700 1 --2- 172.21.15.84:0/1305186167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b9c12f8b0 0x7f8b9c0a0a60 secure :-1 s=THROTTLE_DONE pgs=576 cs=0 l=1 rx=0x7f8b9c133340 tx=0x7f8b90010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:27.158 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:27.160+0000 7f8b8effd700 1 -- 172.21.15.84:0/1305186167 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f8b90033360 con 0x7f8b9c12f8b0 2020-01-16T05:49:27.158 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:49:27.159 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:49:27.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:27.160+0000 7f8ba415d700 1 -- 172.21.15.84:0/1305186167 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f8b8403c210 msgr2=0x7f8b8403e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:27.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:27.160+0000 7f8ba415d700 1 --2- 172.21.15.84:0/1305186167 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f8b8403c210 0x7f8b8403e720 crc :-1 s=READY pgs=218 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:27.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:27.160+0000 7f8ba415d700 1 -- 172.21.15.84:0/1305186167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b9c12f8b0 msgr2=0x7f8b9c0a0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:27.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:27.160+0000 7f8ba415d700 1 --2- 172.21.15.84:0/1305186167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b9c12f8b0 0x7f8b9c0a0a60 secure :-1 s=READY pgs=576 cs=0 l=1 rx=0x7f8b9c133340 tx=0x7f8b90010ed0).stop 2020-01-16T05:49:27.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:27.160+0000 7f8ba415d700 1 -- 172.21.15.84:0/1305186167 shutdown_connections 2020-01-16T05:49:27.160 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:27.160+0000 7f8ba415d700 1 --2- 172.21.15.84:0/1305186167 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f8b8403c210 0x7f8b8403e720 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:27.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:27.160+0000 7f8ba415d700 1 --2- 172.21.15.84:0/1305186167 >> v2:172.21.15.142:3300/0 conn(0x7f8b9c0a0100 0x7f8b9c133960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:27.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:27.160+0000 7f8ba415d700 1 --2- 172.21.15.84:0/1305186167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b9c12f8b0 0x7f8b9c0a0a60 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:27.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:27.160+0000 7f8ba415d700 1 -- 172.21.15.84:0/1305186167 shutdown_connections 2020-01-16T05:49:27.161 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:27.160+0000 7f8ba415d700 1 -- 172.21.15.84:0/1305186167 wait complete. 2020-01-16T05:49:27.162 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:27.160+0000 7f8ba415d700 1 -- 172.21.15.84:0/1305186167 >> 172.21.15.84:0/1305186167 conn(0x7f8b9c0abc10 msgr2=0x7f8b9c08f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:27.162 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:49:27.172 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2020-01-16T05:49:29.174 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-16T05:49:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21dc9c7700 1 Processor -- start 2020-01-16T05:49:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21dc9c7700 1 -- start start 2020-01-16T05:49:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21dc9c7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21d80a9b30 0x7f21d80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:29.298 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21dc9c7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21d807ff10 0x7f21d8066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-16T05:49:29.298 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21dc9c7700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d8066dd0 con 0x7f21d80a4250 2020-01-16T05:49:29.298 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21dc9c7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d80a4830 con 0x7f21d807ff10 2020-01-16T05:49:29.298 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21dc9c7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d807f9d0 con 0x7f21d80a9b30 2020-01-16T05:49:29.298 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21d6d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21d807ff10 0x7f21d8066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:29.298 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21d6d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21d807ff10 0x7f21d8066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36980/0 (socket says 172.21.15.84:36980) 2020-01-16T05:49:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21d6d9d700 1 -- 172.21.15.84:0/4022277982 learned_addr learned my addr 172.21.15.84:0/4022277982 (peer_addr_for_me v2:172.21.15.84:0/0) 2020-01-16T05:49:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21d759e700 1 --2- 172.21.15.84:0/4022277982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21d80a9b30 0x7f21d80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21d6d9d700 1 -- 172.21.15.84:0/4022277982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21d80a9b30 msgr2=0x7f21d80abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-16T05:49:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21d6d9d700 1 --2- 172.21.15.84:0/4022277982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21d80a9b30 0x7f21d80abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21d6d9d700 1 -- 172.21.15.84:0/4022277982 >> v1:172.21.15.142:6789/0 conn(0x7f21d80a4250 legacy=0x7f21d80a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21d6d9d700 1 -- 172.21.15.84:0/4022277982 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d8150ce0 con 0x7f21d807ff10 2020-01-16T05:49:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21d6d9d700 1 --2- 172.21.15.84:0/4022277982 >> v2:172.21.15.84:3300/0 conn(0x7f21d807ff10 0x7f21d8066880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f21c0008910 tx=0x7f21c000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21d6d9d700 1 --2- 172.21.15.84:0/4022277982 >> v2:172.21.15.84:3300/0 conn(0x7f21d807ff10 0x7f21d8066880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f21c0008910 tx=0x7f21c000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21d6d9d700 1 --2- 172.21.15.84:0/4022277982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d807ff10 0x7f21d8066880 secure :-1 s=READY pgs=577 cs=0 l=1 rx=0x7f21c0008910 tx=0x7f21c000feb0).ready entity=mon.0 client_cookie=c63756411d258d99 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21d6d9d700 1 --2- 172.21.15.84:0/4022277982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d807ff10 0x7f21d8066880 secure :-1 s=THROTTLE_DONE pgs=577 cs=0 l=1 rx=0x7f21c0008910 tx=0x7f21c000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21d659c700 1 -- 172.21.15.84:0/4022277982 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21c0011720 con 0x7f21d807ff10 2020-01-16T05:49:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21d6d9d700 1 --2- 172.21.15.84:0/4022277982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d807ff10 0x7f21d8066880 secure :-1 s=THROTTLE_DONE pgs=577 cs=0 l=1 rx=0x7f21c0008910 tx=0x7f21c000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21d6d9d700 1 --2- 172.21.15.84:0/4022277982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d807ff10 0x7f21d8066880 secure :-1 s=THROTTLE_DONE pgs=577 cs=0 l=1 rx=0x7f21c0008910 tx=0x7f21c000feb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21d659c700 1 -- 172.21.15.84:0/4022277982 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c0008d30 con 0x7f21d807ff10 2020-01-16T05:49:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21d659c700 1 -- 172.21.15.84:0/4022277982 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21c0011d00 con 0x7f21d807ff10 2020-01-16T05:49:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21dc9c7700 1 -- 172.21.15.84:0/4022277982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d807ff10 msgr2=0x7f21d8066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21dc9c7700 1 --2- 172.21.15.84:0/4022277982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d807ff10 0x7f21d8066880 secure :-1 s=READY pgs=577 cs=0 l=1 rx=0x7f21c0008910 tx=0x7f21c000feb0).stop 2020-01-16T05:49:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21dc9c7700 1 -- 172.21.15.84:0/4022277982 shutdown_connections 2020-01-16T05:49:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21dc9c7700 1 --2- 172.21.15.84:0/4022277982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21d80a9b30 0x7f21d80abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-16T05:49:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21dc9c7700 1 --2- 172.21.15.84:0/4022277982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d807ff10 0x7f21d8066880 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21dc9c7700 1 -- 172.21.15.84:0/4022277982 shutdown_connections 2020-01-16T05:49:29.303 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21dc9c7700 1 -- 172.21.15.84:0/4022277982 wait complete. 2020-01-16T05:49:29.303 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.296+0000 7f21dc9c7700 1 -- 172.21.15.84:0/4022277982 >> 172.21.15.84:0/4022277982 conn(0x7f21d80acfc0 msgr2=0x7f21d80a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:29.307 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.300+0000 7f21dc9c7700 1 Processor -- start 2020-01-16T05:49:29.307 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.300+0000 7f21dc9c7700 1 -- start start 2020-01-16T05:49:29.307 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.300+0000 7f21dc9c7700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f21d8065840 0x7f21d81403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:29.307 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.300+0000 7f21dc9c7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d8122c40 con 0x7f21d80a3330 2020-01-16T05:49:29.307 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.300+0000 7f21dc9c7700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d807d3c0 con 0x7f21d80a1350 2020-01-16T05:49:29.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.300+0000 7f21dc9c7700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d80a1860 con 0x7f21d8065840 2020-01-16T05:49:29.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.300+0000 7f21d6d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f21d80a3330 0x7f21d81349d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54186/0 (socket says 172.21.15.84:54186) 2020-01-16T05:49:29.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.300+0000 7f21d6d9d700 1 -- 172.21.15.84:0/1126734787 learned_addr learned my addr 172.21.15.84:0/1126734787 (peer_addr_for_me v1:172.21.15.84:0/0) 2020-01-16T05:49:29.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.300+0000 7f21dd1c8700 1 --2- 172.21.15.84:0/1126734787 >> v2:172.21.15.142:3300/0 conn(0x7f21d8065840 0x7f21d81403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:29.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.300+0000 7f21cffff700 1 -- 172.21.15.84:0/1126734787 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53866822 0 0) 0x7f21d8122c40 con 0x7f21d80a3330 2020-01-16T05:49:29.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.300+0000 7f21cffff700 1 -- 172.21.15.84:0/1126734787 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b0003230 con 0x7f21d80a3330 2020-01-16T05:49:29.308 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.300+0000 7f21dd1c8700 1 -- 172.21.15.84:0/1126734787 >> v1:172.21.15.142:6789/0 conn(0x7f21d80a1350 legacy=0x7f21d807cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:29.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.300+0000 7f21cffff700 1 -- 172.21.15.84:0/1126734787 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820792649 0 0) 0x7f21d807d3c0 con 0x7f21d80a1350 2020-01-16T05:49:29.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.300+0000 7f21dd1c8700 1 -- 172.21.15.84:0/1126734787 >> v1:172.21.15.84:6789/0 conn(0x7f21d80a3330 legacy=0x7f21d81349d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:29.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.300+0000 7f21dd1c8700 1 -- 172.21.15.84:0/1126734787 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d81351d0 con 0x7f21d8065840 2020-01-16T05:49:29.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.300+0000 7f21dd1c8700 1 --2- 172.21.15.84:0/1126734787 >> v2:172.21.15.142:3300/0 conn(0x7f21d8065840 0x7f21d81403f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f21d0000e90 tx=0x7f21d00108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:29.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.300+0000 7f21dd1c8700 1 --2- 172.21.15.84:0/1126734787 >> v2:172.21.15.142:3300/0 conn(0x7f21d8065840 0x7f21d81403f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f21d0000e90 tx=0x7f21d00108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:29.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.300+0000 7f21dd1c8700 1 --2- 172.21.15.84:0/1126734787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21d8065840 0x7f21d81403f0 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7f21d0000e90 tx=0x7f21d00108c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:29.309 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.304+0000 7f21dd1c8700 1 --2- 172.21.15.84:0/1126734787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21d8065840 0x7f21d81403f0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f21d0000e90 tx=0x7f21d00108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:29.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.304+0000 7f21cffff700 1 -- 172.21.15.84:0/1126734787 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21d0006cb0 con 0x7f21d8065840 2020-01-16T05:49:29.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.304+0000 7f21dd1c8700 1 --2- 172.21.15.84:0/1126734787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21d8065840 0x7f21d81403f0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f21d0000e90 tx=0x7f21d00108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:29.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.304+0000 7f21dd1c8700 1 --2- 172.21.15.84:0/1126734787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21d8065840 0x7f21d81403f0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f21d0000e90 tx=0x7f21d00108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:29.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.304+0000 7f21cffff700 1 -- 172.21.15.84:0/1126734787 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d00068d0 con 0x7f21d8065840 2020-01-16T05:49:29.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.304+0000 7f21dc9c7700 1 -- 172.21.15.84:0/1126734787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d81354a0 con 0x7f21d8065840 2020-01-16T05:49:29.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.304+0000 7f21cffff700 1 -- 172.21.15.84:0/1126734787 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21d00112f0 con 0x7f21d8065840 2020-01-16T05:49:29.310 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.304+0000 7f21dc9c7700 1 -- 172.21.15.84:0/1126734787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d8140940 con 0x7f21d8065840 2020-01-16T05:49:29.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.304+0000 7f21dc9c7700 1 -- 172.21.15.84:0/1126734787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d805e1c0 con 0x7f21d8065840 2020-01-16T05:49:29.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.304+0000 7f21dd1c8700 1 --2- 172.21.15.84:0/1126734787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21d8065840 0x7f21d81403f0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f21d0000e90 tx=0x7f21d00108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:29.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.304+0000 7f21cffff700 1 -- 172.21.15.84:0/1126734787 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 46357+0+0 (secure 0 0 0) 0x7f21d0011650 con 0x7f21d8065840 2020-01-16T05:49:29.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.304+0000 7f21dd1c8700 1 --2- 172.21.15.84:0/1126734787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21d8065840 0x7f21d81403f0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f21d0000e90 tx=0x7f21d00108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:29.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.304+0000 7f21cffff700 1 --2- 172.21.15.84:0/1126734787 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f21b003c760 0x7f21b003ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-16T05:49:29.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.304+0000 7f21cffff700 1 -- 172.21.15.84:0/1126734787 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5759+0+0 (secure 0 0 0) 0x7f21d004c7d0 con 0x7f21d8065840 2020-01-16T05:49:29.311 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.304+0000 7f21d759e700 1 --2- 172.21.15.84:0/1126734787 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f21b003c760 0x7f21b003ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-16T05:49:29.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.304+0000 7f21d759e700 1 --2- 172.21.15.84:0/1126734787 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f21b003c760 0x7f21b003ec70 crc :-1 s=READY pgs=219 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-16T05:49:29.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.312+0000 7f21dd1c8700 1 --2- 172.21.15.84:0/1126734787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21d8065840 0x7f21d81403f0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f21d0000e90 tx=0x7f21d00108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:29.312 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.312+0000 7f21cffff700 1 -- 172.21.15.84:0/1126734787 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+115515 (secure 0 0 0) 0x7f21d81354a0 con 0x7f21d8065840 2020-01-16T05:49:29.466 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.468+0000 7f21dc9c7700 1 -- 172.21.15.84:0/1126734787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21d805cbc0 con 0x7f21d8065840 2020-01-16T05:49:29.467 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.468+0000 7f21dd1c8700 1 --2- 172.21.15.84:0/1126734787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21d8065840 0x7f21d81403f0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f21d0000e90 tx=0x7f21d00108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-16T05:49:29.467 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.468+0000 7f21cffff700 1 -- 172.21.15.84:0/1126734787 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+1816 (secure 0 0 0) 0x7f21d0032dd0 con 0x7f21d8065840 2020-01-16T05:49:29.467 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-01-16T05:49:29.468 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-16T05:44:03.929689+0000","modified":"2020-01-16T05:45:26.539180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":6,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6835/571032774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":571032774},{"type":"v1","addr":"172.21.15.84:6835","nonce":571032774}]},"laggy_since":"2020-01-16T05:45:26.539100+0000","export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-16T05:49:29.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.472+0000 7f21dc9c7700 1 -- 172.21.15.84:0/1126734787 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f21b003c760 msgr2=0x7f21b003ec70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:29.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.472+0000 7f21dc9c7700 1 --2- 172.21.15.84:0/1126734787 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f21b003c760 0x7f21b003ec70 crc :-1 s=READY pgs=219 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:29.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.472+0000 7f21dc9c7700 1 -- 172.21.15.84:0/1126734787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21d8065840 msgr2=0x7f21d81403f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-16T05:49:29.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.472+0000 7f21dc9c7700 1 --2- 172.21.15.84:0/1126734787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21d8065840 0x7f21d81403f0 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7f21d0000e90 tx=0x7f21d00108c0).stop 2020-01-16T05:49:29.470 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.472+0000 7f21dc9c7700 1 -- 172.21.15.84:0/1126734787 shutdown_connections 2020-01-16T05:49:29.471 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.472+0000 7f21dc9c7700 1 --2- 172.21.15.84:0/1126734787 >> [v2:172.21.15.84:6800/12486,v1:172.21.15.84:6801/12486] conn(0x7f21b003c760 0x7f21b003ec70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:29.471 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.472+0000 7f21dc9c7700 1 --2- 172.21.15.84:0/1126734787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21d8065840 0x7f21d81403f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rx=0 tx=0).stop 2020-01-16T05:49:29.471 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.472+0000 7f21dc9c7700 1 -- 172.21.15.84:0/1126734787 shutdown_connections 2020-01-16T05:49:29.473 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.472+0000 7f21dc9c7700 1 -- 172.21.15.84:0/1126734787 wait complete. 2020-01-16T05:49:29.473 INFO:teuthology.orchestra.run.smithi084.stderr:2020-01-16T05:49:29.472+0000 7f21dc9c7700 1 -- 172.21.15.84:0/1126734787 >> 172.21.15.84:0/1126734787 conn(0x7f21d80ab6b0 msgr2=0x7f21d80a4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-16T05:49:29.473 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2020-01-16T05:49:29.479 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-01-16T05:49:29.480 DEBUG:teuthology.task.console_log:Killing console logger for smithi142 2020-01-16T05:49:29.480 DEBUG:teuthology.task.console_log:Killing console logger for smithi084 2020-01-16T05:49:29.480 DEBUG:teuthology.task.console_log:Killing console logger for smithi142 2020-01-16T05:49:29.480 DEBUG:teuthology.task.console_log:Killing console logger for smithi084 2020-01-16T05:49:29.481 DEBUG:teuthology.exit:Finished running handlers